-- Logs begin at Fri 2022-07-15 16:52:05 UTC, end at Fri 2022-07-15 17:58:34 UTC. -- Jul 15 17:22:59.074431 dv-cinder-836973-11-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 15 17:22:59.086379 dv-cinder-836973-11-smb devstack@keystone.service[80138]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 15 17:22:59.088484 dv-cinder-836973-11-smb devstack@keystone.service[80138]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 15 17:22:59 2022] *** Jul 15 17:22:59.088484 dv-cinder-836973-11-smb devstack@keystone.service[80138]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 15 17:22:59.088484 dv-cinder-836973-11-smb devstack@keystone.service[80138]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 15 17:22:59.088484 dv-cinder-836973-11-smb devstack@keystone.service[80138]: nodename: dv-cinder-836973-11-smb Jul 15 17:22:59.088484 dv-cinder-836973-11-smb devstack@keystone.service[80138]: machine: x86_64 Jul 15 17:22:59.088484 dv-cinder-836973-11-smb devstack@keystone.service[80138]: clock source: unix Jul 15 17:22:59.088484 dv-cinder-836973-11-smb devstack@keystone.service[80138]: pcre jit disabled Jul 15 17:22:59.088484 dv-cinder-836973-11-smb devstack@keystone.service[80138]: detected number of CPU cores: 4 Jul 15 17:22:59.088484 dv-cinder-836973-11-smb devstack@keystone.service[80138]: current working directory: / Jul 15 17:22:59.088484 dv-cinder-836973-11-smb devstack@keystone.service[80138]: detected binary path: /usr/bin/uwsgi-core Jul 15 17:22:59.088484 dv-cinder-836973-11-smb devstack@keystone.service[80138]: your processes number limit is 47680 Jul 15 17:22:59.088484 dv-cinder-836973-11-smb devstack@keystone.service[80138]: your memory page size is 4096 bytes Jul 15 17:22:59.088484 dv-cinder-836973-11-smb devstack@keystone.service[80138]: detected max file descriptor number: 2048 Jul 15 17:22:59.088484 dv-cinder-836973-11-smb devstack@keystone.service[80138]: lock engine: pthread robust mutexes Jul 15 17:22:59.089286 dv-cinder-836973-11-smb devstack@keystone.service[80138]: thunder lock: enabled Jul 15 17:22:59.089286 dv-cinder-836973-11-smb devstack@keystone.service[80138]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 15 17:22:59.089286 dv-cinder-836973-11-smb devstack@keystone.service[80138]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 15 17:22:59.128355 dv-cinder-836973-11-smb devstack@keystone.service[80138]: Python main interpreter initialized at 0x56121efc59c0 Jul 15 17:22:59.128355 dv-cinder-836973-11-smb devstack@keystone.service[80138]: python threads support enabled Jul 15 17:22:59.128355 dv-cinder-836973-11-smb devstack@keystone.service[80138]: your server socket listen backlog is limited to 100 connections Jul 15 17:22:59.128355 dv-cinder-836973-11-smb devstack@keystone.service[80138]: your mercy for graceful operations on workers is 90 seconds Jul 15 17:22:59.128703 dv-cinder-836973-11-smb devstack@keystone.service[80138]: mapped 403077 bytes (393 KB) for 2 cores Jul 15 17:22:59.128775 dv-cinder-836973-11-smb devstack@keystone.service[80138]: *** Operational MODE: preforking *** Jul 15 17:22:59.129024 dv-cinder-836973-11-smb devstack@keystone.service[80138]: *** uWSGI is running in multiple interpreter mode *** Jul 15 17:22:59.129024 dv-cinder-836973-11-smb devstack@keystone.service[80138]: spawned uWSGI master process (pid: 80138) Jul 15 17:22:59.129232 dv-cinder-836973-11-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 15 17:22:59.129944 dv-cinder-836973-11-smb devstack@keystone.service[80138]: spawned uWSGI worker 1 (pid: 80149, cores: 1) Jul 15 17:22:59.131567 dv-cinder-836973-11-smb devstack@keystone.service[80138]: spawned uWSGI worker 2 (pid: 80150, cores: 1) Jul 15 17:22:59.131567 dv-cinder-836973-11-smb devstack@keystone.service[80138]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 15 17:23:04.427386 dv-cinder-836973-11-smb devstack@keystone.service[80149]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 17:23:04.427386 dv-cinder-836973-11-smb devstack@keystone.service[80149]: from cryptography.utils import int_from_bytes Jul 15 17:23:04.428189 dv-cinder-836973-11-smb devstack@keystone.service[80150]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 17:23:04.428189 dv-cinder-836973-11-smb devstack@keystone.service[80150]: from cryptography.utils import int_from_bytes Jul 15 17:23:04.428607 dv-cinder-836973-11-smb devstack@keystone.service[80149]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 17:23:04.428607 dv-cinder-836973-11-smb devstack@keystone.service[80149]: from cryptography.utils import int_from_bytes Jul 15 17:23:04.428714 dv-cinder-836973-11-smb devstack@keystone.service[80150]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 17:23:04.428714 dv-cinder-836973-11-smb devstack@keystone.service[80150]: from cryptography.utils import int_from_bytes Jul 15 17:23:04.476618 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 15 17:23:04.476812 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 15 17:23:04.476963 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] command line args: [] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 15 17:23:04.477060 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 15 17:23:04.477206 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 15 17:23:04.477344 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 15 17:23:04.477435 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] command line args: [] {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 15 17:23:04.477510 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ================================================================================ {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 15 17:23:04.477656 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 15 17:23:04.477745 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] admin_token = **** {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.477845 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ================================================================================ {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 15 17:23:04.477921 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] config_dir = [] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.478074 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] admin_token = **** {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.478206 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.478206 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] config_source = [] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.478348 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] config_dir = [] {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.478410 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] debug = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.478478 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.478666 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.478903 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] config_source = [] {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.478903 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] debug = True {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.479034 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.479106 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.479194 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.479259 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.480246 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.480334 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.480406 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.480472 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.480472 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] list_limit = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.480582 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.480639 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] log_config_append = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.480696 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] list_limit = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.480763 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.480827 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] log_config_append = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.480891 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] log_dir = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.480953 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.481015 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] log_file = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.481071 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] log_dir = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.481071 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] log_file = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.481185 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.481244 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.481302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.481357 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.481414 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.481481 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.481544 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.481544 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.481659 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.481722 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.481823 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.481896 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.481967 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.482169 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.482245 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.482379 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.482577 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.482666 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.482744 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.482865 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.482940 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.483054 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.483141 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.483218 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.483340 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.483421 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.483492 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.483688 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.483823 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.484039 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.484765 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.484897 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.484897 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] publish_errors = False {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.485120 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] publish_errors = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.485195 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.485267 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.485394 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.485477 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.485557 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.485638 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.485715 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.485830 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.485914 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.485989 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.486067 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] standard_threads = False {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.486139 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] standard_threads = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.486213 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.486351 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.486425 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.486495 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.486564 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.486640 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.486716 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] use_journal = False {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.486844 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] use_journal = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.486925 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] use_json = False {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.486997 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] use_json = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.487066 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] use_stderr = False {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.487142 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] use_stderr = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.487220 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] use_syslog = False {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.487294 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] use_syslog = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.487401 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.487487 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 17:23:04.487673 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.487796 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.487891 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.487999 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.488152 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.488274 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.488362 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.488520 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.488655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.488743 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.488817 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.488980 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.489113 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.489193 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.489278 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.489445 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.489568 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.489645 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.489717 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.489931 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.490032 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.490175 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.490256 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.490410 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.490491 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.490635 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.490725 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.490874 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.490954 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.491112 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.491199 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.491343 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.491503 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.491579 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.491650 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.491813 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.491896 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.492046 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.492135 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.492277 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.492367 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.492519 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.492600 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.492765 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.492855 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.493008 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.493094 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.493224 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.493301 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.493460 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.493634 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.493759 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.493860 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.493931 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.494013 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.494135 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.494230 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.494371 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.494453 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.494611 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.494692 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.494834 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.494922 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.495037 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.495114 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.495273 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.495348 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.495510 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.495586 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.495742 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.495820 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.495979 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.496060 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.496207 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.496283 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.496436 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.496511 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.496662 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.496738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.496885 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.496958 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.497096 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.497173 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.497323 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.497398 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.497544 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.497621 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.497768 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.497897 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.498027 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.498443 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.498443 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.498595 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.498672 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.498743 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.498813 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.498882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.498959 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.499030 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.499105 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.499181 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.499332 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.499409 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.499581 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.499827 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.500245 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.500357 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.500456 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.500584 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.500696 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.500800 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.500897 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.500999 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.501096 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.501190 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.501332 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.501436 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.501552 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.501627 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.501740 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.501836 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.501926 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.502007 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.502080 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.502209 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.502288 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.502360 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.502482 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.502596 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.502686 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.502762 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.502881 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.502963 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.503034 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.503148 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.503234 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.503307 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.503421 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.503495 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.503601 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.503743 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.503832 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.503906 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.504078 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.504201 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.504279 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.504366 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.504521 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.504644 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.504718 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.504791 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.504981 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.505117 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.505199 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.505272 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.505430 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.505553 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.505631 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.505721 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.505873 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.505951 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.506115 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.506239 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.506317 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.506402 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.506563 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.506686 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.506764 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.506836 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.507035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.507172 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.507254 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.507334 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.507483 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.507606 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.507695 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.507848 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.507932 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.508013 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.508160 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.508283 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.508363 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.508450 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.508607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.508747 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.508843 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.508916 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.509059 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.509183 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.509262 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.509348 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.509503 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.509626 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.509705 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.509799 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.509980 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.510131 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.510223 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.510298 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.510449 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.510572 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.510651 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.510737 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.510925 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.511049 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.511264 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.511388 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.511468 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] auth.external = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.511556 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.511714 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.511837 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] auth.external = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.511915 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.511986 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.512613 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.512707 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.512792 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] auth.password = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.512867 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.512934 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] auth.token = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.513004 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] auth.password = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.513075 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.513145 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] auth.token = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.513227 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.513307 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.513379 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.513458 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.513535 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.513729 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.513909 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.513995 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.514068 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.514216 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.514341 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.514419 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] credential.caching = True {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.514506 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.514664 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.514798 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.514880 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.514953 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] credential.caching = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.515209 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.515345 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.515593 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.516004 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.516086 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.516159 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.516232 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.516232 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.516381 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.516456 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.516530 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.516600 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.516677 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.516757 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.516830 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.517037 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.517161 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.517250 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.517340 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.517510 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.517634 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.517714 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.517811 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.518017 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.518157 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.518249 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] federation.caching = True {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.518334 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.518446 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.518533 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.518702 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.518826 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.518920 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.518997 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] federation.caching = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.519150 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.519275 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.519353 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.519438 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.519606 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.519731 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.519810 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.519884 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.520066 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.520192 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.520285 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.520362 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.520527 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.520652 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.520732 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.520805 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.520981 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] identity.caching = True {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.521106 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.521185 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.521268 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.521449 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.521573 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.521736 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.521837 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] identity.caching = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.521912 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.521984 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.522139 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.522284 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.522371 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.522445 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.522592 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.522716 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.522795 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.522882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.523040 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.523125 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.523264 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.523346 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.523485 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.523584 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.523711 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.523794 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.523947 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.524030 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.524172 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.524263 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.524402 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.524485 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.524646 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.524727 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.524878 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.524971 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.525118 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.525200 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.525358 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.525440 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.525591 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.525684 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.525814 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.525898 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.526064 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.526148 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.526298 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.526395 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.526527 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.526609 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.526761 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.526844 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.526973 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.527059 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.527220 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.527298 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.527446 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.527528 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.527686 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.527772 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.527922 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.527999 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.528149 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.528225 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.528385 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.528479 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.528622 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.528702 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.528845 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.528923 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.529077 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.529165 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.529299 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.529378 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.529528 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.529606 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.529758 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.529898 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.530008 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.530084 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.530238 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.530314 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.530470 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.530554 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.530708 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.530845 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.531006 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.531475 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.531562 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.531640 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.531703 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.531703 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.531808 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.531867 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.531938 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.532063 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.532150 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.532290 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.532369 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.532519 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.532597 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.532742 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.user = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.532821 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.532972 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.533050 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.533209 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.533285 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.533427 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.533504 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.533656 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.533733 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.533913 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.534171 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.534334 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.534451 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.534581 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.534701 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.534813 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.534946 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.535087 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.535188 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.535319 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.535421 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.535549 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.535636 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.535779 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.535857 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.536002 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.536080 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.536241 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.536328 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.536480 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.536557 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.536717 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.536794 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.536978 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.537221 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.537299 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.537463 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.537542 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.537687 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.537764 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.537943 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.538023 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.538174 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.538251 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.538405 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.538483 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.538635 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.538713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.538860 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.538940 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.539090 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.539166 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.539327 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.539405 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.539563 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.539641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.539799 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.539876 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.540024 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.540102 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.540262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.540340 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.540495 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.540572 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.540724 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.540804 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.540955 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.541031 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.541190 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.541267 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.541425 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.541503 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.541648 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.541724 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.541901 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.541981 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.542136 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.542216 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] resource.caching = True {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.542374 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] resource.caching = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.542450 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.542611 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.542687 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.542841 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.542920 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.543074 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.543149 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.543318 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.543394 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.543548 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.543628 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.543784 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.543860 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.544012 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.544089 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.544240 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.544315 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.544470 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] role.caching = True {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.544547 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.544700 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] role.caching = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.544776 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] role.driver = sql {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.544921 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.544999 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] role.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.545158 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.545235 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.545395 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.545472 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.545634 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.545714 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.545895 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.545976 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.546137 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.546228 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.546452 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.546540 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.546760 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.547197 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.547283 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.547367 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.547441 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.547513 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.547583 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.547654 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.547724 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.547803 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.547876 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.547947 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.548017 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.548094 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.548303 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.548396 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.548629 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.548707 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.548874 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.548952 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.549116 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.549202 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.549356 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.549434 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.549598 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.549677 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.549868 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.550001 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.550110 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.550186 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.550354 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.550432 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.550588 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.550675 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.550815 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.550893 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.551045 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.551163 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.551285 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.551424 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.551552 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.551668 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.551779 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.551890 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.552030 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.552160 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.552278 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.552392 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.552508 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.552620 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.552745 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.552859 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.552972 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] token.caching = True {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.553085 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.553198 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.553310 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] token.caching = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.553433 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.553547 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.553660 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.553773 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.553904 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.554009 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.554133 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.554256 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.554363 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.554469 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.554579 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.554688 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.554806 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.554915 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.555021 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.555128 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.555236 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.555342 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.555460 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.555568 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.555676 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.555781 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.555887 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.555996 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.556115 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.556223 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.556331 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.556435 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.556544 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.556649 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.556773 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.556883 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.556990 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] database.connection = **** {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.557109 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.557227 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.557335 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] database.connection = **** {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.557455 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.557575 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.557686 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.557874 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.557987 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.558096 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.558202 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.558310 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.558418 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.558544 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.558655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.558764 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.558870 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.558978 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.559084 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.559202 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.559314 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.559423 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.559532 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.559638 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.559748 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.559865 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.559976 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.560084 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.560191 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.560298 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.560406 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.560524 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.560634 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.560744 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.560851 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.560960 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.561069 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.561187 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.561297 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 15 17:23:04.561405 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 17:23:04.561405 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 15 17:23:04.592332 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80150) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.592506 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80150) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.592598 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.592667 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80150) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.592749 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.592952 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.601034 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80150) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.601362 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.629365 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.629534 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80150) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.629604 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.629666 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80150) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.772128 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.772876 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80150) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.820796 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80150) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.820973 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80150) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.822328 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.822562 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.884920 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.885090 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.885273 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.885492 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.885711 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.885945 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.887410 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80150) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.887812 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80150) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.888207 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80150) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.888582 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80150) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.888969 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80150) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.889357 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80150) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.911685 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.911891 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.912118 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.912314 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.912595 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.912719 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80150) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.912793 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.912970 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.913109 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80150) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.913183 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80150) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.913400 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80150) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.913902 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80150) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.914134 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80150) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.914343 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80150) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.924223 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.924507 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80150) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.936915 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.937232 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.937473 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80150) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.937623 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.937741 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.937853 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80150) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.938010 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.938222 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.938366 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80150) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.938440 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80149) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.938526 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80150) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.938634 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80150) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.938880 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80150) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.939094 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80150) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 17:23:04.956227 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:04.956414 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 15 17:23:04.956767 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:04.957216 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 15 17:23:04.957482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:04.957742 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:04.958022 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:04.958277 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:04.959285 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:04.959493 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 15 17:23:04.960071 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:04.960272 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 15 17:23:04.960520 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:04.960776 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:04.961027 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:04.961272 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:04.969089 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:04.969439 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:04.969706 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:04.970000 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:04.972724 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:04.972995 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:04.973251 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:04.973532 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:04.978175 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 17:23:04.981438 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 17:23:04.981662 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80150) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 17:23:04.981831 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:04.982005 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:04.982283 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:04.982561 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:04.982822 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:04.983086 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:04.983356 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:04.983621 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:04.983891 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:04.984311 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:04.984927 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80150) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 17:23:04.985201 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:04.985472 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:04.985745 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:04.986044 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:04.986297 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:04.986559 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:04.986822 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:04.987082 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:04.987328 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:04.987584 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.010757 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.012360 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 17:23:05.012634 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.013897 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.015541 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80150) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 17:23:05.015815 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.018128 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 17:23:05.018405 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.018678 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.021042 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80150) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 17:23:05.021318 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.021587 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.026070 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 17:23:05.026352 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.028902 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80150) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 17:23:05.029182 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.030840 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 17:23:05.031201 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.031479 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.031756 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.032030 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.032299 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.032565 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.032828 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.033631 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80150) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 17:23:05.033934 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.034196 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.034468 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.034740 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.035009 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.035271 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.035529 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.051412 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.051680 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.054296 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.054565 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.056209 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 17:23:05.059067 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80150) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 17:23:05.059906 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.060193 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.063380 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.063669 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.065298 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 17:23:05.068720 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80150) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 17:23:05.068926 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 17:23:05.072318 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80150) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 17:23:05.072562 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.072852 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.073132 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.073408 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.073708 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.074003 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.075912 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.076199 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.076485 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.076761 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.077048 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.077320 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.093266 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 17:23:05.093567 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.093837 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.094127 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.097005 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80150) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 17:23:05.097297 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.097562 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.097832 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.102000 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.103704 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.103981 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.105641 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.107178 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 17:23:05.107319 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.107435 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.107605 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.107745 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.108018 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.108290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.111173 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80150) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 17:23:05.111459 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.111746 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.112027 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.112307 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.121527 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 17:23:05.121823 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.122105 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.122381 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.122658 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.122926 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.123209 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.125646 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80150) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 17:23:05.125944 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.126217 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.126489 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.126755 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.127037 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.127312 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.142583 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 17:23:05.145755 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 17:23:05.146269 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80150) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 17:23:05.149043 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.149505 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80150) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 17:23:05.150673 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.152441 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 17:23:05.152714 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.152858 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.152965 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.154364 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.156148 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80150) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 17:23:05.156421 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.156697 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.160406 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.162106 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 17:23:05.163920 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.165294 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.165508 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80150) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 17:23:05.165654 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.165866 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.166140 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.168802 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.169087 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.169362 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.169629 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.175345 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 17:23:05.175625 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.175897 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.178863 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80150) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 17:23:05.179145 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.179416 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.183689 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80149) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 17:23:05.183963 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.184246 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.184513 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.184791 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.185062 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.185339 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.185605 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.185998 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.186266 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.186539 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.186782 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.187078 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.187165 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80150) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 17:23:05.187346 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80149) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.187433 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.187687 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.187955 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.188227 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.188507 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.188780 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.189030 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.189387 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.189660 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.189956 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.190223 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.190492 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.190753 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80150) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 17:23:05.225080 dv-cinder-836973-11-smb devstack@keystone.service[80149]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56121efc59c0 pid: 80149 (default app) Jul 15 17:23:05.228374 dv-cinder-836973-11-smb devstack@keystone.service[80150]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56121efc59c0 pid: 80150 (default app) Jul 15 17:23:05.228500 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c960b-80ae-4a33-88a7-3283adf3bc94 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:05.228803 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c960b-80ae-4a33-88a7-3283adf3bc94 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:05.229083 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c960b-80ae-4a33-88a7-3283adf3bc94 None None] PATH_INFO: `/v3` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:05.233329 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 791 bytes} [Fri Jul 15 17:23:05 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:12.824805 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db87786-5488-4e69-897d-ce649b3359d6 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:12.825701 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db87786-5488-4e69-897d-ce649b3359d6 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:12.825888 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db87786-5488-4e69-897d-ce649b3359d6 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:12.831468 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1/2] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:23:12 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:23:12.837824 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9790e-9f30-45ac-aeef-c788a6bd7697 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:12.838513 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9790e-9f30-45ac-aeef-c788a6bd7697 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:12.838617 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9790e-9f30-45ac-aeef-c788a6bd7697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:12.913924 dv-cinder-836973-11-smb devstack@keystone.service[80149]: INFO dbcounter [None req-39b9790e-9f30-45ac-aeef-c788a6bd7697 None None] Registered counter for database keystone Jul 15 17:23:12.938228 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG oslo_db.sqlalchemy.engines [None req-39b9790e-9f30-45ac-aeef-c788a6bd7697 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80149) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 17:23:12.949655 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writer thread running {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 17:23:13.139281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG passlib.handlers.bcrypt [None req-39b9790e-9f30-45ac-aeef-c788a6bd7697 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80149) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 15 17:23:13.139597 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG passlib.handlers.bcrypt [None req-39b9790e-9f30-45ac-aeef-c788a6bd7697 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80149) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 15 17:23:13.193795 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-39b9790e-9f30-45ac-aeef-c788a6bd7697 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:23:13.195420 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-39b9790e-9f30-45ac-aeef-c788a6bd7697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:23:13.331621 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 2/3] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:23:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 496 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 15 17:23:13.484408 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db87786-5488-4e69-897d-ce649b3359d6 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:13.559681 dv-cinder-836973-11-smb devstack@keystone.service[80150]: INFO dbcounter [None req-1db87786-5488-4e69-897d-ce649b3359d6 None None] Registered counter for database keystone Jul 15 17:23:13.581047 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG oslo_db.sqlalchemy.engines [None req-1db87786-5488-4e69-897d-ce649b3359d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80150) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 17:23:13.588900 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writer thread running {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 17:23:13.714329 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db87786-5488-4e69-897d-ce649b3359d6 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:13.720003 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264c65e-c6cc-43ef-951b-68b9df6725b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:13.720659 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264c65e-c6cc-43ef-951b-68b9df6725b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:13.720939 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264c65e-c6cc-43ef-951b-68b9df6725b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:13.721214 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264c65e-c6cc-43ef-951b-68b9df6725b1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:13.730304 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1264c65e-c6cc-43ef-951b-68b9df6725b1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:13.781199 dv-cinder-836973-11-smb devstack@keystone.service[80150]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1264c65e-c6cc-43ef-951b-68b9df6725b1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 15 17:23:13.781519 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1264c65e-c6cc-43ef-951b-68b9df6725b1 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:13.791716 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 2/4] 10.222.0.27 () {58 vars in 1324 bytes} [Fri Jul 15 17:23:13 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 17:23:13.799064 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9790e-9f30-45ac-aeef-c788a6bd7697 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:13.820018 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9790e-9f30-45ac-aeef-c788a6bd7697 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:13.826608 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429d182-3fc8-4738-8ec3-68ba5f8bb849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:13.827789 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429d182-3fc8-4738-8ec3-68ba5f8bb849 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:13.828050 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429d182-3fc8-4738-8ec3-68ba5f8bb849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:13.828424 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429d182-3fc8-4738-8ec3-68ba5f8bb849 admin admin] PATH_INFO: `/v3/projects/3c32a3d29e5f4e56a46352866cc5acd0` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:13.830117 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a429d182-3fc8-4738-8ec3-68ba5f8bb849 admin admin] RBAC: Authorizing `identity:get_project(project_id=3c32a3d29e5f4e56a46352866cc5acd0)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:13.887045 dv-cinder-836973-11-smb devstack@keystone.service[80149]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a429d182-3fc8-4738-8ec3-68ba5f8bb849 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 15 17:23:13.887705 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a429d182-3fc8-4738-8ec3-68ba5f8bb849 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:13.892487 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 3/5] 10.222.0.27 () {56 vars in 1207 bytes} [Fri Jul 15 17:23:13 2022] GET /identity/v3/projects/3c32a3d29e5f4e56a46352866cc5acd0 => generated 344 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:15.865560 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef4444-6322-45e7-a66c-ec605ecf32c0 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:15.866490 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef4444-6322-45e7-a66c-ec605ecf32c0 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:15.866490 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef4444-6322-45e7-a66c-ec605ecf32c0 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:15.873304 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 3/6] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:23:15 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:23:15.879025 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923bebd7-bfa0-4f50-9605-dc15b7469578 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:15.879456 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923bebd7-bfa0-4f50-9605-dc15b7469578 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:15.879548 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923bebd7-bfa0-4f50-9605-dc15b7469578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:15.899950 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-923bebd7-bfa0-4f50-9605-dc15b7469578 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:23:15.901478 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-923bebd7-bfa0-4f50-9605-dc15b7469578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:23:15.910523 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 4/7] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:23:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 15 17:23:15.932767 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef4444-6322-45e7-a66c-ec605ecf32c0 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:15.948678 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef4444-6322-45e7-a66c-ec605ecf32c0 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:15.954245 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3a6c7-7924-4f9c-af63-2ff708fd5e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:15.954895 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3a6c7-7924-4f9c-af63-2ff708fd5e62 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:15.955179 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3a6c7-7924-4f9c-af63-2ff708fd5e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:15.955786 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3a6c7-7924-4f9c-af63-2ff708fd5e62 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:15.964296 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d3a6c7-7924-4f9c-af63-2ff708fd5e62 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:15.966138 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d3a6c7-7924-4f9c-af63-2ff708fd5e62 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:15.975351 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 4/8] 10.222.0.27 () {58 vars in 1324 bytes} [Fri Jul 15 17:23:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 17:23:15.983737 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923bebd7-bfa0-4f50-9605-dc15b7469578 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:15.998794 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923bebd7-bfa0-4f50-9605-dc15b7469578 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:16.005453 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450d400-ebf2-467e-a610-d82093f525cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:16.006363 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450d400-ebf2-467e-a610-d82093f525cf admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:16.006651 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450d400-ebf2-467e-a610-d82093f525cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:16.006929 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450d400-ebf2-467e-a610-d82093f525cf admin admin] PATH_INFO: `/v3/users/23aa6e5135404cb6a45a96628c2e41d6` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:16.008489 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c450d400-ebf2-467e-a610-d82093f525cf admin admin] RBAC: Authorizing `identity:get_user(user_id=23aa6e5135404cb6a45a96628c2e41d6)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:16.010364 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c450d400-ebf2-467e-a610-d82093f525cf admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:16.012005 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 5/9] 10.222.0.27 () {56 vars in 1198 bytes} [Fri Jul 15 17:23:15 2022] GET /identity/v3/users/23aa6e5135404cb6a45a96628c2e41d6 => generated 247 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:18.061602 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fc584-8880-42c8-badb-a21c8b089bca None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:18.062212 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fc584-8880-42c8-badb-a21c8b089bca None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:18.062378 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fc584-8880-42c8-badb-a21c8b089bca None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:18.064745 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 5/10] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:23:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:23:18.070352 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90ed1b-b4e0-400b-9876-25c9e2cf6d6d None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:18.070825 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90ed1b-b4e0-400b-9876-25c9e2cf6d6d None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:18.070919 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90ed1b-b4e0-400b-9876-25c9e2cf6d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:18.083627 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26584ec6-9b57-4513-bc50-6aa7ec273fe1 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:18.084006 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26584ec6-9b57-4513-bc50-6aa7ec273fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:18.084378 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26584ec6-9b57-4513-bc50-6aa7ec273fe1 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:18.086480 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 6/11] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:23:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:23:18.090533 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-8a90ed1b-b4e0-400b-9876-25c9e2cf6d6d None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:23:18.091638 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00ef16-0819-459c-b115-58b0fbf5b65e None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:18.091730 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8a90ed1b-b4e0-400b-9876-25c9e2cf6d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:23:18.091926 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00ef16-0819-459c-b115-58b0fbf5b65e None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:18.092201 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00ef16-0819-459c-b115-58b0fbf5b65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:18.134671 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG passlib.handlers.bcrypt [None req-fb00ef16-0819-459c-b115-58b0fbf5b65e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80150) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 15 17:23:18.135072 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG passlib.handlers.bcrypt [None req-fb00ef16-0819-459c-b115-58b0fbf5b65e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80150) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 15 17:23:18.174833 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 6/12] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:23:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:23:18.181405 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-fb00ef16-0819-459c-b115-58b0fbf5b65e None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:23:18.183072 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-fb00ef16-0819-459c-b115-58b0fbf5b65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:23:18.197808 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a90ed1b-b4e0-400b-9876-25c9e2cf6d6d None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:18.224232 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:18.283731 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 7/13] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:23:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:23:18.305147 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00ef16-0819-459c-b115-58b0fbf5b65e None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:18.305302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a90ed1b-b4e0-400b-9876-25c9e2cf6d6d None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:18.340981 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9611dad-3dda-4901-97e8-0f44bcdd81a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:18.341804 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9611dad-3dda-4901-97e8-0f44bcdd81a7 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:18.342088 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9611dad-3dda-4901-97e8-0f44bcdd81a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:18.342358 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9611dad-3dda-4901-97e8-0f44bcdd81a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:18.353811 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9611dad-3dda-4901-97e8-0f44bcdd81a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:23:18.365288 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-f9611dad-3dda-4901-97e8-0f44bcdd81a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:23:18.365288 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:23:18.365288 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:23:18.365288 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:23:18.365288 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:23:18.365288 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:23:18.365288 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:23:18.365288 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:23:18.365288 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:23:18.365288 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:23:18.365288 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:23:18.365288 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:23:18.365288 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:23:18.365288 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:23:18.365288 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:23:18.365288 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:23:18.366221 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:23:18.366221 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:23:18.366221 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:23:18.366221 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:23:18.366221 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:23:18.366221 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:23:18.366221 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:23:18.366221 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:23:18.366221 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:23:18.366221 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:23:18.366221 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:23:18.366221 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:23:18.366221 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:23:18.366221 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:23:18.366221 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:23:18.366221 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:23:18.367043 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:23:18.367043 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:23:18.367043 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:23:18.367043 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:23:18.367043 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:23:18.367043 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:23:18.367043 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:23:18.367043 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:23:18.367043 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:23:18.367043 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:23:18.367043 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:23:18.367043 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:23:18.367043 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 7/14] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jul 15 17:23:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 17:23:18.372327 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9611dad-3dda-4901-97e8-0f44bcdd81a7 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:18.405675 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00ef16-0819-459c-b115-58b0fbf5b65e None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:18.408120 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:18.442522 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36388bdb-f1e0-4ed8-bdbc-1ce40e263d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:18.443419 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36388bdb-f1e0-4ed8-bdbc-1ce40e263d6d None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:18.443700 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36388bdb-f1e0-4ed8-bdbc-1ce40e263d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:18.443969 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36388bdb-f1e0-4ed8-bdbc-1ce40e263d6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:18.454089 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:18.472480 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9611dad-3dda-4901-97e8-0f44bcdd81a7 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:18.505877 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393e43b-8d01-4709-83d1-08894148e9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:18.506542 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393e43b-8d01-4709-83d1-08894148e9ca None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:18.506821 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393e43b-8d01-4709-83d1-08894148e9ca None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:18.507093 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393e43b-8d01-4709-83d1-08894148e9ca None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:18.507854 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9393e43b-8d01-4709-83d1-08894148e9ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:18.508153 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9393e43b-8d01-4709-83d1-08894148e9ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:18.509554 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9393e43b-8d01-4709-83d1-08894148e9ca None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:18.510915 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36388bdb-f1e0-4ed8-bdbc-1ce40e263d6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:18.512415 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36388bdb-f1e0-4ed8-bdbc-1ce40e263d6d None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:18.521700 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 8/15] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:23:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:23:18.527509 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393e43b-8d01-4709-83d1-08894148e9ca None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:18.614036 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 8/16] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:23:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 17:23:18.616858 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36388bdb-f1e0-4ed8-bdbc-1ce40e263d6d None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:18.619656 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:18.626895 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393e43b-8d01-4709-83d1-08894148e9ca None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:18.660806 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad6f10-5fca-47db-9e22-f565ef48d7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:18.661692 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad6f10-5fca-47db-9e22-f565ef48d7df None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:18.662002 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad6f10-5fca-47db-9e22-f565ef48d7df None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:18.662277 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad6f10-5fca-47db-9e22-f565ef48d7df None admin] PATH_INFO: `/v3/users/23aa6e5135404cb6a45a96628c2e41d6` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:18.663482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ad6f10-5fca-47db-9e22-f565ef48d7df None admin] RBAC: Authorizing `identity:get_user(user_id=23aa6e5135404cb6a45a96628c2e41d6)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:18.664963 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ad6f10-5fca-47db-9e22-f565ef48d7df None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:18.666645 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 9/17] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:23:18 2022] GET /identity/v3/users/23aa6e5135404cb6a45a96628c2e41d6 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:18.672136 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad6f10-5fca-47db-9e22-f565ef48d7df None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:18.686827 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:18.714163 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36388bdb-f1e0-4ed8-bdbc-1ce40e263d6d None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:18.749204 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1953861-3783-4ba1-9b3a-a9d607d30b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:18.750074 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1953861-3783-4ba1-9b3a-a9d607d30b4a None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:18.750360 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1953861-3783-4ba1-9b3a-a9d607d30b4a None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:18.750638 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1953861-3783-4ba1-9b3a-a9d607d30b4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:18.769444 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1953861-3783-4ba1-9b3a-a9d607d30b4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:18.769846 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad6f10-5fca-47db-9e22-f565ef48d7df None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:18.770986 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1953861-3783-4ba1-9b3a-a9d607d30b4a None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:18.791971 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-d1953861-3783-4ba1-9b3a-a9d607d30b4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:23:18.791971 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:23:18.791971 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:23:18.791971 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:23:18.791971 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:23:18.791971 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:23:18.791971 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:23:18.791971 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:23:18.791971 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:23:18.791971 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:23:18.791971 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:23:18.791971 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:23:18.791971 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:23:18.791971 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:23:18.791971 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:23:18.792819 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:23:18.792819 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:23:18.792819 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:23:18.792819 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:23:18.792819 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:23:18.792819 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:23:18.792819 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:23:18.792819 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:23:18.792819 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:23:18.792819 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:23:18.792819 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:23:18.792819 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:23:18.792819 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:23:18.792819 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:23:18.792819 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:23:18.792819 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:23:18.792819 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:23:18.793618 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:23:18.793618 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:23:18.793618 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:23:18.793618 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:23:18.794307 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 9/18] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:23:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:23:18.799197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1953861-3783-4ba1-9b3a-a9d607d30b4a None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:18.802629 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90aa31-2949-4403-bc0c-d1bb7543c2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:18.803438 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90aa31-2949-4403-bc0c-d1bb7543c2c5 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:18.803715 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90aa31-2949-4403-bc0c-d1bb7543c2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:18.803987 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90aa31-2949-4403-bc0c-d1bb7543c2c5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:18.805259 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af90aa31-2949-4403-bc0c-d1bb7543c2c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:18.806704 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af90aa31-2949-4403-bc0c-d1bb7543c2c5 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:18.808549 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 10/19] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:23:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:23:18.814089 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90aa31-2949-4403-bc0c-d1bb7543c2c5 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:18.854126 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:18.895664 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:18.897909 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1953861-3783-4ba1-9b3a-a9d607d30b4a None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:18.914955 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90aa31-2949-4403-bc0c-d1bb7543c2c5 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:18.932641 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d8e48-8db0-45d0-8abc-c7e90163c0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:18.933299 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d8e48-8db0-45d0-8abc-c7e90163c0dc None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:18.933554 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d8e48-8db0-45d0-8abc-c7e90163c0dc None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:18.933876 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d8e48-8db0-45d0-8abc-c7e90163c0dc None admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:18.934600 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d8e48-8db0-45d0-8abc-c7e90163c0dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:18.934873 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d8e48-8db0-45d0-8abc-c7e90163c0dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:18.936250 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d8e48-8db0-45d0-8abc-c7e90163c0dc None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:18.948432 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d98f70-15c4-4231-bd46-1c63c52daf39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:18.949082 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d98f70-15c4-4231-bd46-1c63c52daf39 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:18.949363 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d98f70-15c4-4231-bd46-1c63c52daf39 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:18.949636 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d98f70-15c4-4231-bd46-1c63c52daf39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:18.950498 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d98f70-15c4-4231-bd46-1c63c52daf39 None admin] RBAC: Adding query filter params (role.id=70d242b29ede4648b639c7ddae5eaead, scope.domain.id=default, user.id=23aa6e5135404cb6a45a96628c2e41d6) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:18.950806 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d98f70-15c4-4231-bd46-1c63c52daf39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:18.952244 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d98f70-15c4-4231-bd46-1c63c52daf39 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:18.953805 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 10/20] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:23:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:18.963085 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 11/21] 10.222.0.27 () {56 vars in 1322 bytes} [Fri Jul 15 17:23:18 2022] GET /identity/v3/role_assignments?user.id=23aa6e5135404cb6a45a96628c2e41d6&scope.domain.id=default&role.id=70d242b29ede4648b639c7ddae5eaead => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:23:21.340832 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8d0b7-97f6-47ab-af86-91210354fcb3 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:21.341348 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8d0b7-97f6-47ab-af86-91210354fcb3 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:21.341419 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8d0b7-97f6-47ab-af86-91210354fcb3 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:21.342946 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 11/22] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:23:21.348353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781ebf4-5812-4e73-a200-5a256eee411d None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:21.349176 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781ebf4-5812-4e73-a200-5a256eee411d None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:21.349640 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781ebf4-5812-4e73-a200-5a256eee411d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:21.370777 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-7781ebf4-5812-4e73-a200-5a256eee411d None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:23:21.372592 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7781ebf4-5812-4e73-a200-5a256eee411d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:23:21.373334 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5b87b-d0c3-4d14-8dff-a19d53beb615 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:21.373627 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5b87b-d0c3-4d14-8dff-a19d53beb615 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:21.373950 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5b87b-d0c3-4d14-8dff-a19d53beb615 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:21.378031 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 12/23] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 17:23:21.390741 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb0b88-032a-4b68-bc66-3075c62c6f48 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:21.391032 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb0b88-032a-4b68-bc66-3075c62c6f48 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:21.391310 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb0b88-032a-4b68-bc66-3075c62c6f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:21.426867 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-0bcb0b88-032a-4b68-bc66-3075c62c6f48 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:23:21.430457 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-0bcb0b88-032a-4b68-bc66-3075c62c6f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:23:21.480049 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 12/24] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:23:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:23:21.514120 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7781ebf4-5812-4e73-a200-5a256eee411d None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:21.560238 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 13/25] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:23:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 17:23:21.563254 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b8541-bb4c-47bb-b823-dbccdd7069e3 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:21.563931 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b8541-bb4c-47bb-b823-dbccdd7069e3 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:21.565708 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b8541-bb4c-47bb-b823-dbccdd7069e3 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:21.568344 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 14/26] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:23:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:23:21.572991 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df303d12-0bad-49cf-802a-d21319f7d014 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:21.573480 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df303d12-0bad-49cf-802a-d21319f7d014 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:21.573986 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df303d12-0bad-49cf-802a-d21319f7d014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:21.606899 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-df303d12-0bad-49cf-802a-d21319f7d014 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:23:21.608924 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-df303d12-0bad-49cf-802a-d21319f7d014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:23:21.634389 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:21.686232 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:21.695618 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7781ebf4-5812-4e73-a200-5a256eee411d None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:21.703290 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 15/27] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:23:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:23:21.704393 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df303d12-0bad-49cf-802a-d21319f7d014 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:21.802980 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ea61e-3434-4934-ade4-c695e01fcdc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:21.804153 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ea61e-3434-4934-ade4-c695e01fcdc2 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:21.804628 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ea61e-3434-4934-ade4-c695e01fcdc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:21.805124 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ea61e-3434-4934-ade4-c695e01fcdc2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:21.829098 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ea61e-3434-4934-ade4-c695e01fcdc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:23:21.841002 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df303d12-0bad-49cf-802a-d21319f7d014 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:21.847811 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-a09ea61e-3434-4934-ade4-c695e01fcdc2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:23:21.847811 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:23:21.847811 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:23:21.847811 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:23:21.847811 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:23:21.847811 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:23:21.847811 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:23:21.847811 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:23:21.847811 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:23:21.847811 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:23:21.847811 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:23:21.847811 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:23:21.847811 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:23:21.847811 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:23:21.847811 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:23:21.847811 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:23:21.848663 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:23:21.848663 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:23:21.848663 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:23:21.848663 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:23:21.848663 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:23:21.848663 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:23:21.848663 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:23:21.848663 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:23:21.848663 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:23:21.848663 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:23:21.848663 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:23:21.848663 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:23:21.848663 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:23:21.848663 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:23:21.848663 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:23:21.848663 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:23:21.849430 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:23:21.849430 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:23:21.849430 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:23:21.849430 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:23:21.849430 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:23:21.849430 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:23:21.849430 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:23:21.849430 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:23:21.849430 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:23:21.849430 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:23:21.849430 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:23:21.849430 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:23:21.854927 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 13/28] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jul 15 17:23:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:23:21.855940 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ea61e-3434-4934-ade4-c695e01fcdc2 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:21.920620 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805090b0-8492-4e7e-8e61-87085f43104a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:21.921254 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805090b0-8492-4e7e-8e61-87085f43104a None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:21.921577 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805090b0-8492-4e7e-8e61-87085f43104a None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:21.921873 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805090b0-8492-4e7e-8e61-87085f43104a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:21.943909 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805090b0-8492-4e7e-8e61-87085f43104a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:21.945391 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805090b0-8492-4e7e-8e61-87085f43104a None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:21.975795 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-805090b0-8492-4e7e-8e61-87085f43104a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:23:21.975795 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:23:21.975795 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:23:21.975795 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:23:21.975795 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:23:21.975795 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:23:21.975795 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:23:21.975795 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:23:21.975795 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:23:21.975795 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:23:21.975795 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:23:21.975795 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:23:21.975795 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:23:21.975795 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:23:21.975795 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:23:21.976655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:23:21.976655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:23:21.976655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:23:21.976655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:23:21.976655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:23:21.976655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:23:21.976655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:23:21.976655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:23:21.976655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:23:21.976655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:23:21.976655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:23:21.976655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:23:21.976655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:23:21.976655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:23:21.976655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:23:21.976655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:23:21.976655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:23:21.977426 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:23:21.977426 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:23:21.977426 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:23:21.977426 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:23:21.977426 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 16/29] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:23:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:23:21.986760 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805090b0-8492-4e7e-8e61-87085f43104a None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:21.992101 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ea61e-3434-4934-ade4-c695e01fcdc2 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:22.030139 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d7bac-ab53-412e-97ec-995ccdd6d86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:22.031305 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d7bac-ab53-412e-97ec-995ccdd6d86e None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:22.031777 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d7bac-ab53-412e-97ec-995ccdd6d86e None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:22.032247 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d7bac-ab53-412e-97ec-995ccdd6d86e None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:22.033185 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d7bac-ab53-412e-97ec-995ccdd6d86e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:22.034819 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d7bac-ab53-412e-97ec-995ccdd6d86e None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:22.040984 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:22.046710 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:22.143444 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805090b0-8492-4e7e-8e61-87085f43104a None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:22.165334 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 14/30] 10.222.0.27 () {60 vars in 1131 bytes} [Fri Jul 15 17:23:21 2022] POST /identity/v3/roles => generated 219 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:23:22.175026 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d7bac-ab53-412e-97ec-995ccdd6d86e None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:22.180878 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6a12c-c553-46f8-9133-e6d458474d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:22.181920 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6a12c-c553-46f8-9133-e6d458474d07 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:22.182393 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6a12c-c553-46f8-9133-e6d458474d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:22.182857 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6a12c-c553-46f8-9133-e6d458474d07 None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:22.183808 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6a12c-c553-46f8-9133-e6d458474d07 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:22.184330 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6a12c-c553-46f8-9133-e6d458474d07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:22.185960 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6a12c-c553-46f8-9133-e6d458474d07 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:22.200165 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 17/31] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:23:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:22.202092 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41673041-6ba9-4607-b30f-54e465a1cfbd None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:22.202610 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41673041-6ba9-4607-b30f-54e465a1cfbd None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:22.203134 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41673041-6ba9-4607-b30f-54e465a1cfbd None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:22.205160 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 18/32] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:23:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:23:22.206501 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41673041-6ba9-4607-b30f-54e465a1cfbd None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:22.318051 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:22.333828 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41673041-6ba9-4607-b30f-54e465a1cfbd None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:22.369485 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d7bac-ab53-412e-97ec-995ccdd6d86e None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:22.377268 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc8075-9490-4ee9-9295-916f11641e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:22.378292 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc8075-9490-4ee9-9295-916f11641e41 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:22.378644 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc8075-9490-4ee9-9295-916f11641e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:22.378980 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc8075-9490-4ee9-9295-916f11641e41 None admin] PATH_INFO: `/v3/users/23aa6e5135404cb6a45a96628c2e41d6` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:22.380964 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc8075-9490-4ee9-9295-916f11641e41 None admin] RBAC: Authorizing `identity:get_user(user_id=23aa6e5135404cb6a45a96628c2e41d6)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:22.382629 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc8075-9490-4ee9-9295-916f11641e41 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:22.384645 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 19/33] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:23:22 2022] GET /identity/v3/users/23aa6e5135404cb6a45a96628c2e41d6 => generated 247 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:22.386161 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0af9c-3d07-48c6-ae0b-212507a1af12 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:22.386517 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0af9c-3d07-48c6-ae0b-212507a1af12 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:22.386860 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0af9c-3d07-48c6-ae0b-212507a1af12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:22.405286 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-ccd0af9c-3d07-48c6-ae0b-212507a1af12 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:23:22.406752 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-ccd0af9c-3d07-48c6-ae0b-212507a1af12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:23:22.413967 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465d49b-90cc-4b4a-a31a-1de3bdaf321c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:22.414153 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465d49b-90cc-4b4a-a31a-1de3bdaf321c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:22.414367 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465d49b-90cc-4b4a-a31a-1de3bdaf321c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:22.414656 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465d49b-90cc-4b4a-a31a-1de3bdaf321c None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:22.415401 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465d49b-90cc-4b4a-a31a-1de3bdaf321c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:22.415713 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465d49b-90cc-4b4a-a31a-1de3bdaf321c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:22.417740 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465d49b-90cc-4b4a-a31a-1de3bdaf321c None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:22.444384 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 15/34] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:23:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:22.446022 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3387715-7337-497c-92c8-101433ccd895 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:22.446320 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3387715-7337-497c-92c8-101433ccd895 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:22.446605 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3387715-7337-497c-92c8-101433ccd895 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:22.448000 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 16/35] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:23:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:23:22.448861 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3387715-7337-497c-92c8-101433ccd895 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:22.495330 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 20/36] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:23:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:23:22.496453 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd0af9c-3d07-48c6-ae0b-212507a1af12 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:22.515862 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:22.566116 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3387715-7337-497c-92c8-101433ccd895 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:22.590398 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:22.604761 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd0af9c-3d07-48c6-ae0b-212507a1af12 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:22.605695 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ebbfe-8647-4d58-9d38-ec83f3fc80d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:22.606542 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ebbfe-8647-4d58-9d38-ec83f3fc80d8 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:22.606840 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ebbfe-8647-4d58-9d38-ec83f3fc80d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:22.607096 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ebbfe-8647-4d58-9d38-ec83f3fc80d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:22.608401 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ebbfe-8647-4d58-9d38-ec83f3fc80d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:22.610120 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ebbfe-8647-4d58-9d38-ec83f3fc80d8 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:22.616716 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 17/37] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:23:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:22.618037 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee38b2-fb5b-4376-b7f9-39b804f5c888 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:22.618342 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee38b2-fb5b-4376-b7f9-39b804f5c888 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:22.618623 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee38b2-fb5b-4376-b7f9-39b804f5c888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:22.642313 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2a3c8-6086-45b7-8667-ea37296cdc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:22.643168 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2a3c8-6086-45b7-8667-ea37296cdc30 None admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:22.643439 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2a3c8-6086-45b7-8667-ea37296cdc30 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:22.643710 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2a3c8-6086-45b7-8667-ea37296cdc30 None admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:22.644433 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a2a3c8-6086-45b7-8667-ea37296cdc30 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:22.645970 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a2a3c8-6086-45b7-8667-ea37296cdc30 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:22.748706 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-12ee38b2-fb5b-4376-b7f9-39b804f5c888 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:23:22.750237 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-12ee38b2-fb5b-4376-b7f9-39b804f5c888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:23:22.783526 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 21/38] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Jul 15 17:23:22 2022] POST /identity/v3/projects => generated 301 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:23:22.784482 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2a3c8-6086-45b7-8667-ea37296cdc30 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:22.841833 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 18/39] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:23:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:23:22.841833 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee38b2-fb5b-4376-b7f9-39b804f5c888 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:22.907384 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:22.937968 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2a3c8-6086-45b7-8667-ea37296cdc30 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:22.977641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee38b2-fb5b-4376-b7f9-39b804f5c888 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:22.977871 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d0e9a-b8b4-4913-814a-ad25b926a3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:22.978533 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d0e9a-b8b4-4913-814a-ad25b926a3de None admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:22.978842 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d0e9a-b8b4-4913-814a-ad25b926a3de None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:22.979104 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d0e9a-b8b4-4913-814a-ad25b926a3de None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:22.979893 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936d0e9a-b8b4-4913-814a-ad25b926a3de None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:22.981428 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936d0e9a-b8b4-4913-814a-ad25b926a3de None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:22.994205 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:23.001438 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 22/40] 10.222.0.27 () {60 vars in 1131 bytes} [Fri Jul 15 17:23:22 2022] POST /identity/v3/roles => generated 225 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:23:23.003209 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d0e9a-b8b4-4913-814a-ad25b926a3de None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:23.026184 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06221416-0b47-44fa-8624-1e5c9487a422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:23.027351 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06221416-0b47-44fa-8624-1e5c9487a422 None admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:23.027458 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06221416-0b47-44fa-8624-1e5c9487a422 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:23.027741 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06221416-0b47-44fa-8624-1e5c9487a422 None admin] PATH_INFO: `/v3/domains/default/users/23aa6e5135404cb6a45a96628c2e41d6/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:23.030167 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06221416-0b47-44fa-8624-1e5c9487a422 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=23aa6e5135404cb6a45a96628c2e41d6, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:23.033847 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06221416-0b47-44fa-8624-1e5c9487a422 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:23.054046 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 19/41] 10.222.0.27 () {58 vars in 1361 bytes} [Fri Jul 15 17:23:22 2022] PUT /identity/v3/domains/default/users/23aa6e5135404cb6a45a96628c2e41d6/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:23:23.055405 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174d526-8cc1-4c6a-b97c-5ba2e5e12cd2 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:23.055701 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174d526-8cc1-4c6a-b97c-5ba2e5e12cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:23.055980 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174d526-8cc1-4c6a-b97c-5ba2e5e12cd2 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:23.057507 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 20/42] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:23:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:23:23.064988 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8e35c-bb6d-4091-ba37-7eaa13711afe None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:23.065289 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8e35c-bb6d-4091-ba37-7eaa13711afe None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:23.065560 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8e35c-bb6d-4091-ba37-7eaa13711afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:23.094071 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-03b8e35c-bb6d-4091-ba37-7eaa13711afe None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:23:23.097358 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-03b8e35c-bb6d-4091-ba37-7eaa13711afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:23:23.164805 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d0e9a-b8b4-4913-814a-ad25b926a3de None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:23.181988 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 21/43] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:23:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 17:23:23.208297 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8e35c-bb6d-4091-ba37-7eaa13711afe None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:23.210593 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725a6c1-fafa-40b1-a745-563baf149eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:23.211420 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725a6c1-fafa-40b1-a745-563baf149eda None admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:23.211713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725a6c1-fafa-40b1-a745-563baf149eda None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:23.211995 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725a6c1-fafa-40b1-a745-563baf149eda None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:23.212899 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725a6c1-fafa-40b1-a745-563baf149eda None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:23.214404 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725a6c1-fafa-40b1-a745-563baf149eda None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:23.234096 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 23/44] 10.222.0.27 () {60 vars in 1131 bytes} [Fri Jul 15 17:23:23 2022] POST /identity/v3/roles => generated 223 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:23:23.263332 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:23.333882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8e35c-bb6d-4091-ba37-7eaa13711afe None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:23.371295 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb5b60-025e-4575-aa09-5b482659f4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:23.372160 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb5b60-025e-4575-aa09-5b482659f4a0 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:23.372410 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb5b60-025e-4575-aa09-5b482659f4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:23.372686 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb5b60-025e-4575-aa09-5b482659f4a0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:23.374002 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb5b60-025e-4575-aa09-5b482659f4a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:23.375567 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb5b60-025e-4575-aa09-5b482659f4a0 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:23.377444 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 22/45] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:23:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:23.382993 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725a6c1-fafa-40b1-a745-563baf149eda None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:23.552676 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:23.594296 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725a6c1-fafa-40b1-a745-563baf149eda None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:23.627164 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b733fb-b9fe-4a89-a3ac-85124d8f977b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:23.627828 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b733fb-b9fe-4a89-a3ac-85124d8f977b None admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:23.628108 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b733fb-b9fe-4a89-a3ac-85124d8f977b None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:23.628386 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b733fb-b9fe-4a89-a3ac-85124d8f977b None admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:23.629100 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b733fb-b9fe-4a89-a3ac-85124d8f977b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:23.630577 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b733fb-b9fe-4a89-a3ac-85124d8f977b None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:23.658160 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 24/46] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Jul 15 17:23:23 2022] POST /identity/v3/projects => generated 312 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:23:25.114618 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7249c-f381-4ef9-b4d4-bb9ec63d6722 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:25.115143 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7249c-f381-4ef9-b4d4-bb9ec63d6722 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:25.115224 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7249c-f381-4ef9-b4d4-bb9ec63d6722 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:25.116609 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 23/47] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:23:25.122027 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d62683-4a93-4781-918a-6bbd4f461660 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:25.122479 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d62683-4a93-4781-918a-6bbd4f461660 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:25.122566 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d62683-4a93-4781-918a-6bbd4f461660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:25.141200 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-c5d62683-4a93-4781-918a-6bbd4f461660 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:23:25.142823 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-c5d62683-4a93-4781-918a-6bbd4f461660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:23:25.212859 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 25/48] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:23:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:23:25.236044 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7249c-f381-4ef9-b4d4-bb9ec63d6722 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:25.345636 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7249c-f381-4ef9-b4d4-bb9ec63d6722 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:25.356337 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:25.382806 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb8d69-6270-4840-8d89-28045832eeac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:25.383615 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb8d69-6270-4840-8d89-28045832eeac None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:25.383941 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb8d69-6270-4840-8d89-28045832eeac None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:25.384219 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb8d69-6270-4840-8d89-28045832eeac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:25.394941 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cb8d69-6270-4840-8d89-28045832eeac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:23:25.402641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-a3cb8d69-6270-4840-8d89-28045832eeac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:23:25.402641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:23:25.402641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:23:25.402641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:23:25.402641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:23:25.402641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:23:25.402641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:23:25.402641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:23:25.402641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:23:25.402641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:23:25.402641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:23:25.402641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:23:25.402641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:23:25.402641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:23:25.402641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:23:25.402641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:23:25.403626 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:23:25.403626 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:23:25.403626 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:23:25.403626 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:23:25.403626 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:23:25.403626 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:23:25.403626 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:23:25.403626 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:23:25.403626 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:23:25.403626 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:23:25.403626 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:23:25.403626 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:23:25.403626 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:23:25.403626 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:23:25.403626 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:23:25.403626 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:23:25.409622 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:23:25.409622 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:23:25.409622 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:23:25.409622 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:23:25.409622 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:23:25.409622 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:23:25.409622 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:23:25.409622 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:23:25.409622 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:23:25.409622 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:23:25.409622 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:23:25.409622 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:23:25.409622 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 24/49] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jul 15 17:23:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:23:25.410457 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d62683-4a93-4781-918a-6bbd4f461660 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:25.456799 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:25.516663 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d62683-4a93-4781-918a-6bbd4f461660 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:25.551803 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027253f-11bf-423c-a50e-7a06af295676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:25.552483 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027253f-11bf-423c-a50e-7a06af295676 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:25.552768 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027253f-11bf-423c-a50e-7a06af295676 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:25.553045 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027253f-11bf-423c-a50e-7a06af295676 None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:25.553806 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a027253f-11bf-423c-a50e-7a06af295676 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:25.554144 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a027253f-11bf-423c-a50e-7a06af295676 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:25.555555 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a027253f-11bf-423c-a50e-7a06af295676 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:25.564115 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 26/50] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:23:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:25.570030 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb8d69-6270-4840-8d89-28045832eeac None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:25.629900 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35670dc-e7a0-4037-8e6c-142746287138 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:25.630207 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35670dc-e7a0-4037-8e6c-142746287138 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:25.630492 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35670dc-e7a0-4037-8e6c-142746287138 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:25.631923 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 27/51] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:23:25.637361 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e51b0e-6ae4-47ac-9cf9-3263eb98ea47 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:25.637665 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e51b0e-6ae4-47ac-9cf9-3263eb98ea47 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:25.637975 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e51b0e-6ae4-47ac-9cf9-3263eb98ea47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:25.655272 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-c9e51b0e-6ae4-47ac-9cf9-3263eb98ea47 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:23:25.656623 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-c9e51b0e-6ae4-47ac-9cf9-3263eb98ea47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:23:25.673954 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb8d69-6270-4840-8d89-28045832eeac None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:25.708452 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c1f61-c9be-4f17-ad9e-41d204220d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:25.709343 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c1f61-c9be-4f17-ad9e-41d204220d4a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:25.709630 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c1f61-c9be-4f17-ad9e-41d204220d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:25.709943 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c1f61-c9be-4f17-ad9e-41d204220d4a None admin] PATH_INFO: `/v3/users/23aa6e5135404cb6a45a96628c2e41d6` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:25.711558 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c1f61-c9be-4f17-ad9e-41d204220d4a None admin] RBAC: Authorizing `identity:get_user(user_id=23aa6e5135404cb6a45a96628c2e41d6)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:25.713025 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c1f61-c9be-4f17-ad9e-41d204220d4a None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:25.714938 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 25/52] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:23:25 2022] GET /identity/v3/users/23aa6e5135404cb6a45a96628c2e41d6 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:25.720246 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c1f61-c9be-4f17-ad9e-41d204220d4a None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:25.724574 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 28/53] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:23:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:23:25.746582 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e51b0e-6ae4-47ac-9cf9-3263eb98ea47 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:25.759253 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:25.780992 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:25.819249 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c1f61-c9be-4f17-ad9e-41d204220d4a None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:25.849330 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e51b0e-6ae4-47ac-9cf9-3263eb98ea47 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:25.852447 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd1a4cd-fd4e-4172-a545-bcaa1a08db4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:25.853238 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1a4cd-fd4e-4172-a545-bcaa1a08db4c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:25.853521 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1a4cd-fd4e-4172-a545-bcaa1a08db4c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:25.853824 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1a4cd-fd4e-4172-a545-bcaa1a08db4c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:25.855118 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd1a4cd-fd4e-4172-a545-bcaa1a08db4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:25.856560 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd1a4cd-fd4e-4172-a545-bcaa1a08db4c None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:25.858239 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 26/54] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:23:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:23:25.864242 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd1a4cd-fd4e-4172-a545-bcaa1a08db4c None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:25.883784 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3da8af-2114-4720-bbb3-3b3e69a55549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:25.884554 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3da8af-2114-4720-bbb3-3b3e69a55549 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:25.884837 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3da8af-2114-4720-bbb3-3b3e69a55549 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:25.885126 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3da8af-2114-4720-bbb3-3b3e69a55549 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:25.886321 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3da8af-2114-4720-bbb3-3b3e69a55549 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:25.887850 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3da8af-2114-4720-bbb3-3b3e69a55549 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:25.889590 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 29/55] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:23:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:25.895064 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3da8af-2114-4720-bbb3-3b3e69a55549 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:25.963912 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd1a4cd-fd4e-4172-a545-bcaa1a08db4c None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:25.971842 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:25.994711 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3da8af-2114-4720-bbb3-3b3e69a55549 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:25.996238 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:25.998547 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75224a-a1a4-403b-94cb-314cc0810338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:25.999474 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75224a-a1a4-403b-94cb-314cc0810338 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:25.999919 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75224a-a1a4-403b-94cb-314cc0810338 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:26.000327 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75224a-a1a4-403b-94cb-314cc0810338 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:26.001171 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd75224a-a1a4-403b-94cb-314cc0810338 None admin] RBAC: Adding query filter params (role.id=70d242b29ede4648b639c7ddae5eaead, scope.domain.id=default, user.id=23aa6e5135404cb6a45a96628c2e41d6) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:26.001486 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd75224a-a1a4-403b-94cb-314cc0810338 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:26.002991 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd75224a-a1a4-403b-94cb-314cc0810338 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:26.008793 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 27/56] 10.222.0.27 () {56 vars in 1322 bytes} [Fri Jul 15 17:23:25 2022] GET /identity/v3/role_assignments?user.id=23aa6e5135404cb6a45a96628c2e41d6&scope.domain.id=default&role.id=70d242b29ede4648b639c7ddae5eaead => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:23:26.030121 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b891e-0373-4617-a685-315d734b0647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:26.030963 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b891e-0373-4617-a685-315d734b0647 None admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:26.031140 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b891e-0373-4617-a685-315d734b0647 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:26.031406 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b891e-0373-4617-a685-315d734b0647 None admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:26.032229 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b891e-0373-4617-a685-315d734b0647 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:26.033732 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b891e-0373-4617-a685-315d734b0647 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:26.064229 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 30/57] 10.222.0.27 () {60 vars in 1140 bytes} [Fri Jul 15 17:23:25 2022] POST /identity/v3/projects => generated 298 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 17:23:28.041553 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f567fb0-ecaa-4085-9e11-b69f8ad1fc47 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:28.042422 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f567fb0-ecaa-4085-9e11-b69f8ad1fc47 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:28.042553 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f567fb0-ecaa-4085-9e11-b69f8ad1fc47 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:28.044647 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 28/58] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:23:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:23:28.051014 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66574fa-d2ac-4e8c-b859-4447ddb27db3 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:28.051432 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66574fa-d2ac-4e8c-b859-4447ddb27db3 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:28.051649 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66574fa-d2ac-4e8c-b859-4447ddb27db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:28.072527 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-b66574fa-d2ac-4e8c-b859-4447ddb27db3 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:23:28.073747 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-b66574fa-d2ac-4e8c-b859-4447ddb27db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:23:28.143910 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 31/59] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:23:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:23:28.172620 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f567fb0-ecaa-4085-9e11-b69f8ad1fc47 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:28.287518 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f567fb0-ecaa-4085-9e11-b69f8ad1fc47 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:28.330000 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef09cda-0054-45f5-b169-afc47c2ac242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:28.331223 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef09cda-0054-45f5-b169-afc47c2ac242 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:28.331514 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef09cda-0054-45f5-b169-afc47c2ac242 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:28.331793 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef09cda-0054-45f5-b169-afc47c2ac242 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:28.333057 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef09cda-0054-45f5-b169-afc47c2ac242 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:28.334574 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef09cda-0054-45f5-b169-afc47c2ac242 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:28.336199 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 29/60] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:23:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:28.342112 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66574fa-d2ac-4e8c-b859-4447ddb27db3 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:28.440224 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:28.462912 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66574fa-d2ac-4e8c-b859-4447ddb27db3 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:28.498441 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b4805-f87f-4b95-88f3-6a6876004591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:28.499121 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b4805-f87f-4b95-88f3-6a6876004591 None admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:28.499407 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b4805-f87f-4b95-88f3-6a6876004591 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:28.499679 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b4805-f87f-4b95-88f3-6a6876004591 None admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:28.500398 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b4805-f87f-4b95-88f3-6a6876004591 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:28.501894 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b4805-f87f-4b95-88f3-6a6876004591 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:28.530176 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 32/61] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Jul 15 17:23:28 2022] POST /identity/v3/users => generated 275 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:23:31.795648 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8ec56-908e-4d55-8e08-c2ef51cfe283 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:31.795648 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8ec56-908e-4d55-8e08-c2ef51cfe283 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:31.795648 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8ec56-908e-4d55-8e08-c2ef51cfe283 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:31.795648 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 30/62] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:23:31.801214 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b38fe-437a-42c8-b891-3f802ab7401e None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:31.802031 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b38fe-437a-42c8-b891-3f802ab7401e None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:31.802498 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b38fe-437a-42c8-b891-3f802ab7401e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:31.826845 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-e78b38fe-437a-42c8-b891-3f802ab7401e None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:23:31.828214 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-e78b38fe-437a-42c8-b891-3f802ab7401e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:23:31.871499 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f771d-3f27-4ec0-aecb-f5a0cc43f8af None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:31.872106 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f771d-3f27-4ec0-aecb-f5a0cc43f8af None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:31.872589 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f771d-3f27-4ec0-aecb-f5a0cc43f8af None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:31.874210 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 31/63] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:23:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 17:23:31.879614 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518a5b9-7357-441f-98c6-bd0b28184e54 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:31.880178 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518a5b9-7357-441f-98c6-bd0b28184e54 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:31.880642 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518a5b9-7357-441f-98c6-bd0b28184e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:31.908729 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-8518a5b9-7357-441f-98c6-bd0b28184e54 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:23:31.909960 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8518a5b9-7357-441f-98c6-bd0b28184e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:23:31.937891 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 33/64] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:23:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:23:31.961708 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:31.998212 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b38fe-437a-42c8-b891-3f802ab7401e None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:32.030745 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 32/65] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:23:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 17:23:32.032140 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b0c96-5b2f-4248-ab66-9dbe5c96a411 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:32.032440 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b0c96-5b2f-4248-ab66-9dbe5c96a411 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:32.032722 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b0c96-5b2f-4248-ab66-9dbe5c96a411 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:32.034290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 33/66] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:23:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:23:32.043635 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd91a8-7864-4696-bc07-9bb7044006ae None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:32.043924 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd91a8-7864-4696-bc07-9bb7044006ae None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:32.044198 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd91a8-7864-4696-bc07-9bb7044006ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:32.066929 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-56fd91a8-7864-4696-bc07-9bb7044006ae None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:23:32.068522 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-56fd91a8-7864-4696-bc07-9bb7044006ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:23:32.093682 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:32.128058 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b38fe-437a-42c8-b891-3f802ab7401e None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:32.142549 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 34/67] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:23:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:23:32.143797 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd91a8-7864-4696-bc07-9bb7044006ae None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:32.164760 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6f556-73f4-464a-9008-e4d2002d9902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:32.165667 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6f556-73f4-464a-9008-e4d2002d9902 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:32.166223 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6f556-73f4-464a-9008-e4d2002d9902 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:32.166674 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6f556-73f4-464a-9008-e4d2002d9902 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:32.179756 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a6f556-73f4-464a-9008-e4d2002d9902 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:23:32.189631 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-d1a6f556-73f4-464a-9008-e4d2002d9902 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 17:23:32.189631 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:23:32.189631 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:23:32.189631 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:23:32.189631 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:23:32.189631 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:23:32.189631 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:23:32.189631 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:23:32.189631 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:23:32.189631 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:23:32.189631 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:23:32.189631 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:23:32.189631 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:23:32.189631 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:23:32.189631 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:23:32.189631 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:23:32.190793 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:23:32.190793 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:23:32.190793 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:23:32.190793 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:23:32.190793 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:23:32.190793 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:23:32.190793 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:23:32.190793 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:23:32.190793 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:23:32.190793 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:23:32.190793 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:23:32.190793 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:23:32.190793 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:23:32.190793 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:23:32.190793 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:23:32.190793 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:23:32.191749 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:23:32.191749 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:23:32.191749 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:23:32.191749 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:23:32.191749 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:23:32.191749 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:23:32.191749 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:23:32.191749 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:23:32.191749 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:23:32.191749 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:23:32.191749 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 17:23:32.191749 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:23:32.194079 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 34/68] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:23:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:23:32.195110 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6f556-73f4-464a-9008-e4d2002d9902 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:32.244019 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:32.247762 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd91a8-7864-4696-bc07-9bb7044006ae None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:32.284217 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c6ef2-4dd7-4ef7-b826-b246ebbaa11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:32.285021 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c6ef2-4dd7-4ef7-b826-b246ebbaa11d None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:32.285303 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c6ef2-4dd7-4ef7-b826-b246ebbaa11d None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:32.285579 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c6ef2-4dd7-4ef7-b826-b246ebbaa11d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:32.297304 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575c6ef2-4dd7-4ef7-b826-b246ebbaa11d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:23:32.306459 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6f556-73f4-464a-9008-e4d2002d9902 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:32.313482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-575c6ef2-4dd7-4ef7-b826-b246ebbaa11d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:23:32.313482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:23:32.313482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:23:32.313482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:23:32.313482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:23:32.313482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:23:32.313482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:23:32.313482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:23:32.313482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:23:32.313482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:23:32.313482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:23:32.313482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:23:32.313482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:23:32.313482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:23:32.313482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:23:32.313482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:23:32.314515 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:23:32.314515 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:23:32.314515 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:23:32.314515 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:23:32.314515 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:23:32.314515 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:23:32.314515 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:23:32.314515 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:23:32.314515 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:23:32.314515 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:23:32.314515 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:23:32.314515 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:23:32.314515 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:23:32.314515 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:23:32.314515 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:23:32.314515 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:23:32.315257 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:23:32.315257 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:23:32.315257 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:23:32.315257 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:23:32.315257 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:23:32.315257 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:23:32.315257 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:23:32.315257 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:23:32.315257 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:23:32.315257 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:23:32.315257 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:23:32.315257 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:23:32.319635 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 35/69] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jul 15 17:23:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:23:32.320612 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c6ef2-4dd7-4ef7-b826-b246ebbaa11d None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:32.343099 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:32.350178 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e801771-6abd-4885-b35f-fdb4157d0bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:32.351419 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e801771-6abd-4885-b35f-fdb4157d0bc5 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:32.351993 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e801771-6abd-4885-b35f-fdb4157d0bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:32.352550 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e801771-6abd-4885-b35f-fdb4157d0bc5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:32.364128 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e801771-6abd-4885-b35f-fdb4157d0bc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:23:32.373262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-4e801771-6abd-4885-b35f-fdb4157d0bc5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 17:23:32.373262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:23:32.373262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:23:32.373262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:23:32.373262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:23:32.373262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:23:32.373262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:23:32.373262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:23:32.373262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:23:32.373262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:23:32.373262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:23:32.373262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:23:32.373262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:23:32.373262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:23:32.373262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:23:32.373262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:23:32.374174 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:23:32.374174 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:23:32.374174 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:23:32.374174 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:23:32.374174 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:23:32.374174 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:23:32.374174 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:23:32.374174 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:23:32.374174 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:23:32.374174 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:23:32.374174 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:23:32.374174 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:23:32.374174 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:23:32.374174 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:23:32.374174 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:23:32.374174 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:23:32.375046 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:23:32.375046 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:23:32.375046 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:23:32.375046 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:23:32.375046 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:23:32.375046 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:23:32.375046 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:23:32.375046 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:23:32.375046 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:23:32.375046 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:23:32.375046 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 17:23:32.375046 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:23:32.377600 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 35/70] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Jul 15 17:23:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:23:32.378548 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e801771-6abd-4885-b35f-fdb4157d0bc5 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:32.429608 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c6ef2-4dd7-4ef7-b826-b246ebbaa11d None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:32.464336 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7712b27b-7f6c-4dc0-9b0e-79954be9833c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:32.465025 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712b27b-7f6c-4dc0-9b0e-79954be9833c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:32.465287 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712b27b-7f6c-4dc0-9b0e-79954be9833c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:32.465609 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712b27b-7f6c-4dc0-9b0e-79954be9833c None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:32.466340 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7712b27b-7f6c-4dc0-9b0e-79954be9833c None admin] RBAC: Adding query filter params (name=member) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:32.466668 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7712b27b-7f6c-4dc0-9b0e-79954be9833c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:32.468105 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7712b27b-7f6c-4dc0-9b0e-79954be9833c None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:32.476220 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 36/71] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jul 15 17:23:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:32.477064 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7712b27b-7f6c-4dc0-9b0e-79954be9833c None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:32.489967 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e801771-6abd-4885-b35f-fdb4157d0bc5 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:32.501454 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:32.527056 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2716fd3-a170-4ac6-8db5-d089c076062f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:32.528048 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2716fd3-a170-4ac6-8db5-d089c076062f None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:32.528520 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2716fd3-a170-4ac6-8db5-d089c076062f None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:32.528971 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2716fd3-a170-4ac6-8db5-d089c076062f None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:32.529939 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2716fd3-a170-4ac6-8db5-d089c076062f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:32.530439 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2716fd3-a170-4ac6-8db5-d089c076062f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:32.532209 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2716fd3-a170-4ac6-8db5-d089c076062f None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:32.541592 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 36/72] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:23:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:32.547884 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12b9ee-166c-4054-b11a-bbf972b4be69 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:32.548183 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12b9ee-166c-4054-b11a-bbf972b4be69 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:32.548468 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12b9ee-166c-4054-b11a-bbf972b4be69 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:32.549956 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 37/73] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:23:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:23:32.550516 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12b9ee-166c-4054-b11a-bbf972b4be69 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:32.587981 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7712b27b-7f6c-4dc0-9b0e-79954be9833c None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:32.605960 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:32.622080 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4563d3-ae3c-4789-abcd-3c337cb04984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:32.622755 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4563d3-ae3c-4789-abcd-3c337cb04984 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:32.623041 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4563d3-ae3c-4789-abcd-3c337cb04984 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:32.623321 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4563d3-ae3c-4789-abcd-3c337cb04984 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:32.624102 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4563d3-ae3c-4789-abcd-3c337cb04984 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:32.624450 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4563d3-ae3c-4789-abcd-3c337cb04984 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:32.625857 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4563d3-ae3c-4789-abcd-3c337cb04984 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:32.633813 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 37/74] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:23:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:32.634693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4563d3-ae3c-4789-abcd-3c337cb04984 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:32.657069 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12b9ee-166c-4054-b11a-bbf972b4be69 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:32.691140 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9972caa-4e03-483d-801c-a0a03ce9e9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:32.692026 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9972caa-4e03-483d-801c-a0a03ce9e9b3 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:32.692312 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9972caa-4e03-483d-801c-a0a03ce9e9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:32.692590 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9972caa-4e03-483d-801c-a0a03ce9e9b3 None admin] PATH_INFO: `/v3/users/2ac9dd996a9f4a0b9387f409d44f60f9` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:32.708114 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9972caa-4e03-483d-801c-a0a03ce9e9b3 None admin] RBAC: Authorizing `identity:get_user(user_id=2ac9dd996a9f4a0b9387f409d44f60f9)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:32.709749 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9972caa-4e03-483d-801c-a0a03ce9e9b3 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:32.711491 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 38/75] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:23:32 2022] GET /identity/v3/users/2ac9dd996a9f4a0b9387f409d44f60f9 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:32.712736 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4825c2e-cac2-411a-bf66-7814565ac77b None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:32.713087 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4825c2e-cac2-411a-bf66-7814565ac77b None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:32.713371 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4825c2e-cac2-411a-bf66-7814565ac77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:32.716572 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:32.729998 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-d4825c2e-cac2-411a-bf66-7814565ac77b None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:23:32.731214 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-d4825c2e-cac2-411a-bf66-7814565ac77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:23:32.735218 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4563d3-ae3c-4789-abcd-3c337cb04984 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:32.767511 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e94efc1-8b79-4043-84ea-1611f275b613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:32.768385 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94efc1-8b79-4043-84ea-1611f275b613 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:32.768662 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94efc1-8b79-4043-84ea-1611f275b613 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:32.768932 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94efc1-8b79-4043-84ea-1611f275b613 None admin] PATH_INFO: `/v3/users/23aa6e5135404cb6a45a96628c2e41d6` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:32.770165 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e94efc1-8b79-4043-84ea-1611f275b613 None admin] RBAC: Authorizing `identity:get_user(user_id=23aa6e5135404cb6a45a96628c2e41d6)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:32.771645 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e94efc1-8b79-4043-84ea-1611f275b613 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:32.773277 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 38/76] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:23:32 2022] GET /identity/v3/users/23aa6e5135404cb6a45a96628c2e41d6 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:32.774442 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ea5cd-977a-4659-bb0f-e554d62d1905 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:32.774727 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ea5cd-977a-4659-bb0f-e554d62d1905 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:32.775000 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ea5cd-977a-4659-bb0f-e554d62d1905 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:32.776199 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 39/77] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:23:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:23:32.776877 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ea5cd-977a-4659-bb0f-e554d62d1905 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:32.800475 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 39/78] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:23:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:23:32.801511 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4825c2e-cac2-411a-bf66-7814565ac77b None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:32.842085 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:32.883295 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ea5cd-977a-4659-bb0f-e554d62d1905 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:32.898400 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4825c2e-cac2-411a-bf66-7814565ac77b None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:32.917277 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78136f3d-b276-4b76-8fcf-1682aee4b146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:32.918589 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78136f3d-b276-4b76-8fcf-1682aee4b146 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:32.918874 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78136f3d-b276-4b76-8fcf-1682aee4b146 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:32.919298 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78136f3d-b276-4b76-8fcf-1682aee4b146 None admin] PATH_INFO: `/v3/users/2ac9dd996a9f4a0b9387f409d44f60f9` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:32.920494 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78136f3d-b276-4b76-8fcf-1682aee4b146 None admin] RBAC: Authorizing `identity:get_user(user_id=2ac9dd996a9f4a0b9387f409d44f60f9)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:32.922047 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78136f3d-b276-4b76-8fcf-1682aee4b146 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:32.923688 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 40/79] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:23:32 2022] GET /identity/v3/users/2ac9dd996a9f4a0b9387f409d44f60f9 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:32.928184 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78136f3d-b276-4b76-8fcf-1682aee4b146 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:32.936216 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a6b65-fe7a-4f90-9762-bef024d0f623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:32.936903 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a6b65-fe7a-4f90-9762-bef024d0f623 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:32.937187 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a6b65-fe7a-4f90-9762-bef024d0f623 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:32.937466 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a6b65-fe7a-4f90-9762-bef024d0f623 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:32.942624 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:33.005705 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a6b65-fe7a-4f90-9762-bef024d0f623 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:33.007353 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a6b65-fe7a-4f90-9762-bef024d0f623 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:33.029827 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78136f3d-b276-4b76-8fcf-1682aee4b146 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:33.048814 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:33.064649 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16d3d0-e8bf-4b08-b74b-ea95f12e0426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:33.065305 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16d3d0-e8bf-4b08-b74b-ea95f12e0426 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:33.065593 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16d3d0-e8bf-4b08-b74b-ea95f12e0426 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:33.065902 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16d3d0-e8bf-4b08-b74b-ea95f12e0426 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:33.109968 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 40/80] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:23:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 17:23:33.111256 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785ae43-b850-42a2-ad61-37452471867c None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:33.111552 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785ae43-b850-42a2-ad61-37452471867c None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:33.111832 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785ae43-b850-42a2-ad61-37452471867c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:33.128803 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-d785ae43-b850-42a2-ad61-37452471867c None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:23:33.130035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-d785ae43-b850-42a2-ad61-37452471867c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:23:33.132869 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a16d3d0-e8bf-4b08-b74b-ea95f12e0426 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:33.134411 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a16d3d0-e8bf-4b08-b74b-ea95f12e0426 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:33.153632 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:33.216555 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 41/81] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:23:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:23:33.217413 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785ae43-b850-42a2-ad61-37452471867c None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:33.245014 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 41/82] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:23:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 17:23:33.249834 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16d3d0-e8bf-4b08-b74b-ea95f12e0426 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:33.297257 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:33.331582 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785ae43-b850-42a2-ad61-37452471867c None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:33.362321 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16d3d0-e8bf-4b08-b74b-ea95f12e0426 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:33.367195 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dce4c2-a957-431d-bb42-4b90147a1579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:33.368003 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dce4c2-a957-431d-bb42-4b90147a1579 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:33.368285 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dce4c2-a957-431d-bb42-4b90147a1579 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:33.368561 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dce4c2-a957-431d-bb42-4b90147a1579 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:33.369805 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dce4c2-a957-431d-bb42-4b90147a1579 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:33.371272 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dce4c2-a957-431d-bb42-4b90147a1579 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:33.373226 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 42/83] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:23:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:33.373874 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dce4c2-a957-431d-bb42-4b90147a1579 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:33.381427 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:33.399374 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a362d2-9ecc-45d7-ac7d-290d751baa20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:33.400126 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a362d2-9ecc-45d7-ac7d-290d751baa20 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:33.400413 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a362d2-9ecc-45d7-ac7d-290d751baa20 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:33.400686 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a362d2-9ecc-45d7-ac7d-290d751baa20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:33.468433 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a362d2-9ecc-45d7-ac7d-290d751baa20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:33.469955 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a362d2-9ecc-45d7-ac7d-290d751baa20 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:33.473766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dce4c2-a957-431d-bb42-4b90147a1579 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:33.507136 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147aea4-4ebe-4ab8-9900-96416f0f3b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:33.508002 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147aea4-4ebe-4ab8-9900-96416f0f3b46 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:33.508280 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147aea4-4ebe-4ab8-9900-96416f0f3b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:33.508552 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147aea4-4ebe-4ab8-9900-96416f0f3b46 None admin] PATH_INFO: `/v3/projects/7660c9e611fc4315b714c975f6e5f41e` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:33.510099 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b147aea4-4ebe-4ab8-9900-96416f0f3b46 None admin] RBAC: Authorizing `identity:get_project(project_id=7660c9e611fc4315b714c975f6e5f41e)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:33.511525 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b147aea4-4ebe-4ab8-9900-96416f0f3b46 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:33.513448 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 43/84] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:23:33 2022] GET /identity/v3/projects/7660c9e611fc4315b714c975f6e5f41e => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:33.513992 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147aea4-4ebe-4ab8-9900-96416f0f3b46 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:33.523530 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:33.571769 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 42/85] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:23:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 17:23:33.572706 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a362d2-9ecc-45d7-ac7d-290d751baa20 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:33.590733 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:33.619433 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147aea4-4ebe-4ab8-9900-96416f0f3b46 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:33.655058 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6072783-1b95-4774-b2cf-b6cf9779db8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:33.656398 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6072783-1b95-4774-b2cf-b6cf9779db8e None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:33.656867 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6072783-1b95-4774-b2cf-b6cf9779db8e None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:33.657289 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6072783-1b95-4774-b2cf-b6cf9779db8e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:33.668698 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6072783-1b95-4774-b2cf-b6cf9779db8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:23:33.669438 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a362d2-9ecc-45d7-ac7d-290d751baa20 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:33.676565 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-b6072783-1b95-4774-b2cf-b6cf9779db8e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 17:23:33.676565 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:23:33.676565 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:23:33.676565 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:23:33.676565 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:23:33.676565 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:23:33.676565 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:23:33.676565 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:23:33.676565 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:23:33.676565 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:23:33.676565 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:23:33.676565 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:23:33.676565 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:23:33.676565 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:23:33.676565 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:23:33.676565 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:23:33.677428 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:23:33.677428 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:23:33.677428 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:23:33.677428 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:23:33.677428 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:23:33.677428 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:23:33.677428 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:23:33.677428 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:23:33.677428 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:23:33.677428 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:23:33.677428 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:23:33.677428 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:23:33.677428 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:23:33.677428 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:23:33.677428 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:23:33.677428 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:23:33.678208 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:23:33.678208 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:23:33.678208 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:23:33.678208 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:23:33.678208 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:23:33.678208 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:23:33.678208 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:23:33.678208 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:23:33.678208 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:23:33.678208 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:23:33.678208 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 17:23:33.678208 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:23:33.678208 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 44/86] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:23:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:23:33.678809 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6072783-1b95-4774-b2cf-b6cf9779db8e None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:33.707541 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbcee1-7781-41c8-92ea-9c363100497f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:33.708415 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbcee1-7781-41c8-92ea-9c363100497f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:33.708701 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbcee1-7781-41c8-92ea-9c363100497f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:33.708981 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbcee1-7781-41c8-92ea-9c363100497f None admin] PATH_INFO: `/v3/projects/7660c9e611fc4315b714c975f6e5f41e` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:33.710229 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdbcee1-7781-41c8-92ea-9c363100497f None admin] RBAC: Authorizing `identity:get_project(project_id=7660c9e611fc4315b714c975f6e5f41e)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:33.711708 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdbcee1-7781-41c8-92ea-9c363100497f None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:33.713426 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 43/87] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:23:33 2022] GET /identity/v3/projects/7660c9e611fc4315b714c975f6e5f41e => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:33.714652 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbcee1-7781-41c8-92ea-9c363100497f None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:33.744667 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:33.779281 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6072783-1b95-4774-b2cf-b6cf9779db8e None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:33.800323 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:33.812499 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557badc5-3a7f-42ae-93cf-4ef534215145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:33.813171 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557badc5-3a7f-42ae-93cf-4ef534215145 None admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:33.813450 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557badc5-3a7f-42ae-93cf-4ef534215145 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:33.813718 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557badc5-3a7f-42ae-93cf-4ef534215145 None admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:33.814466 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557badc5-3a7f-42ae-93cf-4ef534215145 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:33.815893 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557badc5-3a7f-42ae-93cf-4ef534215145 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:33.815982 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbcee1-7781-41c8-92ea-9c363100497f None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:33.835741 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 45/88] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Jul 15 17:23:33 2022] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:23:33.836542 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557badc5-3a7f-42ae-93cf-4ef534215145 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:33.867319 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaa1469-7839-414b-ae1a-6b5351c1d0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:33.868096 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa1469-7839-414b-ae1a-6b5351c1d0fd None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:33.868377 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa1469-7839-414b-ae1a-6b5351c1d0fd None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:33.868651 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa1469-7839-414b-ae1a-6b5351c1d0fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:33.869639 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaa1469-7839-414b-ae1a-6b5351c1d0fd None admin] RBAC: Adding query filter params (role.id=d8d52b8fc62e44cd9d551b855f2ac84b, scope.project.id=7660c9e611fc4315b714c975f6e5f41e, user.id=2ac9dd996a9f4a0b9387f409d44f60f9) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:33.869924 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaa1469-7839-414b-ae1a-6b5351c1d0fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:33.871658 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaa1469-7839-414b-ae1a-6b5351c1d0fd None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:33.890312 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 44/89] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jul 15 17:23:33 2022] GET /identity/v3/role_assignments?user.id=2ac9dd996a9f4a0b9387f409d44f60f9&scope.project.id=7660c9e611fc4315b714c975f6e5f41e&role.id=d8d52b8fc62e44cd9d551b855f2ac84b => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:33.890312 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaa1469-7839-414b-ae1a-6b5351c1d0fd None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:33.971133 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557badc5-3a7f-42ae-93cf-4ef534215145 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:34.005977 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:34.014302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaa1469-7839-414b-ae1a-6b5351c1d0fd None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:34.021219 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c45c13-f63f-453f-aac0-5c7c71de317c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:34.023682 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c45c13-f63f-453f-aac0-5c7c71de317c None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:34.023682 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c45c13-f63f-453f-aac0-5c7c71de317c None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:34.023682 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c45c13-f63f-453f-aac0-5c7c71de317c None admin] PATH_INFO: `/v3/projects/7660c9e611fc4315b714c975f6e5f41e` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:34.024655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c45c13-f63f-453f-aac0-5c7c71de317c None admin] RBAC: Authorizing `identity:get_project(project_id=7660c9e611fc4315b714c975f6e5f41e)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:34.025473 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c45c13-f63f-453f-aac0-5c7c71de317c None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:34.027985 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 46/90] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:23:33 2022] GET /identity/v3/projects/7660c9e611fc4315b714c975f6e5f41e => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:34.028930 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c45c13-f63f-453f-aac0-5c7c71de317c None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:34.062037 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb892d1-0f09-4994-b911-015a598577e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:34.062730 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb892d1-0f09-4994-b911-015a598577e2 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:34.063084 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb892d1-0f09-4994-b911-015a598577e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:34.063281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb892d1-0f09-4994-b911-015a598577e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:34.064134 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb892d1-0f09-4994-b911-015a598577e2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:34.064516 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb892d1-0f09-4994-b911-015a598577e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:34.065760 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb892d1-0f09-4994-b911-015a598577e2 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:34.076796 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 45/91] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jul 15 17:23:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:34.077597 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb892d1-0f09-4994-b911-015a598577e2 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:34.096736 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:34.154130 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c45c13-f63f-453f-aac0-5c7c71de317c None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:34.197382 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb892d1-0f09-4994-b911-015a598577e2 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:34.198310 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995b3e0-bf86-40ad-9b7b-cafb52f2f1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:34.199375 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995b3e0-bf86-40ad-9b7b-cafb52f2f1d9 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:34.199928 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995b3e0-bf86-40ad-9b7b-cafb52f2f1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:34.200203 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995b3e0-bf86-40ad-9b7b-cafb52f2f1d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:34.201054 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d995b3e0-bf86-40ad-9b7b-cafb52f2f1d9 None admin] RBAC: Adding query filter params (role.id=70d242b29ede4648b639c7ddae5eaead, scope.project.id=7660c9e611fc4315b714c975f6e5f41e, user.id=23aa6e5135404cb6a45a96628c2e41d6) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:34.201369 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d995b3e0-bf86-40ad-9b7b-cafb52f2f1d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:34.202959 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d995b3e0-bf86-40ad-9b7b-cafb52f2f1d9 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:34.212966 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 47/92] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jul 15 17:23:34 2022] GET /identity/v3/role_assignments?user.id=23aa6e5135404cb6a45a96628c2e41d6&scope.project.id=7660c9e611fc4315b714c975f6e5f41e&role.id=70d242b29ede4648b639c7ddae5eaead => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:34.213815 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995b3e0-bf86-40ad-9b7b-cafb52f2f1d9 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:34.256641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94968d-0a19-4ca6-bc78-88718dd7e2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:34.257765 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94968d-0a19-4ca6-bc78-88718dd7e2ae None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:34.258306 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94968d-0a19-4ca6-bc78-88718dd7e2ae None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:34.258785 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94968d-0a19-4ca6-bc78-88718dd7e2ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:34.260013 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94968d-0a19-4ca6-bc78-88718dd7e2ae None admin] RBAC: Adding query filter params (role.id=c9b1f4b47f054f7a8a9a079e65a7197a, scope.project.id=7660c9e611fc4315b714c975f6e5f41e, user.id=2ac9dd996a9f4a0b9387f409d44f60f9) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:34.260554 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94968d-0a19-4ca6-bc78-88718dd7e2ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:34.262404 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94968d-0a19-4ca6-bc78-88718dd7e2ae None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:34.269117 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 46/93] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jul 15 17:23:34 2022] GET /identity/v3/role_assignments?user.id=2ac9dd996a9f4a0b9387f409d44f60f9&scope.project.id=7660c9e611fc4315b714c975f6e5f41e&role.id=c9b1f4b47f054f7a8a9a079e65a7197a => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:34.277606 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:34.334833 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995b3e0-bf86-40ad-9b7b-cafb52f2f1d9 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:34.374139 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f209f4-3c31-4699-bd78-4afadf1743eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:34.375092 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f209f4-3c31-4699-bd78-4afadf1743eb None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:34.375372 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f209f4-3c31-4699-bd78-4afadf1743eb None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:34.375644 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f209f4-3c31-4699-bd78-4afadf1743eb None admin] PATH_INFO: `/v3/users/2ac9dd996a9f4a0b9387f409d44f60f9` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:34.376940 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f209f4-3c31-4699-bd78-4afadf1743eb None admin] RBAC: Authorizing `identity:get_user(user_id=2ac9dd996a9f4a0b9387f409d44f60f9)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:34.378478 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f209f4-3c31-4699-bd78-4afadf1743eb None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:34.380229 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 48/94] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:23:34 2022] GET /identity/v3/users/2ac9dd996a9f4a0b9387f409d44f60f9 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:34.386183 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94968d-0a19-4ca6-bc78-88718dd7e2ae None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:34.478533 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:34.505113 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94968d-0a19-4ca6-bc78-88718dd7e2ae None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:34.541401 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724d52c-44c8-4fc8-8bf6-3059c8e4c707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:34.542137 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724d52c-44c8-4fc8-8bf6-3059c8e4c707 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:34.542424 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724d52c-44c8-4fc8-8bf6-3059c8e4c707 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:34.542751 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724d52c-44c8-4fc8-8bf6-3059c8e4c707 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:34.624941 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d724d52c-44c8-4fc8-8bf6-3059c8e4c707 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:34.626480 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d724d52c-44c8-4fc8-8bf6-3059c8e4c707 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:34.710219 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:34.742619 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 47/95] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:23:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 17:23:34.748317 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f209f4-3c31-4699-bd78-4afadf1743eb None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:34.898510 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f209f4-3c31-4699-bd78-4afadf1743eb None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:34.934665 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:34.950663 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d04956-4bf3-4ee2-aaf0-856df947d9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:34.951551 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d04956-4bf3-4ee2-aaf0-856df947d9c2 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:34.951838 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d04956-4bf3-4ee2-aaf0-856df947d9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:34.952122 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d04956-4bf3-4ee2-aaf0-856df947d9c2 None admin] PATH_INFO: `/v3/projects/2ee0e90b9ef242f59d727daa40b84620` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:34.954581 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d04956-4bf3-4ee2-aaf0-856df947d9c2 None admin] RBAC: Authorizing `identity:get_project(project_id=2ee0e90b9ef242f59d727daa40b84620)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:34.956410 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d04956-4bf3-4ee2-aaf0-856df947d9c2 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:34.958550 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 49/96] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:23:34 2022] GET /identity/v3/projects/2ee0e90b9ef242f59d727daa40b84620 => generated 312 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:34.964446 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724d52c-44c8-4fc8-8bf6-3059c8e4c707 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:35.076017 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724d52c-44c8-4fc8-8bf6-3059c8e4c707 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:35.115986 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e7402-325e-45ad-bf24-94e11709c9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:35.116651 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e7402-325e-45ad-bf24-94e11709c9a2 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:35.116938 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e7402-325e-45ad-bf24-94e11709c9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:35.117212 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e7402-325e-45ad-bf24-94e11709c9a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:35.118082 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e7402-325e-45ad-bf24-94e11709c9a2 None admin] RBAC: Adding query filter params (role.id=d8d52b8fc62e44cd9d551b855f2ac84b, scope.project.id=2ee0e90b9ef242f59d727daa40b84620, user.id=2ac9dd996a9f4a0b9387f409d44f60f9) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:35.118397 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e7402-325e-45ad-bf24-94e11709c9a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:35.119902 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e7402-325e-45ad-bf24-94e11709c9a2 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:35.130157 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 48/97] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jul 15 17:23:34 2022] GET /identity/v3/role_assignments?user.id=2ac9dd996a9f4a0b9387f409d44f60f9&scope.project.id=2ee0e90b9ef242f59d727daa40b84620&role.id=d8d52b8fc62e44cd9d551b855f2ac84b => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:36.717664 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d02a36-6d38-48b1-ab80-1c6d63ee5015 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:36.718207 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d02a36-6d38-48b1-ab80-1c6d63ee5015 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:36.718207 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d02a36-6d38-48b1-ab80-1c6d63ee5015 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:36.719605 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 50/98] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:23:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:23:36.724855 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17330e59-7951-4132-b9ce-58d14ec2e16c None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:36.725308 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17330e59-7951-4132-b9ce-58d14ec2e16c None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:36.725479 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17330e59-7951-4132-b9ce-58d14ec2e16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:36.751149 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-17330e59-7951-4132-b9ce-58d14ec2e16c None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:23:36.752372 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-17330e59-7951-4132-b9ce-58d14ec2e16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:23:36.801675 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:36.848104 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 49/99] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:23:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:23:36.889912 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d02a36-6d38-48b1-ab80-1c6d63ee5015 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:36.920735 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824da61-67e5-4c48-8bf2-5cf05f8714a2 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:36.921040 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824da61-67e5-4c48-8bf2-5cf05f8714a2 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:36.921340 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824da61-67e5-4c48-8bf2-5cf05f8714a2 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:36.922889 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 50/100] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:23:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 17:23:36.930782 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c6e10-f5e7-4c26-9a96-c3c5cb394482 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:36.931121 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c6e10-f5e7-4c26-9a96-c3c5cb394482 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:36.931342 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c6e10-f5e7-4c26-9a96-c3c5cb394482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:36.950590 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-795c6e10-f5e7-4c26-9a96-c3c5cb394482 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:23:36.951767 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-795c6e10-f5e7-4c26-9a96-c3c5cb394482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:23:37.079867 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d02a36-6d38-48b1-ab80-1c6d63ee5015 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:37.092933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 51/101] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:23:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 17:23:37.131006 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b1e23-b7d3-43d9-97bf-2ea4fd274824 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:37.131318 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b1e23-b7d3-43d9-97bf-2ea4fd274824 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:37.131566 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b1e23-b7d3-43d9-97bf-2ea4fd274824 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:37.133091 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 52/102] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:23:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 17:23:37.133638 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b1e23-b7d3-43d9-97bf-2ea4fd274824 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:37.138485 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6123a01-a365-4508-9872-1df3832470e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:37.139288 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6123a01-a365-4508-9872-1df3832470e9 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:37.139566 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6123a01-a365-4508-9872-1df3832470e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:37.139891 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6123a01-a365-4508-9872-1df3832470e9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:37.158445 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6123a01-a365-4508-9872-1df3832470e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:23:37.166541 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-f6123a01-a365-4508-9872-1df3832470e9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 17:23:37.166541 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:23:37.166541 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:23:37.166541 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:23:37.166541 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:23:37.166541 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:23:37.166541 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:23:37.166541 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:23:37.166541 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:23:37.166541 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:23:37.166541 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:23:37.166541 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:23:37.166541 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:23:37.166541 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:23:37.166541 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:23:37.166541 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:23:37.168209 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:23:37.168209 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:23:37.168209 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:23:37.168209 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:23:37.168209 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:23:37.168209 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:23:37.168209 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:23:37.168209 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:23:37.168209 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:23:37.168209 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:23:37.168209 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:23:37.168209 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:23:37.168209 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:23:37.168209 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:23:37.168209 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:23:37.168209 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:23:37.170632 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:23:37.170632 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:23:37.170632 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:23:37.170632 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:23:37.170632 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:23:37.170632 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:23:37.170632 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:23:37.170632 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:23:37.170632 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:23:37.170632 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:23:37.170632 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 17:23:37.170632 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:23:37.170632 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 51/103] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:23:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:23:37.170632 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fa2aa-e11d-4854-bb68-90c57bd799c1 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:37.172046 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fa2aa-e11d-4854-bb68-90c57bd799c1 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:37.172046 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fa2aa-e11d-4854-bb68-90c57bd799c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:37.188233 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-f32fa2aa-e11d-4854-bb68-90c57bd799c1 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:23:37.189467 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-f32fa2aa-e11d-4854-bb68-90c57bd799c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:23:37.250244 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:37.265957 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 52/104] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:23:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:23:37.266940 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32fa2aa-e11d-4854-bb68-90c57bd799c1 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:37.320758 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:37.326017 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b1e23-b7d3-43d9-97bf-2ea4fd274824 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:37.364243 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af17d3f-b04c-4b03-9802-5914d1348c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:37.365474 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af17d3f-b04c-4b03-9802-5914d1348c30 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:37.366049 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af17d3f-b04c-4b03-9802-5914d1348c30 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:37.366531 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af17d3f-b04c-4b03-9802-5914d1348c30 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:37.379591 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af17d3f-b04c-4b03-9802-5914d1348c30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:23:37.381039 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32fa2aa-e11d-4854-bb68-90c57bd799c1 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:37.389511 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-8af17d3f-b04c-4b03-9802-5914d1348c30 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 17:23:37.389511 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:23:37.389511 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:23:37.389511 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:23:37.389511 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:23:37.389511 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:23:37.389511 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:23:37.389511 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:23:37.389511 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:23:37.389511 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:23:37.389511 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:23:37.389511 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:23:37.389511 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:23:37.389511 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:23:37.389511 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:23:37.389511 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:23:37.390481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:23:37.390481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:23:37.390481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:23:37.390481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:23:37.390481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:23:37.390481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:23:37.390481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:23:37.390481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:23:37.390481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:23:37.390481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:23:37.390481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:23:37.390481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:23:37.390481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:23:37.390481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:23:37.390481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:23:37.390481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:23:37.391261 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:23:37.391261 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:23:37.391261 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:23:37.391261 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:23:37.391261 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:23:37.391261 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:23:37.391261 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:23:37.391261 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:23:37.391261 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:23:37.391261 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:23:37.391261 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 17:23:37.391261 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:23:37.391261 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 53/105] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:23:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:23:37.398310 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b7497-b3f1-478e-8b0a-2de0e186cfc9 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:37.398875 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b7497-b3f1-478e-8b0a-2de0e186cfc9 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:37.399803 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b7497-b3f1-478e-8b0a-2de0e186cfc9 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:37.402503 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 54/106] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:23:37 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:23:37.403729 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b7497-b3f1-478e-8b0a-2de0e186cfc9 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:37.435908 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995abbf-2def-4f5c-96b2-bdd098fc2246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:37.436745 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995abbf-2def-4f5c-96b2-bdd098fc2246 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:37.437667 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995abbf-2def-4f5c-96b2-bdd098fc2246 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:37.438171 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995abbf-2def-4f5c-96b2-bdd098fc2246 None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:37.439319 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0995abbf-2def-4f5c-96b2-bdd098fc2246 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:37.439689 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0995abbf-2def-4f5c-96b2-bdd098fc2246 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:37.441866 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0995abbf-2def-4f5c-96b2-bdd098fc2246 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:37.453716 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 53/107] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jul 15 17:23:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:37.454828 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995abbf-2def-4f5c-96b2-bdd098fc2246 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:37.519371 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b7497-b3f1-478e-8b0a-2de0e186cfc9 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:37.520924 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:37.556789 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9f444-6f34-4181-ae65-4cab3141620f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:37.557592 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9f444-6f34-4181-ae65-4cab3141620f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:37.557902 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9f444-6f34-4181-ae65-4cab3141620f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:37.558573 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9f444-6f34-4181-ae65-4cab3141620f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:37.559742 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e9f444-6f34-4181-ae65-4cab3141620f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:37.561929 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e9f444-6f34-4181-ae65-4cab3141620f None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:37.564033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 55/108] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:23:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:37.565263 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa5952-70bc-4e5a-bca1-a2e90a01e986 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:37.565553 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa5952-70bc-4e5a-bca1-a2e90a01e986 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:37.565852 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa5952-70bc-4e5a-bca1-a2e90a01e986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:37.582139 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-26aa5952-70bc-4e5a-bca1-a2e90a01e986 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:23:37.583326 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-26aa5952-70bc-4e5a-bca1-a2e90a01e986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:23:37.588534 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995abbf-2def-4f5c-96b2-bdd098fc2246 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:37.605542 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:37.627390 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3d95d-4105-42ff-988b-536f8d15ae2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:37.627989 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3d95d-4105-42ff-988b-536f8d15ae2f None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:37.628305 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3d95d-4105-42ff-988b-536f8d15ae2f None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:37.628546 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3d95d-4105-42ff-988b-536f8d15ae2f None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:37.629338 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb3d95d-4105-42ff-988b-536f8d15ae2f None admin] RBAC: Adding query filter params (name=member) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:37.629639 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb3d95d-4105-42ff-988b-536f8d15ae2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:37.631292 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb3d95d-4105-42ff-988b-536f8d15ae2f None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:37.644882 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 54/109] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jul 15 17:23:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:37.644882 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3d95d-4105-42ff-988b-536f8d15ae2f None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:37.657048 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 56/110] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:23:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:23:37.667232 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880fab6-daff-41c0-9f4a-f9fca3b72618 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:37.667580 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880fab6-daff-41c0-9f4a-f9fca3b72618 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:37.667887 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880fab6-daff-41c0-9f4a-f9fca3b72618 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:37.669223 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 57/111] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:23:37 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:23:37.673843 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b880fab6-daff-41c0-9f4a-f9fca3b72618 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:37.753861 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3d95d-4105-42ff-988b-536f8d15ae2f None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:37.756271 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:37.776909 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b880fab6-daff-41c0-9f4a-f9fca3b72618 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:37.791303 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf843f-d6ff-404a-a1d8-5c69f5ad47c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:37.792564 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf843f-d6ff-404a-a1d8-5c69f5ad47c3 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:37.792992 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf843f-d6ff-404a-a1d8-5c69f5ad47c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:37.793270 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf843f-d6ff-404a-a1d8-5c69f5ad47c3 None admin] PATH_INFO: `/v3/users/58ba77a3b3154cbaaa2d756dff52192e` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:37.807754 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cf843f-d6ff-404a-a1d8-5c69f5ad47c3 None admin] RBAC: Authorizing `identity:get_user(user_id=58ba77a3b3154cbaaa2d756dff52192e)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:37.809234 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cf843f-d6ff-404a-a1d8-5c69f5ad47c3 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:37.810990 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 55/112] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:23:37 2022] GET /identity/v3/users/58ba77a3b3154cbaaa2d756dff52192e => generated 289 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:37.815500 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf843f-d6ff-404a-a1d8-5c69f5ad47c3 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:37.816351 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a130a4-ec33-4d83-97dd-478ec99b0e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:37.817025 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a130a4-ec33-4d83-97dd-478ec99b0e12 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:37.817304 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a130a4-ec33-4d83-97dd-478ec99b0e12 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:37.817581 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a130a4-ec33-4d83-97dd-478ec99b0e12 None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:37.818336 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a130a4-ec33-4d83-97dd-478ec99b0e12 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:37.819795 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a130a4-ec33-4d83-97dd-478ec99b0e12 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:37.848786 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 58/113] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Jul 15 17:23:37 2022] POST /identity/v3/projects => generated 302 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:23:37.863352 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe22dca-056a-4d69-ba46-8822e30d4980 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:37.863674 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe22dca-056a-4d69-ba46-8822e30d4980 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:37.863922 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe22dca-056a-4d69-ba46-8822e30d4980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:37.888628 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-4fe22dca-056a-4d69-ba46-8822e30d4980 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:23:37.890296 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-4fe22dca-056a-4d69-ba46-8822e30d4980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:23:37.895251 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:37.929712 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf843f-d6ff-404a-a1d8-5c69f5ad47c3 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:37.973212 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20bff5-e1cc-40a0-9753-68e56634daa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:37.974637 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20bff5-e1cc-40a0-9753-68e56634daa9 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:37.975126 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20bff5-e1cc-40a0-9753-68e56634daa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:37.975655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20bff5-e1cc-40a0-9753-68e56634daa9 None admin] PATH_INFO: `/v3/users/2ac9dd996a9f4a0b9387f409d44f60f9` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:37.977347 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af20bff5-e1cc-40a0-9753-68e56634daa9 None admin] RBAC: Authorizing `identity:get_user(user_id=2ac9dd996a9f4a0b9387f409d44f60f9)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:37.979237 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af20bff5-e1cc-40a0-9753-68e56634daa9 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:37.981463 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 56/114] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:23:37 2022] GET /identity/v3/users/2ac9dd996a9f4a0b9387f409d44f60f9 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:37.983627 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20bff5-e1cc-40a0-9753-68e56634daa9 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:37.986275 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 59/115] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:23:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:23:37.988475 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe22dca-056a-4d69-ba46-8822e30d4980 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:38.023069 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:38.105645 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20bff5-e1cc-40a0-9753-68e56634daa9 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:38.120108 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe22dca-056a-4d69-ba46-8822e30d4980 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:38.141230 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6e6d6-e864-42fd-a9af-a613e564c5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:38.141988 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6e6d6-e864-42fd-a9af-a613e564c5a1 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:38.142276 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6e6d6-e864-42fd-a9af-a613e564c5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:38.142554 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6e6d6-e864-42fd-a9af-a613e564c5a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:38.153374 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f6e6d6-e864-42fd-a9af-a613e564c5a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:23:38.160485 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4cd55c-106b-4dfb-ab4c-ffc9d273ec55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:38.161171 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-c1f6e6d6-e864-42fd-a9af-a613e564c5a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:23:38.161171 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:23:38.161171 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:23:38.161171 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:23:38.161171 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:23:38.161171 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:23:38.161171 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:23:38.161171 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:23:38.161171 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:23:38.161171 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:23:38.161171 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:23:38.161171 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:23:38.161171 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:23:38.161171 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:23:38.161171 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:23:38.161171 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:23:38.162193 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:23:38.162193 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:23:38.162193 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:23:38.162193 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:23:38.162193 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:23:38.162193 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:23:38.162193 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:23:38.162193 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:23:38.162193 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:23:38.162193 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:23:38.162193 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:23:38.162193 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:23:38.162193 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:23:38.162193 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:23:38.162193 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:23:38.162193 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:23:38.163104 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:23:38.163104 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:23:38.163104 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:23:38.163104 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:23:38.163104 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:23:38.163104 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:23:38.163104 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:23:38.163104 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:23:38.163104 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:23:38.163104 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:23:38.163104 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:23:38.163104 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:23:38.163795 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4cd55c-106b-4dfb-ab4c-ffc9d273ec55 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:38.163795 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4cd55c-106b-4dfb-ab4c-ffc9d273ec55 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:38.163795 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4cd55c-106b-4dfb-ab4c-ffc9d273ec55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:38.167377 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 57/116] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jul 15 17:23:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:23:38.168214 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6e6d6-e864-42fd-a9af-a613e564c5a1 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:38.176745 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:38.239051 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4cd55c-106b-4dfb-ab4c-ffc9d273ec55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:38.240702 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4cd55c-106b-4dfb-ab4c-ffc9d273ec55 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:38.267520 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:38.278097 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6e6d6-e864-42fd-a9af-a613e564c5a1 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:38.321249 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf7db23-d0c2-4a8d-b30c-f5fef88130f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:38.322290 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7db23-d0c2-4a8d-b30c-f5fef88130f9 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:38.322646 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7db23-d0c2-4a8d-b30c-f5fef88130f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:38.322927 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7db23-d0c2-4a8d-b30c-f5fef88130f9 None admin] PATH_INFO: `/v3/projects/7660c9e611fc4315b714c975f6e5f41e` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:38.324118 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf7db23-d0c2-4a8d-b30c-f5fef88130f9 None admin] RBAC: Authorizing `identity:get_project(project_id=7660c9e611fc4315b714c975f6e5f41e)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:38.325579 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf7db23-d0c2-4a8d-b30c-f5fef88130f9 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:38.327544 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 58/117] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:23:38 2022] GET /identity/v3/projects/7660c9e611fc4315b714c975f6e5f41e => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:38.328200 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf7db23-d0c2-4a8d-b30c-f5fef88130f9 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:38.347416 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 60/118] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:23:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 17:23:38.348991 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5338374-0e63-4192-9555-50ea07d7e340 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:38.349441 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5338374-0e63-4192-9555-50ea07d7e340 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:38.349902 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5338374-0e63-4192-9555-50ea07d7e340 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:38.355236 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 61/119] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:23:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:23:38.355236 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5338374-0e63-4192-9555-50ea07d7e340 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:38.399850 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:38.442547 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf7db23-d0c2-4a8d-b30c-f5fef88130f9 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:38.462585 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5338374-0e63-4192-9555-50ea07d7e340 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:38.482862 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a0e94-abfc-401d-b629-7f43c73cd17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:38.483749 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a0e94-abfc-401d-b629-7f43c73cd17d None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:38.484405 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a0e94-abfc-401d-b629-7f43c73cd17d None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:38.484405 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a0e94-abfc-401d-b629-7f43c73cd17d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:38.494995 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975a0e94-abfc-401d-b629-7f43c73cd17d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:23:38.498417 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19be01-562c-4109-ad44-e4bc2e6abd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:38.499217 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19be01-562c-4109-ad44-e4bc2e6abd06 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:38.499510 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19be01-562c-4109-ad44-e4bc2e6abd06 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:38.499791 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19be01-562c-4109-ad44-e4bc2e6abd06 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:38.500544 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19be01-562c-4109-ad44-e4bc2e6abd06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:38.500849 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19be01-562c-4109-ad44-e4bc2e6abd06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:38.502275 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19be01-562c-4109-ad44-e4bc2e6abd06 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:38.503262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-975a0e94-abfc-401d-b629-7f43c73cd17d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 17:23:38.503262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:23:38.503262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:23:38.503262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:23:38.503262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:23:38.503262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:23:38.503262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:23:38.503262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:23:38.503262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:23:38.503262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:23:38.503262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:23:38.503262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:23:38.503262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:23:38.503262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:23:38.503262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:23:38.503262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:23:38.504095 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:23:38.504095 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:23:38.504095 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:23:38.504095 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:23:38.504095 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:23:38.504095 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:23:38.504095 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:23:38.504095 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:23:38.504095 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:23:38.504095 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:23:38.504095 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:23:38.504095 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:23:38.504095 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:23:38.504095 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:23:38.504095 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:23:38.504095 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:23:38.504881 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:23:38.504881 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:23:38.504881 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:23:38.504881 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:23:38.504881 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:23:38.504881 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:23:38.504881 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:23:38.504881 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:23:38.504881 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:23:38.504881 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:23:38.504881 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 17:23:38.504881 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:23:38.504881 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 59/120] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Jul 15 17:23:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:23:38.505503 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a0e94-abfc-401d-b629-7f43c73cd17d None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:38.521820 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 62/121] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:23:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:38.521820 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19be01-562c-4109-ad44-e4bc2e6abd06 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:38.531625 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:38.618929 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a0e94-abfc-401d-b629-7f43c73cd17d None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:38.625869 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19be01-562c-4109-ad44-e4bc2e6abd06 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:38.627543 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:38.657543 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb16438-f95c-4805-a150-fdec32b50183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:38.658702 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb16438-f95c-4805-a150-fdec32b50183 None admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:38.659133 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb16438-f95c-4805-a150-fdec32b50183 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:38.659550 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb16438-f95c-4805-a150-fdec32b50183 None admin] PATH_INFO: `/v3/projects/7660c9e611fc4315b714c975f6e5f41e/users/2ac9dd996a9f4a0b9387f409d44f60f9/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:38.661599 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376233b-00f8-4e76-8377-c7a09b1d54e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:38.661949 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb16438-f95c-4805-a150-fdec32b50183 None admin] RBAC: Authorizing `identity:create_grant(project_id=7660c9e611fc4315b714c975f6e5f41e, user_id=2ac9dd996a9f4a0b9387f409d44f60f9, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:38.662508 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376233b-00f8-4e76-8377-c7a09b1d54e8 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:38.662789 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376233b-00f8-4e76-8377-c7a09b1d54e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:38.663061 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376233b-00f8-4e76-8377-c7a09b1d54e8 None admin] PATH_INFO: `/v3/projects/7660c9e611fc4315b714c975f6e5f41e` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:38.664062 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb16438-f95c-4805-a150-fdec32b50183 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:38.664240 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4376233b-00f8-4e76-8377-c7a09b1d54e8 None admin] RBAC: Authorizing `identity:get_project(project_id=7660c9e611fc4315b714c975f6e5f41e)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:38.665668 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4376233b-00f8-4e76-8377-c7a09b1d54e8 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:38.667424 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 63/122] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:23:38 2022] GET /identity/v3/projects/7660c9e611fc4315b714c975f6e5f41e => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:38.668559 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72736048-8df9-4c01-92c7-8e9fe37bb64c None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:38.668839 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72736048-8df9-4c01-92c7-8e9fe37bb64c None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:38.669125 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72736048-8df9-4c01-92c7-8e9fe37bb64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:38.684577 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 60/123] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Jul 15 17:23:38 2022] PUT /identity/v3/projects/7660c9e611fc4315b714c975f6e5f41e/users/2ac9dd996a9f4a0b9387f409d44f60f9/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:23:38.685672 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb16438-f95c-4805-a150-fdec32b50183 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:38.695210 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-72736048-8df9-4c01-92c7-8e9fe37bb64c None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:23:38.696771 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-72736048-8df9-4c01-92c7-8e9fe37bb64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:23:38.789004 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:38.799996 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 64/124] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:23:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:23:38.802863 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72736048-8df9-4c01-92c7-8e9fe37bb64c None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:38.833630 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb16438-f95c-4805-a150-fdec32b50183 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:38.880252 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c323a-6dba-479f-be0b-8507ef295310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:38.880936 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c323a-6dba-479f-be0b-8507ef295310 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:38.881219 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c323a-6dba-479f-be0b-8507ef295310 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:38.881489 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c323a-6dba-479f-be0b-8507ef295310 None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:38.882292 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214c323a-6dba-479f-be0b-8507ef295310 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:38.882603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214c323a-6dba-479f-be0b-8507ef295310 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:38.883978 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214c323a-6dba-479f-be0b-8507ef295310 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:38.892854 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 61/125] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:23:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:38.893667 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c323a-6dba-479f-be0b-8507ef295310 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:38.946981 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:38.952002 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72736048-8df9-4c01-92c7-8e9fe37bb64c None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:38.995008 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b973da-9380-4c6d-b497-7492b2ec44a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:38.996194 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b973da-9380-4c6d-b497-7492b2ec44a6 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:38.996648 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b973da-9380-4c6d-b497-7492b2ec44a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:38.997090 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b973da-9380-4c6d-b497-7492b2ec44a6 None admin] PATH_INFO: `/v3/users/23aa6e5135404cb6a45a96628c2e41d6` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:38.998539 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b973da-9380-4c6d-b497-7492b2ec44a6 None admin] RBAC: Authorizing `identity:get_user(user_id=23aa6e5135404cb6a45a96628c2e41d6)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:39.000372 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b973da-9380-4c6d-b497-7492b2ec44a6 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:39.002385 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 65/126] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:23:38 2022] GET /identity/v3/users/23aa6e5135404cb6a45a96628c2e41d6 => generated 247 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:39.003311 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b973da-9380-4c6d-b497-7492b2ec44a6 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:39.004228 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c323a-6dba-479f-be0b-8507ef295310 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:39.051081 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d841342-78a9-4ae8-bb0d-1488cc30f8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:39.052198 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d841342-78a9-4ae8-bb0d-1488cc30f8f7 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:39.052508 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d841342-78a9-4ae8-bb0d-1488cc30f8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:39.052789 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d841342-78a9-4ae8-bb0d-1488cc30f8f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:39.053641 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d841342-78a9-4ae8-bb0d-1488cc30f8f7 None admin] RBAC: Adding query filter params (role.id=a3a3c02087374a9086cf0d79e6118247, scope.project.id=7660c9e611fc4315b714c975f6e5f41e, user.id=58ba77a3b3154cbaaa2d756dff52192e) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:39.053985 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d841342-78a9-4ae8-bb0d-1488cc30f8f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:39.056174 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d841342-78a9-4ae8-bb0d-1488cc30f8f7 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:39.063780 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 62/127] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jul 15 17:23:38 2022] GET /identity/v3/role_assignments?user.id=58ba77a3b3154cbaaa2d756dff52192e&scope.project.id=7660c9e611fc4315b714c975f6e5f41e&role.id=a3a3c02087374a9086cf0d79e6118247 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:39.064732 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d841342-78a9-4ae8-bb0d-1488cc30f8f7 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:39.070507 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:39.128556 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b973da-9380-4c6d-b497-7492b2ec44a6 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:39.174362 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b696d8-b823-4afc-a62c-b8cb940c4bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:39.175335 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b696d8-b823-4afc-a62c-b8cb940c4bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:39.175624 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b696d8-b823-4afc-a62c-b8cb940c4bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:39.175904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b696d8-b823-4afc-a62c-b8cb940c4bf6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:39.190739 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b696d8-b823-4afc-a62c-b8cb940c4bf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:23:39.194224 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d841342-78a9-4ae8-bb0d-1488cc30f8f7 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:39.199982 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-c6b696d8-b823-4afc-a62c-b8cb940c4bf6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 17:23:39.199982 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:23:39.199982 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:23:39.199982 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:23:39.199982 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:23:39.199982 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:23:39.199982 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:23:39.199982 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:23:39.199982 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:23:39.199982 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:23:39.199982 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:23:39.199982 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:23:39.199982 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:23:39.199982 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:23:39.199982 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:23:39.199982 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:23:39.200815 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:23:39.200815 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:23:39.200815 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:23:39.200815 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:23:39.200815 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:23:39.200815 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:23:39.200815 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:23:39.200815 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:23:39.200815 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:23:39.200815 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:23:39.200815 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:23:39.200815 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:23:39.200815 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:23:39.200815 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:23:39.200815 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:23:39.200815 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:23:39.201603 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:23:39.201603 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:23:39.201603 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:23:39.201603 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:23:39.201603 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:23:39.201603 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:23:39.201603 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:23:39.201603 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:23:39.201603 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:23:39.201603 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:23:39.201603 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 17:23:39.201603 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:23:39.201603 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 66/128] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:23:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:23:39.202660 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b696d8-b823-4afc-a62c-b8cb940c4bf6 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:39.256248 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd90a6-5b99-4af8-b416-66c69dc06b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:39.257217 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd90a6-5b99-4af8-b416-66c69dc06b98 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:39.257507 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd90a6-5b99-4af8-b416-66c69dc06b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:39.257811 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd90a6-5b99-4af8-b416-66c69dc06b98 None admin] PATH_INFO: `/v3/users/2ac9dd996a9f4a0b9387f409d44f60f9` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:39.260398 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbd90a6-5b99-4af8-b416-66c69dc06b98 None admin] RBAC: Authorizing `identity:get_user(user_id=2ac9dd996a9f4a0b9387f409d44f60f9)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:39.262822 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbd90a6-5b99-4af8-b416-66c69dc06b98 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:39.263478 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:39.264731 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 63/129] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:23:39 2022] GET /identity/v3/users/2ac9dd996a9f4a0b9387f409d44f60f9 => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:39.265574 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd90a6-5b99-4af8-b416-66c69dc06b98 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:39.363393 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b696d8-b823-4afc-a62c-b8cb940c4bf6 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:39.392909 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:39.398593 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8566bf-b258-4112-8099-ef3f0f76dd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:39.399733 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8566bf-b258-4112-8099-ef3f0f76dd9e None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:39.400148 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8566bf-b258-4112-8099-ef3f0f76dd9e None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:39.400553 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8566bf-b258-4112-8099-ef3f0f76dd9e None admin] PATH_INFO: `/v3/projects/7660c9e611fc4315b714c975f6e5f41e` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:39.401913 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8566bf-b258-4112-8099-ef3f0f76dd9e None admin] RBAC: Authorizing `identity:get_project(project_id=7660c9e611fc4315b714c975f6e5f41e)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:39.403511 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8566bf-b258-4112-8099-ef3f0f76dd9e None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:39.405369 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 67/130] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:23:39 2022] GET /identity/v3/projects/7660c9e611fc4315b714c975f6e5f41e => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:39.406548 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8566bf-b258-4112-8099-ef3f0f76dd9e None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:39.469992 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd90a6-5b99-4af8-b416-66c69dc06b98 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:39.538561 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674ebcf-d745-4b1c-9140-2b2435573361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:39.539618 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674ebcf-d745-4b1c-9140-2b2435573361 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:39.540139 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674ebcf-d745-4b1c-9140-2b2435573361 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:39.540639 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674ebcf-d745-4b1c-9140-2b2435573361 None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:39.541590 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674ebcf-d745-4b1c-9140-2b2435573361 None admin] RBAC: Adding query filter params (name=member) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:39.543429 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674ebcf-d745-4b1c-9140-2b2435573361 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:39.545019 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674ebcf-d745-4b1c-9140-2b2435573361 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:39.554140 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:39.561223 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8566bf-b258-4112-8099-ef3f0f76dd9e None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:39.566547 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 64/131] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jul 15 17:23:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:39.567169 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674ebcf-d745-4b1c-9140-2b2435573361 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:39.622447 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfd6ab2-c11f-40de-becc-5285dc304df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:39.623324 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd6ab2-c11f-40de-becc-5285dc304df4 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:39.623602 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd6ab2-c11f-40de-becc-5285dc304df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:39.623940 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd6ab2-c11f-40de-becc-5285dc304df4 None admin] PATH_INFO: `/v3/projects/7660c9e611fc4315b714c975f6e5f41e` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:39.625190 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfd6ab2-c11f-40de-becc-5285dc304df4 None admin] RBAC: Authorizing `identity:get_project(project_id=7660c9e611fc4315b714c975f6e5f41e)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:39.626714 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfd6ab2-c11f-40de-becc-5285dc304df4 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:39.628714 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 68/132] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:23:39 2022] GET /identity/v3/projects/7660c9e611fc4315b714c975f6e5f41e => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:39.629482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfd6ab2-c11f-40de-becc-5285dc304df4 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:39.733039 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfd6ab2-c11f-40de-becc-5285dc304df4 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:39.743309 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674ebcf-d745-4b1c-9140-2b2435573361 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:39.766934 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eeb64e-d3d9-412d-9406-dfd907d6b2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:39.767821 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eeb64e-d3d9-412d-9406-dfd907d6b2c0 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:39.768103 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eeb64e-d3d9-412d-9406-dfd907d6b2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:39.768377 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eeb64e-d3d9-412d-9406-dfd907d6b2c0 None admin] PATH_INFO: `/v3/users/2ac9dd996a9f4a0b9387f409d44f60f9` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:39.769583 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eeb64e-d3d9-412d-9406-dfd907d6b2c0 None admin] RBAC: Authorizing `identity:get_user(user_id=2ac9dd996a9f4a0b9387f409d44f60f9)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:39.771056 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eeb64e-d3d9-412d-9406-dfd907d6b2c0 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:39.772686 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 69/133] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:23:39 2022] GET /identity/v3/users/2ac9dd996a9f4a0b9387f409d44f60f9 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:39.773414 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eeb64e-d3d9-412d-9406-dfd907d6b2c0 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:39.815008 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444c9de-c50a-45a5-9649-e8ef56b5e922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:39.815929 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444c9de-c50a-45a5-9649-e8ef56b5e922 None admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:39.816215 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444c9de-c50a-45a5-9649-e8ef56b5e922 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:39.816497 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444c9de-c50a-45a5-9649-e8ef56b5e922 None admin] PATH_INFO: `/v3/projects/7660c9e611fc4315b714c975f6e5f41e/users/23aa6e5135404cb6a45a96628c2e41d6/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:39.817008 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:39.819016 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444c9de-c50a-45a5-9649-e8ef56b5e922 None admin] RBAC: Authorizing `identity:create_grant(project_id=7660c9e611fc4315b714c975f6e5f41e, user_id=23aa6e5135404cb6a45a96628c2e41d6, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:39.820472 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444c9de-c50a-45a5-9649-e8ef56b5e922 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:39.825998 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:39.872705 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 65/134] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Jul 15 17:23:39 2022] PUT /identity/v3/projects/7660c9e611fc4315b714c975f6e5f41e/users/23aa6e5135404cb6a45a96628c2e41d6/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:23:39.873568 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444c9de-c50a-45a5-9649-e8ef56b5e922 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:39.880444 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eeb64e-d3d9-412d-9406-dfd907d6b2c0 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:39.917695 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956423d-c6d7-4ddd-a60a-e043d6b32a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:39.918683 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956423d-c6d7-4ddd-a60a-e043d6b32a71 None admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:39.918968 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956423d-c6d7-4ddd-a60a-e043d6b32a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:39.919283 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956423d-c6d7-4ddd-a60a-e043d6b32a71 None admin] PATH_INFO: `/v3/projects/7660c9e611fc4315b714c975f6e5f41e/users/2ac9dd996a9f4a0b9387f409d44f60f9/roles/c9b1f4b47f054f7a8a9a079e65a7197a` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:39.921685 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1956423d-c6d7-4ddd-a60a-e043d6b32a71 None admin] RBAC: Authorizing `identity:create_grant(project_id=7660c9e611fc4315b714c975f6e5f41e, user_id=2ac9dd996a9f4a0b9387f409d44f60f9, role_id=c9b1f4b47f054f7a8a9a079e65a7197a)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:39.923296 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1956423d-c6d7-4ddd-a60a-e043d6b32a71 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:39.952130 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 70/135] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Jul 15 17:23:39 2022] PUT /identity/v3/projects/7660c9e611fc4315b714c975f6e5f41e/users/2ac9dd996a9f4a0b9387f409d44f60f9/roles/c9b1f4b47f054f7a8a9a079e65a7197a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:23:40.064336 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444c9de-c50a-45a5-9649-e8ef56b5e922 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:40.103122 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e8680-9e30-46de-bd03-6dbed6581d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:40.104011 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e8680-9e30-46de-bd03-6dbed6581d57 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:40.104289 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e8680-9e30-46de-bd03-6dbed6581d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:40.104561 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e8680-9e30-46de-bd03-6dbed6581d57 None admin] PATH_INFO: `/v3/projects/2ee0e90b9ef242f59d727daa40b84620` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:40.105879 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e8680-9e30-46de-bd03-6dbed6581d57 None admin] RBAC: Authorizing `identity:get_project(project_id=2ee0e90b9ef242f59d727daa40b84620)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:40.107364 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e8680-9e30-46de-bd03-6dbed6581d57 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:40.109584 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 66/136] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:23:39 2022] GET /identity/v3/projects/2ee0e90b9ef242f59d727daa40b84620 => generated 312 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:40.115084 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956423d-c6d7-4ddd-a60a-e043d6b32a71 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:40.147159 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd760e56-684c-4d6a-80cd-ba9be8b3912e None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:40.147514 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd760e56-684c-4d6a-80cd-ba9be8b3912e None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:40.147724 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd760e56-684c-4d6a-80cd-ba9be8b3912e None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:40.149149 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 67/137] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:23:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 17:23:40.164025 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b8e4c-b8ab-4d68-9cfa-6032a9e8f6d5 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:40.164345 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b8e4c-b8ab-4d68-9cfa-6032a9e8f6d5 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:40.164587 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b8e4c-b8ab-4d68-9cfa-6032a9e8f6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:40.185596 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-488b8e4c-b8ab-4d68-9cfa-6032a9e8f6d5 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:23:40.186908 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-488b8e4c-b8ab-4d68-9cfa-6032a9e8f6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:23:40.244310 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:40.253085 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956423d-c6d7-4ddd-a60a-e043d6b32a71 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:40.254008 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:40.265012 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 68/138] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:23:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:23:40.312298 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b8e4c-b8ab-4d68-9cfa-6032a9e8f6d5 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:40.331344 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c364c7e-881e-4e1b-8474-dc987a6de461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:40.332176 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c364c7e-881e-4e1b-8474-dc987a6de461 None admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:40.332460 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c364c7e-881e-4e1b-8474-dc987a6de461 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:40.332740 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c364c7e-881e-4e1b-8474-dc987a6de461 None admin] PATH_INFO: `/v3/projects/2ee0e90b9ef242f59d727daa40b84620/users/2ac9dd996a9f4a0b9387f409d44f60f9/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:40.336738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c364c7e-881e-4e1b-8474-dc987a6de461 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ee0e90b9ef242f59d727daa40b84620, user_id=2ac9dd996a9f4a0b9387f409d44f60f9, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:40.338252 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c364c7e-881e-4e1b-8474-dc987a6de461 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:40.362941 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 71/139] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Jul 15 17:23:40 2022] PUT /identity/v3/projects/2ee0e90b9ef242f59d727daa40b84620/users/2ac9dd996a9f4a0b9387f409d44f60f9/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:23:40.488369 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b8e4c-b8ab-4d68-9cfa-6032a9e8f6d5 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:40.529367 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85769669-1401-4df3-b95a-f96e2510b482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:40.530303 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85769669-1401-4df3-b95a-f96e2510b482 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:40.530924 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85769669-1401-4df3-b95a-f96e2510b482 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:40.531462 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85769669-1401-4df3-b95a-f96e2510b482 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:40.532759 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85769669-1401-4df3-b95a-f96e2510b482 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:40.534234 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85769669-1401-4df3-b95a-f96e2510b482 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:40.536619 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 69/140] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:23:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:23:40.541893 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c364c7e-881e-4e1b-8474-dc987a6de461 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:40.651509 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c364c7e-881e-4e1b-8474-dc987a6de461 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:40.690382 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01177b-ae98-454d-ad87-8b24bc9b7284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:40.691068 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01177b-ae98-454d-ad87-8b24bc9b7284 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:40.691358 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01177b-ae98-454d-ad87-8b24bc9b7284 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:40.691635 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01177b-ae98-454d-ad87-8b24bc9b7284 None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:40.692373 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec01177b-ae98-454d-ad87-8b24bc9b7284 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:40.693852 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec01177b-ae98-454d-ad87-8b24bc9b7284 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:40.725141 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 72/141] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Jul 15 17:23:40 2022] POST /identity/v3/users => generated 283 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:23:41.079295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a600a56-aab5-4268-9b39-e28168a732ac None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:41.079829 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a600a56-aab5-4268-9b39-e28168a732ac None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:41.079829 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a600a56-aab5-4268-9b39-e28168a732ac None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:41.081736 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 70/142] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:23:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:23:41.087469 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bd438-8e41-4085-bf52-cd5a2807c018 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:41.087924 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bd438-8e41-4085-bf52-cd5a2807c018 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:41.088134 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bd438-8e41-4085-bf52-cd5a2807c018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:41.111590 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-5e9bd438-8e41-4085-bf52-cd5a2807c018 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:23:41.113171 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5e9bd438-8e41-4085-bf52-cd5a2807c018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:23:41.115832 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:41.201808 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 73/143] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:23:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:23:41.251939 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a600a56-aab5-4268-9b39-e28168a732ac None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:41.341295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:41.397035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a600a56-aab5-4268-9b39-e28168a732ac None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:41.432041 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c51744-176c-44aa-aa0d-0356461eb8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:41.432856 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c51744-176c-44aa-aa0d-0356461eb8f6 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:41.433136 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c51744-176c-44aa-aa0d-0356461eb8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:41.433412 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c51744-176c-44aa-aa0d-0356461eb8f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:41.444159 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c51744-176c-44aa-aa0d-0356461eb8f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:23:41.451976 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-51c51744-176c-44aa-aa0d-0356461eb8f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 17:23:41.451976 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:23:41.451976 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:23:41.451976 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:23:41.451976 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:23:41.451976 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:23:41.451976 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:23:41.451976 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:23:41.451976 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:23:41.451976 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:23:41.451976 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:23:41.451976 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:23:41.451976 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:23:41.451976 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:23:41.451976 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:23:41.451976 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:23:41.453093 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:23:41.453093 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:23:41.453093 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:23:41.453093 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:23:41.453093 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:23:41.453093 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:23:41.453093 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:23:41.453093 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:23:41.453093 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:23:41.453093 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:23:41.453093 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:23:41.453093 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:23:41.453093 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:23:41.453093 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:23:41.453093 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:23:41.453093 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:23:41.453917 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:23:41.453917 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:23:41.453917 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:23:41.453917 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:23:41.453917 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:23:41.453917 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:23:41.453917 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:23:41.453917 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:23:41.453917 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:23:41.453917 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:23:41.453917 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 17:23:41.453917 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:23:41.453917 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 71/144] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:23:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:23:41.459913 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9bd438-8e41-4085-bf52-cd5a2807c018 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:41.601857 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9bd438-8e41-4085-bf52-cd5a2807c018 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:41.642703 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0353a21-54ef-4d5b-a63e-1a691c7cd748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:41.643376 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0353a21-54ef-4d5b-a63e-1a691c7cd748 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:41.643657 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0353a21-54ef-4d5b-a63e-1a691c7cd748 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:41.643930 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0353a21-54ef-4d5b-a63e-1a691c7cd748 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:41.644694 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0353a21-54ef-4d5b-a63e-1a691c7cd748 None admin] RBAC: Adding query filter params (name=member) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:41.644996 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0353a21-54ef-4d5b-a63e-1a691c7cd748 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:41.646433 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0353a21-54ef-4d5b-a63e-1a691c7cd748 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:41.651721 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:41.658620 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 74/145] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jul 15 17:23:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:41.664549 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c51744-176c-44aa-aa0d-0356461eb8f6 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:41.791142 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c51744-176c-44aa-aa0d-0356461eb8f6 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:41.815716 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:41.834187 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7337f14-c1cb-49d8-9389-e22873e00146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:41.835076 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7337f14-c1cb-49d8-9389-e22873e00146 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:41.835356 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7337f14-c1cb-49d8-9389-e22873e00146 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:41.835628 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7337f14-c1cb-49d8-9389-e22873e00146 None admin] PATH_INFO: `/v3/users/2ac9dd996a9f4a0b9387f409d44f60f9` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:41.836823 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7337f14-c1cb-49d8-9389-e22873e00146 None admin] RBAC: Authorizing `identity:get_user(user_id=2ac9dd996a9f4a0b9387f409d44f60f9)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:41.838323 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7337f14-c1cb-49d8-9389-e22873e00146 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:41.839980 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 72/146] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:23:41 2022] GET /identity/v3/users/2ac9dd996a9f4a0b9387f409d44f60f9 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:41.845973 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0353a21-54ef-4d5b-a63e-1a691c7cd748 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:41.867763 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9dd8cc-4ada-44c2-b3de-fe1989abfcdd None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:41.868047 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9dd8cc-4ada-44c2-b3de-fe1989abfcdd None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:41.868236 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9dd8cc-4ada-44c2-b3de-fe1989abfcdd None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:41.869925 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 73/147] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:23:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:23:41.877013 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77025127-02a8-4856-b78d-a42e9be4f2e2 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:41.877363 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77025127-02a8-4856-b78d-a42e9be4f2e2 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:41.877567 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77025127-02a8-4856-b78d-a42e9be4f2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:41.895061 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-77025127-02a8-4856-b78d-a42e9be4f2e2 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:23:41.896254 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-77025127-02a8-4856-b78d-a42e9be4f2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:23:41.988284 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 74/148] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:23:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 17:23:42.023347 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77025127-02a8-4856-b78d-a42e9be4f2e2 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:42.024260 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0353a21-54ef-4d5b-a63e-1a691c7cd748 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:42.078119 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2b09b-8268-4f04-80de-59fd7e618cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:42.078793 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2b09b-8268-4f04-80de-59fd7e618cda None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:42.079107 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2b09b-8268-4f04-80de-59fd7e618cda None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:42.079394 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2b09b-8268-4f04-80de-59fd7e618cda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:42.166283 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd2b09b-8268-4f04-80de-59fd7e618cda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:42.167694 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd2b09b-8268-4f04-80de-59fd7e618cda None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:42.172270 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:42.206862 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77025127-02a8-4856-b78d-a42e9be4f2e2 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:42.238975 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:42.263498 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55e406-be97-488f-bb86-d6cc67d19586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:42.264324 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55e406-be97-488f-bb86-d6cc67d19586 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:42.270193 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55e406-be97-488f-bb86-d6cc67d19586 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:42.270480 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55e406-be97-488f-bb86-d6cc67d19586 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:42.281376 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a55e406-be97-488f-bb86-d6cc67d19586 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:23:42.289136 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-3a55e406-be97-488f-bb86-d6cc67d19586 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 17:23:42.289136 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:23:42.289136 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:23:42.289136 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:23:42.289136 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:23:42.289136 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:23:42.289136 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:23:42.289136 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:23:42.289136 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:23:42.289136 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:23:42.289136 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:23:42.289136 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:23:42.289136 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:23:42.289136 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:23:42.289136 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:23:42.289136 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:23:42.290028 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:23:42.290028 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:23:42.290028 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:23:42.290028 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:23:42.290028 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:23:42.290028 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:23:42.290028 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:23:42.290028 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:23:42.290028 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:23:42.290028 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:23:42.290028 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:23:42.290028 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:23:42.290028 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:23:42.290028 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:23:42.290028 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:23:42.290028 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:23:42.290792 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:23:42.290792 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:23:42.290792 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:23:42.290792 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:23:42.290792 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:23:42.290792 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:23:42.290792 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:23:42.290792 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:23:42.290792 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:23:42.290792 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:23:42.290792 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 17:23:42.290792 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:23:42.290792 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 75/149] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:23:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:23:42.302791 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55e406-be97-488f-bb86-d6cc67d19586 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:42.312710 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 75/150] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:23:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 17:23:42.318468 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2b09b-8268-4f04-80de-59fd7e618cda None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:42.433844 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55e406-be97-488f-bb86-d6cc67d19586 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:42.472080 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f40c8f-d3a4-42dc-8f33-741655521e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:42.472759 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f40c8f-d3a4-42dc-8f33-741655521e28 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:42.473043 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f40c8f-d3a4-42dc-8f33-741655521e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:42.473315 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f40c8f-d3a4-42dc-8f33-741655521e28 None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:42.478142 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f40c8f-d3a4-42dc-8f33-741655521e28 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:42.478456 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f40c8f-d3a4-42dc-8f33-741655521e28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:42.479861 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f40c8f-d3a4-42dc-8f33-741655521e28 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:42.488752 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 76/151] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jul 15 17:23:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:42.490038 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:42.494285 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2b09b-8268-4f04-80de-59fd7e618cda None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:42.494408 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f40c8f-d3a4-42dc-8f33-741655521e28 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:42.542703 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:42.549514 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5bc1a-400e-4340-b1b8-934bc4653240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:42.550705 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5bc1a-400e-4340-b1b8-934bc4653240 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:42.551203 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5bc1a-400e-4340-b1b8-934bc4653240 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:42.552717 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5bc1a-400e-4340-b1b8-934bc4653240 None admin] PATH_INFO: `/v3/projects/7660c9e611fc4315b714c975f6e5f41e` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:42.557895 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def5bc1a-400e-4340-b1b8-934bc4653240 None admin] RBAC: Authorizing `identity:get_project(project_id=7660c9e611fc4315b714c975f6e5f41e)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:42.559617 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def5bc1a-400e-4340-b1b8-934bc4653240 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:42.562246 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 76/152] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:23:42 2022] GET /identity/v3/projects/7660c9e611fc4315b714c975f6e5f41e => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:42.567797 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5bc1a-400e-4340-b1b8-934bc4653240 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:42.621548 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f40c8f-d3a4-42dc-8f33-741655521e28 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:42.665172 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640aa9c-8939-44c8-a798-3538ead2e521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:42.666355 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640aa9c-8939-44c8-a798-3538ead2e521 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:42.666791 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640aa9c-8939-44c8-a798-3538ead2e521 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:42.667204 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640aa9c-8939-44c8-a798-3538ead2e521 None admin] PATH_INFO: `/v3/users/58ba77a3b3154cbaaa2d756dff52192e` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:42.668544 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7640aa9c-8939-44c8-a798-3538ead2e521 None admin] RBAC: Authorizing `identity:get_user(user_id=58ba77a3b3154cbaaa2d756dff52192e)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:42.670144 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7640aa9c-8939-44c8-a798-3538ead2e521 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:42.672327 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 77/153] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:23:42 2022] GET /identity/v3/users/58ba77a3b3154cbaaa2d756dff52192e => generated 289 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:23:42.677805 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640aa9c-8939-44c8-a798-3538ead2e521 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:42.734462 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5bc1a-400e-4340-b1b8-934bc4653240 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:42.792410 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640aa9c-8939-44c8-a798-3538ead2e521 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:42.801626 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a561f94-67ad-462a-85cb-59966516f0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:42.802501 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:42.803387 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a561f94-67ad-462a-85cb-59966516f0ac None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:42.803677 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a561f94-67ad-462a-85cb-59966516f0ac None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:42.803956 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a561f94-67ad-462a-85cb-59966516f0ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:42.808654 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a561f94-67ad-462a-85cb-59966516f0ac None admin] RBAC: Adding query filter params (role.id=d8d52b8fc62e44cd9d551b855f2ac84b, scope.project.id=7660c9e611fc4315b714c975f6e5f41e, user.id=2ac9dd996a9f4a0b9387f409d44f60f9) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:42.808654 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a561f94-67ad-462a-85cb-59966516f0ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:42.808654 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a561f94-67ad-462a-85cb-59966516f0ac None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:42.822106 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 77/154] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jul 15 17:23:42 2022] GET /identity/v3/role_assignments?user.id=2ac9dd996a9f4a0b9387f409d44f60f9&scope.project.id=7660c9e611fc4315b714c975f6e5f41e&role.id=d8d52b8fc62e44cd9d551b855f2ac84b => generated 608 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:23:42.843271 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3b448-2735-4f6f-8040-a03a76eca1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:42.844151 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3b448-2735-4f6f-8040-a03a76eca1ab None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:42.844434 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3b448-2735-4f6f-8040-a03a76eca1ab None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:42.844709 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3b448-2735-4f6f-8040-a03a76eca1ab None admin] PATH_INFO: `/v3/projects/7660c9e611fc4315b714c975f6e5f41e` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:42.850766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc3b448-2735-4f6f-8040-a03a76eca1ab None admin] RBAC: Authorizing `identity:get_project(project_id=7660c9e611fc4315b714c975f6e5f41e)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:42.852265 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc3b448-2735-4f6f-8040-a03a76eca1ab None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:42.854589 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 78/155] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:23:42 2022] GET /identity/v3/projects/7660c9e611fc4315b714c975f6e5f41e => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:42.860730 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a561f94-67ad-462a-85cb-59966516f0ac None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:42.900604 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:42.988420 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a561f94-67ad-462a-85cb-59966516f0ac None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:43.026926 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3e878-3c69-4fa2-85db-08bd27dd4fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:43.027846 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3e878-3c69-4fa2-85db-08bd27dd4fc0 None admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:43.028131 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3e878-3c69-4fa2-85db-08bd27dd4fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:43.028409 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3e878-3c69-4fa2-85db-08bd27dd4fc0 None admin] PATH_INFO: `/v3/projects/7660c9e611fc4315b714c975f6e5f41e/users/58ba77a3b3154cbaaa2d756dff52192e/roles/a3a3c02087374a9086cf0d79e6118247` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:43.030520 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb3e878-3c69-4fa2-85db-08bd27dd4fc0 None admin] RBAC: Authorizing `identity:create_grant(project_id=7660c9e611fc4315b714c975f6e5f41e, user_id=58ba77a3b3154cbaaa2d756dff52192e, role_id=a3a3c02087374a9086cf0d79e6118247)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:43.032076 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb3e878-3c69-4fa2-85db-08bd27dd4fc0 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:43.052033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 78/156] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Jul 15 17:23:42 2022] PUT /identity/v3/projects/7660c9e611fc4315b714c975f6e5f41e/users/58ba77a3b3154cbaaa2d756dff52192e/roles/a3a3c02087374a9086cf0d79e6118247 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:23:43.397186 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34605fec-fe03-40ac-ad79-c53531726265 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:43.397710 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34605fec-fe03-40ac-ad79-c53531726265 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:43.397710 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34605fec-fe03-40ac-ad79-c53531726265 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:43.399145 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 79/157] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:23:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:23:43.405301 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d9128-e2cd-49a1-afe9-1176f1db0f5e None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:43.405998 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d9128-e2cd-49a1-afe9-1176f1db0f5e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:43.405998 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d9128-e2cd-49a1-afe9-1176f1db0f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:43.424246 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-7b6d9128-e2cd-49a1-afe9-1176f1db0f5e None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:23:43.425462 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7b6d9128-e2cd-49a1-afe9-1176f1db0f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:23:43.509399 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 79/158] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:23:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 17:23:43.548232 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34605fec-fe03-40ac-ad79-c53531726265 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:43.675508 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34605fec-fe03-40ac-ad79-c53531726265 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:43.715944 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d3028-f795-4812-b55e-a66f6597c339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:43.717123 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d3028-f795-4812-b55e-a66f6597c339 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:43.717608 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d3028-f795-4812-b55e-a66f6597c339 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:43.718152 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d3028-f795-4812-b55e-a66f6597c339 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:43.729134 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d3028-f795-4812-b55e-a66f6597c339 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:23:43.739226 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-500d3028-f795-4812-b55e-a66f6597c339 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:23:43.739226 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:23:43.739226 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:23:43.739226 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:23:43.739226 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:23:43.739226 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:23:43.739226 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:23:43.739226 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:23:43.739226 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:23:43.739226 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:23:43.739226 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:23:43.739226 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:23:43.739226 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:23:43.739226 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:23:43.739226 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:23:43.739226 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:23:43.740204 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:23:43.740204 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:23:43.740204 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:23:43.740204 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:23:43.740204 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:23:43.740204 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:23:43.740204 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:23:43.740204 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:23:43.740204 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:23:43.740204 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:23:43.740204 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:23:43.740204 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:23:43.740204 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:23:43.740204 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:23:43.740204 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:23:43.740204 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:23:43.740988 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:23:43.740988 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:23:43.740988 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:23:43.740988 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:23:43.740988 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:23:43.740988 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:23:43.740988 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:23:43.740988 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:23:43.740988 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:23:43.740988 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:23:43.740988 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:23:43.740988 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:23:43.743460 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 80/159] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jul 15 17:23:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:23:43.749877 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d9128-e2cd-49a1-afe9-1176f1db0f5e None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:43.791628 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:43.880142 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d9128-e2cd-49a1-afe9-1176f1db0f5e None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:43.921252 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066691dc-37c8-4411-ad01-903b7b62f23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:43.921968 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066691dc-37c8-4411-ad01-903b7b62f23a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:43.922247 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066691dc-37c8-4411-ad01-903b7b62f23a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:43.922524 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066691dc-37c8-4411-ad01-903b7b62f23a None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:43.923290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066691dc-37c8-4411-ad01-903b7b62f23a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:43.923596 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066691dc-37c8-4411-ad01-903b7b62f23a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:43.924993 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066691dc-37c8-4411-ad01-903b7b62f23a None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:43.934565 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 80/160] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:23:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:43.940395 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d3028-f795-4812-b55e-a66f6597c339 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:43.959245 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8f9db-a370-4510-a4a7-5c4ed18eee21 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:43.959544 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8f9db-a370-4510-a4a7-5c4ed18eee21 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:43.959756 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8f9db-a370-4510-a4a7-5c4ed18eee21 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:43.961144 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 81/161] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:23:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 17:23:43.966260 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ed521-95b6-44ca-a4e0-c81746df1def None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:43.966448 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ed521-95b6-44ca-a4e0-c81746df1def None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:43.966730 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ed521-95b6-44ca-a4e0-c81746df1def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:43.985420 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-a69ed521-95b6-44ca-a4e0-c81746df1def None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:23:43.989802 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a69ed521-95b6-44ca-a4e0-c81746df1def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:23:43.993471 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:44.080924 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d3028-f795-4812-b55e-a66f6597c339 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:44.092345 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 82/162] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:23:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 17:23:44.093725 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd826d5-320a-453e-87c6-df7b973570f9 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:44.094037 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd826d5-320a-453e-87c6-df7b973570f9 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:44.094313 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd826d5-320a-453e-87c6-df7b973570f9 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:44.095604 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 83/163] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:23:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:23:44.100980 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25df35-d780-41ea-8a98-8629382c9f08 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:44.101282 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25df35-d780-41ea-8a98-8629382c9f08 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:44.101554 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25df35-d780-41ea-8a98-8629382c9f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:44.118511 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-5a25df35-d780-41ea-8a98-8629382c9f08 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:23:44.122072 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5a25df35-d780-41ea-8a98-8629382c9f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:23:44.127058 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e53344-664a-4aec-ae98-c372ac1131b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:44.128349 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e53344-664a-4aec-ae98-c372ac1131b6 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:44.128819 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e53344-664a-4aec-ae98-c372ac1131b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:44.129335 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e53344-664a-4aec-ae98-c372ac1131b6 None admin] PATH_INFO: `/v3/users/23aa6e5135404cb6a45a96628c2e41d6` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:44.130046 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:44.131932 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e53344-664a-4aec-ae98-c372ac1131b6 None admin] RBAC: Authorizing `identity:get_user(user_id=23aa6e5135404cb6a45a96628c2e41d6)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:44.133688 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e53344-664a-4aec-ae98-c372ac1131b6 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:44.136265 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 81/164] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:23:43 2022] GET /identity/v3/users/23aa6e5135404cb6a45a96628c2e41d6 => generated 247 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:44.142897 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e53344-664a-4aec-ae98-c372ac1131b6 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:44.204554 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 84/165] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:23:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 17:23:44.205163 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25df35-d780-41ea-8a98-8629382c9f08 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:44.251566 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e53344-664a-4aec-ae98-c372ac1131b6 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:44.254346 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:44.290013 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea1d6c-fbd1-4131-a7ff-a81c71b56549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:44.291111 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea1d6c-fbd1-4131-a7ff-a81c71b56549 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:44.291586 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea1d6c-fbd1-4131-a7ff-a81c71b56549 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:44.292054 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea1d6c-fbd1-4131-a7ff-a81c71b56549 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:44.319710 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25df35-d780-41ea-8a98-8629382c9f08 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:44.355513 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d9764f-1d9a-443a-99e3-edab5f5b2e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:44.356558 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9764f-1d9a-443a-99e3-edab5f5b2e78 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:44.356836 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9764f-1d9a-443a-99e3-edab5f5b2e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:44.357117 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9764f-1d9a-443a-99e3-edab5f5b2e78 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:44.367051 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ea1d6c-fbd1-4131-a7ff-a81c71b56549 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:44.367938 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d9764f-1d9a-443a-99e3-edab5f5b2e78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:23:44.369003 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ea1d6c-fbd1-4131-a7ff-a81c71b56549 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:44.376403 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-e6d9764f-1d9a-443a-99e3-edab5f5b2e78 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 17:23:44.376403 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:23:44.376403 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:23:44.376403 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:23:44.376403 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:23:44.376403 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:23:44.376403 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:23:44.376403 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:23:44.376403 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:23:44.376403 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:23:44.376403 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:23:44.376403 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:23:44.376403 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:23:44.376403 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:23:44.376403 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:23:44.376403 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:23:44.377290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:23:44.377290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:23:44.377290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:23:44.377290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:23:44.377290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:23:44.377290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:23:44.377290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:23:44.377290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:23:44.377290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:23:44.377290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:23:44.377290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:23:44.377290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:23:44.377290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:23:44.377290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:23:44.377290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:23:44.377290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:23:44.378349 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:23:44.378349 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:23:44.378349 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:23:44.378349 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:23:44.378349 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:23:44.378349 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:23:44.378349 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:23:44.378349 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:23:44.378349 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:23:44.378349 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:23:44.378349 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 17:23:44.378349 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:23:44.378349 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 85/166] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Jul 15 17:23:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:23:44.379004 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d9764f-1d9a-443a-99e3-edab5f5b2e78 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:44.388331 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:44.486465 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 82/167] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:23:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 17:23:44.487913 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea1d6c-fbd1-4131-a7ff-a81c71b56549 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:44.495815 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:44.524756 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d9764f-1d9a-443a-99e3-edab5f5b2e78 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:44.604775 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea1d6c-fbd1-4131-a7ff-a81c71b56549 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:44.610570 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96fe312-3171-43da-8938-e6df9dc2d30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:44.611405 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fe312-3171-43da-8938-e6df9dc2d30e None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:44.611686 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fe312-3171-43da-8938-e6df9dc2d30e None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:44.611963 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fe312-3171-43da-8938-e6df9dc2d30e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:44.638838 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96fe312-3171-43da-8938-e6df9dc2d30e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:23:44.646989 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-f96fe312-3171-43da-8938-e6df9dc2d30e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 17:23:44.646989 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:23:44.646989 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:23:44.646989 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:23:44.646989 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:23:44.646989 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:23:44.646989 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:23:44.646989 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:23:44.646989 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:23:44.646989 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:23:44.646989 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:23:44.646989 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:23:44.646989 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:23:44.646989 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:23:44.646989 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:23:44.646989 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:23:44.648073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:23:44.648073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:23:44.648073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:23:44.648073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:23:44.648073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:23:44.648073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:23:44.648073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:23:44.648073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:23:44.648073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:23:44.648073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:23:44.648073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:23:44.648073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:23:44.648073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:23:44.648073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:23:44.648073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:23:44.648073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:23:44.648978 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:23:44.648978 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:23:44.648978 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:23:44.648978 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:23:44.648978 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:23:44.648978 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:23:44.648978 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:23:44.648978 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:23:44.648978 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:23:44.648978 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:23:44.648978 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 17:23:44.648978 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:23:44.648978 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 86/168] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:23:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:23:44.651994 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf3ebd0-94da-4f6f-a8f8-89243f8d0abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:44.652832 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3ebd0-94da-4f6f-a8f8-89243f8d0abc None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:44.653258 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3ebd0-94da-4f6f-a8f8-89243f8d0abc None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:44.653662 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3ebd0-94da-4f6f-a8f8-89243f8d0abc None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:44.653795 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96fe312-3171-43da-8938-e6df9dc2d30e None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:44.654776 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf3ebd0-94da-4f6f-a8f8-89243f8d0abc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:44.655215 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf3ebd0-94da-4f6f-a8f8-89243f8d0abc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:44.656797 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf3ebd0-94da-4f6f-a8f8-89243f8d0abc None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:44.674645 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 83/169] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:23:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:44.675707 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf3ebd0-94da-4f6f-a8f8-89243f8d0abc None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:44.748037 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:44.763717 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:44.788411 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf3ebd0-94da-4f6f-a8f8-89243f8d0abc None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:44.824840 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89a50b-255d-4799-a61f-e4313ff9eba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:44.826389 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89a50b-255d-4799-a61f-e4313ff9eba4 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:44.826982 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89a50b-255d-4799-a61f-e4313ff9eba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:44.828608 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89a50b-255d-4799-a61f-e4313ff9eba4 None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:44.829504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee89a50b-255d-4799-a61f-e4313ff9eba4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:44.830134 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee89a50b-255d-4799-a61f-e4313ff9eba4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:44.832630 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee89a50b-255d-4799-a61f-e4313ff9eba4 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:44.843541 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96fe312-3171-43da-8938-e6df9dc2d30e None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:44.848967 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 84/170] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jul 15 17:23:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:44.854402 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89a50b-255d-4799-a61f-e4313ff9eba4 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:44.909475 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9cf25-1a19-4b12-9ad3-1b35c85b0430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:44.911770 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9cf25-1a19-4b12-9ad3-1b35c85b0430 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:44.913053 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9cf25-1a19-4b12-9ad3-1b35c85b0430 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:44.913468 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9cf25-1a19-4b12-9ad3-1b35c85b0430 None admin] PATH_INFO: `/v3/projects/7660c9e611fc4315b714c975f6e5f41e` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:44.917806 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d9cf25-1a19-4b12-9ad3-1b35c85b0430 None admin] RBAC: Authorizing `identity:get_project(project_id=7660c9e611fc4315b714c975f6e5f41e)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:44.919417 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d9cf25-1a19-4b12-9ad3-1b35c85b0430 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:44.922240 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 87/171] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:23:44 2022] GET /identity/v3/projects/7660c9e611fc4315b714c975f6e5f41e => generated 298 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:44.930709 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9cf25-1a19-4b12-9ad3-1b35c85b0430 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:45.006199 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89a50b-255d-4799-a61f-e4313ff9eba4 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:45.034282 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:45.051161 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2b601-ea1b-4458-863b-2487e4d767ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:45.052695 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2b601-ea1b-4458-863b-2487e4d767ff None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:45.053431 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2b601-ea1b-4458-863b-2487e4d767ff None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:45.054005 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2b601-ea1b-4458-863b-2487e4d767ff None admin] PATH_INFO: `/v3/users/2ac9dd996a9f4a0b9387f409d44f60f9` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:45.055419 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade2b601-ea1b-4458-863b-2487e4d767ff None admin] RBAC: Authorizing `identity:get_user(user_id=2ac9dd996a9f4a0b9387f409d44f60f9)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:45.061247 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade2b601-ea1b-4458-863b-2487e4d767ff None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:45.063812 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 85/172] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:23:44 2022] GET /identity/v3/users/2ac9dd996a9f4a0b9387f409d44f60f9 => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:45.064797 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2b601-ea1b-4458-863b-2487e4d767ff None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:45.072690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9cf25-1a19-4b12-9ad3-1b35c85b0430 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:45.119598 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:45.135829 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e8d09-c275-4bc5-8977-dee6f9ece8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:45.141805 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e8d09-c275-4bc5-8977-dee6f9ece8af None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:45.141805 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e8d09-c275-4bc5-8977-dee6f9ece8af None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:45.141805 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e8d09-c275-4bc5-8977-dee6f9ece8af None admin] PATH_INFO: `/v3/users/2ac9dd996a9f4a0b9387f409d44f60f9` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:45.141805 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7e8d09-c275-4bc5-8977-dee6f9ece8af None admin] RBAC: Authorizing `identity:get_user(user_id=2ac9dd996a9f4a0b9387f409d44f60f9)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:45.142446 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7e8d09-c275-4bc5-8977-dee6f9ece8af None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:45.144446 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 88/173] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:23:44 2022] GET /identity/v3/users/2ac9dd996a9f4a0b9387f409d44f60f9 => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:45.145295 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e8d09-c275-4bc5-8977-dee6f9ece8af None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:45.258706 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2b601-ea1b-4458-863b-2487e4d767ff None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:45.307250 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e8d09-c275-4bc5-8977-dee6f9ece8af None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:45.336568 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a9edb-4a7a-4c3a-ade2-91d76637037d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:45.337619 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a9edb-4a7a-4c3a-ade2-91d76637037d None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:45.338115 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a9edb-4a7a-4c3a-ade2-91d76637037d None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:45.338575 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a9edb-4a7a-4c3a-ade2-91d76637037d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:45.339600 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a9edb-4a7a-4c3a-ade2-91d76637037d None admin] RBAC: Adding query filter params (role.id=70d242b29ede4648b639c7ddae5eaead, scope.project.id=7660c9e611fc4315b714c975f6e5f41e, user.id=23aa6e5135404cb6a45a96628c2e41d6) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:45.340132 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a9edb-4a7a-4c3a-ade2-91d76637037d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:45.341805 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a9edb-4a7a-4c3a-ade2-91d76637037d None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:45.354584 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 86/174] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jul 15 17:23:45 2022] GET /identity/v3/role_assignments?user.id=23aa6e5135404cb6a45a96628c2e41d6&scope.project.id=7660c9e611fc4315b714c975f6e5f41e&role.id=70d242b29ede4648b639c7ddae5eaead => generated 608 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:45.355674 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a9edb-4a7a-4c3a-ade2-91d76637037d None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:45.377521 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203897eb-f7b5-417c-aa9c-2aee6a00a79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:45.378219 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203897eb-f7b5-417c-aa9c-2aee6a00a79d None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:45.378502 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203897eb-f7b5-417c-aa9c-2aee6a00a79d None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:45.382178 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203897eb-f7b5-417c-aa9c-2aee6a00a79d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:45.500277 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:45.521502 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:45.524695 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203897eb-f7b5-417c-aa9c-2aee6a00a79d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:45.526238 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203897eb-f7b5-417c-aa9c-2aee6a00a79d None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:45.606713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a9edb-4a7a-4c3a-ade2-91d76637037d None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:45.694048 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 89/175] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:23:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 17:23:45.696790 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203897eb-f7b5-417c-aa9c-2aee6a00a79d None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:45.705223 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc94300-510b-4299-847a-8669d47812e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:45.706245 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc94300-510b-4299-847a-8669d47812e8 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:45.706524 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc94300-510b-4299-847a-8669d47812e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:45.706798 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc94300-510b-4299-847a-8669d47812e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:45.828091 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc94300-510b-4299-847a-8669d47812e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:45.829547 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc94300-510b-4299-847a-8669d47812e8 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:45.837760 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:45.840689 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203897eb-f7b5-417c-aa9c-2aee6a00a79d None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:45.879026 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d4b19a-fd1b-4d22-add0-a46fe7dfbf11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:45.880164 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4b19a-fd1b-4d22-add0-a46fe7dfbf11 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:45.880683 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4b19a-fd1b-4d22-add0-a46fe7dfbf11 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:45.881123 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4b19a-fd1b-4d22-add0-a46fe7dfbf11 None admin] PATH_INFO: `/v3/projects/7660c9e611fc4315b714c975f6e5f41e` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:45.882597 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d4b19a-fd1b-4d22-add0-a46fe7dfbf11 None admin] RBAC: Authorizing `identity:get_project(project_id=7660c9e611fc4315b714c975f6e5f41e)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:45.884313 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d4b19a-fd1b-4d22-add0-a46fe7dfbf11 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:45.886217 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 90/176] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:23:45 2022] GET /identity/v3/projects/7660c9e611fc4315b714c975f6e5f41e => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:23:45.887851 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b024408-09ef-4bf4-a5e6-cab8703b267c None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:45.888284 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b024408-09ef-4bf4-a5e6-cab8703b267c None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:45.888876 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b024408-09ef-4bf4-a5e6-cab8703b267c None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:45.890476 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 91/177] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:23:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:23:45.891894 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107b63b-60b8-486b-8818-0c8e1e52c946 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:45.892319 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107b63b-60b8-486b-8818-0c8e1e52c946 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:45.892735 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107b63b-60b8-486b-8818-0c8e1e52c946 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:45.894365 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 92/178] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:23:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:23:45.895313 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107b63b-60b8-486b-8818-0c8e1e52c946 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:45.901995 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:45.946741 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 87/179] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:23:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 17:23:45.952345 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f011f-2e58-4891-8a6d-b0830986b98c None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:45.952640 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f011f-2e58-4891-8a6d-b0830986b98c None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:45.952995 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f011f-2e58-4891-8a6d-b0830986b98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:45.971481 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-1f8f011f-2e58-4891-8a6d-b0830986b98c None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:23:45.972907 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-1f8f011f-2e58-4891-8a6d-b0830986b98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:23:46.015544 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107b63b-60b8-486b-8818-0c8e1e52c946 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:46.051504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 88/180] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:23:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:23:46.053164 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2956df-e9ca-4dc9-b799-3e03f53047f1 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:46.053590 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2956df-e9ca-4dc9-b799-3e03f53047f1 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:46.054033 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2956df-e9ca-4dc9-b799-3e03f53047f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:46.067346 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716661ea-2a34-4983-ab10-64d82037b6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:46.068512 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716661ea-2a34-4983-ab10-64d82037b6a1 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:46.068972 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716661ea-2a34-4983-ab10-64d82037b6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:46.069391 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716661ea-2a34-4983-ab10-64d82037b6a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:46.070413 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716661ea-2a34-4983-ab10-64d82037b6a1 None admin] RBAC: Adding query filter params (role.id=c9b1f4b47f054f7a8a9a079e65a7197a, scope.project.id=7660c9e611fc4315b714c975f6e5f41e, user.id=2ac9dd996a9f4a0b9387f409d44f60f9) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:46.070866 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716661ea-2a34-4983-ab10-64d82037b6a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:46.071731 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-da2956df-e9ca-4dc9-b799-3e03f53047f1 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:23:46.072637 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716661ea-2a34-4983-ab10-64d82037b6a1 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:46.073001 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-da2956df-e9ca-4dc9-b799-3e03f53047f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:23:46.081190 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 93/181] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jul 15 17:23:45 2022] GET /identity/v3/role_assignments?user.id=2ac9dd996a9f4a0b9387f409d44f60f9&scope.project.id=7660c9e611fc4315b714c975f6e5f41e&role.id=c9b1f4b47f054f7a8a9a079e65a7197a => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:46.083271 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9e59e-54b4-4ce1-9087-ccd3c256be19 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:46.083725 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9e59e-54b4-4ce1-9087-ccd3c256be19 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:46.084599 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9e59e-54b4-4ce1-9087-ccd3c256be19 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:46.086833 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 94/182] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:23:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:23:46.087838 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba9e59e-54b4-4ce1-9087-ccd3c256be19 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:46.136786 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:46.162074 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 89/183] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:23:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:23:46.163345 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2956df-e9ca-4dc9-b799-3e03f53047f1 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:46.192872 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:46.241514 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba9e59e-54b4-4ce1-9087-ccd3c256be19 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:46.284234 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb2e37f-fc90-4699-a75d-d77415aea42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:46.285117 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2e37f-fc90-4699-a75d-d77415aea42a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:46.285404 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2e37f-fc90-4699-a75d-d77415aea42a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:46.285674 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2e37f-fc90-4699-a75d-d77415aea42a None admin] PATH_INFO: `/v3/projects/2ee0e90b9ef242f59d727daa40b84620` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:46.286910 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb2e37f-fc90-4699-a75d-d77415aea42a None admin] RBAC: Authorizing `identity:get_project(project_id=2ee0e90b9ef242f59d727daa40b84620)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:46.288355 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb2e37f-fc90-4699-a75d-d77415aea42a None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:46.290991 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 95/184] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:23:46 2022] GET /identity/v3/projects/2ee0e90b9ef242f59d727daa40b84620 => generated 312 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:46.292138 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe807a2-5b20-409e-ada0-f79373dfcb39 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:46.292474 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe807a2-5b20-409e-ada0-f79373dfcb39 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:46.292750 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe807a2-5b20-409e-ada0-f79373dfcb39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:46.296308 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2956df-e9ca-4dc9-b799-3e03f53047f1 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:46.314074 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-cfe807a2-5b20-409e-ada0-f79373dfcb39 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:23:46.315278 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-cfe807a2-5b20-409e-ada0-f79373dfcb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:23:46.341426 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8698e641-c90c-4685-824b-67c41aa4fed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:46.342910 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698e641-c90c-4685-824b-67c41aa4fed8 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:46.343875 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698e641-c90c-4685-824b-67c41aa4fed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:46.344150 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698e641-c90c-4685-824b-67c41aa4fed8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:46.354459 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8698e641-c90c-4685-824b-67c41aa4fed8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:23:46.362862 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-8698e641-c90c-4685-824b-67c41aa4fed8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 17:23:46.362862 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:23:46.362862 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:23:46.362862 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:23:46.362862 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:23:46.362862 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:23:46.362862 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:23:46.362862 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:23:46.362862 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:23:46.362862 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:23:46.362862 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:23:46.362862 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:23:46.362862 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:23:46.362862 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:23:46.362862 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:23:46.362862 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:23:46.363733 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:23:46.363733 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:23:46.363733 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:23:46.363733 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:23:46.363733 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:23:46.363733 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:23:46.363733 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:23:46.363733 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:23:46.363733 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:23:46.363733 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:23:46.363733 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:23:46.363733 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:23:46.363733 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:23:46.363733 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:23:46.363733 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:23:46.363733 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:23:46.364504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:23:46.364504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:23:46.364504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:23:46.364504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:23:46.364504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:23:46.364504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:23:46.364504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:23:46.364504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:23:46.364504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:23:46.364504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:23:46.364504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 17:23:46.364504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:23:46.364504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 90/185] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Jul 15 17:23:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:23:46.365349 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8698e641-c90c-4685-824b-67c41aa4fed8 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:46.391348 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 96/186] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:23:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:23:46.395208 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b585c4b-849c-4de7-90be-326f0abb7458 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:46.395537 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b585c4b-849c-4de7-90be-326f0abb7458 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:46.395818 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b585c4b-849c-4de7-90be-326f0abb7458 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:46.400962 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 97/187] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:23:46.400962 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b585c4b-849c-4de7-90be-326f0abb7458 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:46.428030 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:46.450480 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:46.470142 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8698e641-c90c-4685-824b-67c41aa4fed8 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:46.501740 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b585c4b-849c-4de7-90be-326f0abb7458 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:46.503389 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439717f5-57de-4a08-9535-83be900802cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:46.504188 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439717f5-57de-4a08-9535-83be900802cb None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:46.504464 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439717f5-57de-4a08-9535-83be900802cb None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:46.504728 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439717f5-57de-4a08-9535-83be900802cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:46.505932 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439717f5-57de-4a08-9535-83be900802cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:46.507382 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439717f5-57de-4a08-9535-83be900802cb None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:46.509005 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 91/188] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:23:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:46.510041 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439717f5-57de-4a08-9535-83be900802cb None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:46.537982 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8dcf9c-9c6a-4e17-81dc-141d57a054a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:46.538640 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8dcf9c-9c6a-4e17-81dc-141d57a054a9 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:46.538941 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8dcf9c-9c6a-4e17-81dc-141d57a054a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:46.539233 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8dcf9c-9c6a-4e17-81dc-141d57a054a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:46.540075 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8dcf9c-9c6a-4e17-81dc-141d57a054a9 None admin] RBAC: Adding query filter params (role.id=d8d52b8fc62e44cd9d551b855f2ac84b, scope.project.id=2ee0e90b9ef242f59d727daa40b84620, user.id=2ac9dd996a9f4a0b9387f409d44f60f9) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:46.540375 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8dcf9c-9c6a-4e17-81dc-141d57a054a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:46.541859 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8dcf9c-9c6a-4e17-81dc-141d57a054a9 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:46.548136 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 98/189] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jul 15 17:23:46 2022] GET /identity/v3/role_assignments?user.id=2ac9dd996a9f4a0b9387f409d44f60f9&scope.project.id=2ee0e90b9ef242f59d727daa40b84620&role.id=d8d52b8fc62e44cd9d551b855f2ac84b => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:46.549418 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619361f-a783-45a5-9161-2585c1f01a4a None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:46.549590 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619361f-a783-45a5-9161-2585c1f01a4a None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:46.549879 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619361f-a783-45a5-9161-2585c1f01a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:46.569568 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-3619361f-a783-45a5-9161-2585c1f01a4a None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:23:46.570860 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-3619361f-a783-45a5-9161-2585c1f01a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:23:46.625605 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439717f5-57de-4a08-9535-83be900802cb None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:46.649659 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 99/190] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:23:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:23:46.655051 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619361f-a783-45a5-9161-2585c1f01a4a None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:46.665011 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b755b-4ab8-4c8a-b278-08f57c132099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:46.665689 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b755b-4ab8-4c8a-b278-08f57c132099 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:46.666036 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b755b-4ab8-4c8a-b278-08f57c132099 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:46.666314 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b755b-4ab8-4c8a-b278-08f57c132099 None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:46.667196 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b755b-4ab8-4c8a-b278-08f57c132099 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:46.667556 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b755b-4ab8-4c8a-b278-08f57c132099 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:46.669053 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b755b-4ab8-4c8a-b278-08f57c132099 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:46.678604 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 92/191] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:23:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:46.679239 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b755b-4ab8-4c8a-b278-08f57c132099 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:46.692680 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:46.693251 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:46.782431 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619361f-a783-45a5-9161-2585c1f01a4a None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:46.795699 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b755b-4ab8-4c8a-b278-08f57c132099 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:46.815030 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e482f-6665-4896-8310-9a77ec273e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:46.815826 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e482f-6665-4896-8310-9a77ec273e84 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:46.816098 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e482f-6665-4896-8310-9a77ec273e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:46.816364 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e482f-6665-4896-8310-9a77ec273e84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:46.826621 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e482f-6665-4896-8310-9a77ec273e84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:23:46.829247 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e513a-63fc-4e38-9f67-792e27a17329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:46.829937 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e513a-63fc-4e38-9f67-792e27a17329 None admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:46.830215 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e513a-63fc-4e38-9f67-792e27a17329 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:46.830483 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e513a-63fc-4e38-9f67-792e27a17329 None admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:46.831515 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e513a-63fc-4e38-9f67-792e27a17329 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:46.832944 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e513a-63fc-4e38-9f67-792e27a17329 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:46.834779 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-849e482f-6665-4896-8310-9a77ec273e84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:23:46.834779 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:23:46.834779 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:23:46.834779 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:23:46.834779 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:23:46.834779 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:23:46.834779 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:23:46.834779 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:23:46.834779 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:23:46.834779 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:23:46.834779 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:23:46.834779 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:23:46.834779 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:23:46.834779 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:23:46.834779 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:23:46.834779 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:23:46.835619 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:23:46.835619 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:23:46.835619 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:23:46.835619 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:23:46.835619 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:23:46.835619 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:23:46.835619 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:23:46.835619 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:23:46.835619 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:23:46.835619 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:23:46.835619 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:23:46.835619 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:23:46.835619 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:23:46.835619 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:23:46.835619 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:23:46.835619 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:23:46.836715 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:23:46.836715 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:23:46.836715 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:23:46.836715 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:23:46.836715 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:23:46.836715 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:23:46.836715 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:23:46.836715 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:23:46.836715 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:23:46.836715 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:23:46.836715 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:23:46.836715 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:23:46.836715 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 100/192] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jul 15 17:23:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:23:46.837545 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e482f-6665-4896-8310-9a77ec273e84 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:46.852508 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 93/193] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Jul 15 17:23:46 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:23:46.853335 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e513a-63fc-4e38-9f67-792e27a17329 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:46.929587 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:46.941363 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:46.959626 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e482f-6665-4896-8310-9a77ec273e84 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:46.970117 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e513a-63fc-4e38-9f67-792e27a17329 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:47.000041 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e044d-1d8d-4ea3-931c-b552cb36ee44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:47.001062 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e044d-1d8d-4ea3-931c-b552cb36ee44 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:47.001341 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e044d-1d8d-4ea3-931c-b552cb36ee44 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:47.001611 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e044d-1d8d-4ea3-931c-b552cb36ee44 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:47.010079 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56182eb-7a70-42bd-9ee7-4c6e32a6ca1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:47.010979 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56182eb-7a70-42bd-9ee7-4c6e32a6ca1d None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:47.011260 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56182eb-7a70-42bd-9ee7-4c6e32a6ca1d None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:47.011533 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56182eb-7a70-42bd-9ee7-4c6e32a6ca1d None admin] PATH_INFO: `/v3/users/1105ddc2f5114ec1be71ec51372bfab7` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:47.013528 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e044d-1d8d-4ea3-931c-b552cb36ee44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:23:47.021565 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-ba7e044d-1d8d-4ea3-931c-b552cb36ee44 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 17:23:47.021565 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:23:47.021565 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:23:47.021565 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:23:47.021565 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:23:47.021565 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:23:47.021565 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:23:47.021565 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:23:47.021565 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:23:47.021565 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:23:47.021565 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:23:47.021565 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:23:47.021565 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:23:47.021565 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:23:47.021565 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:23:47.021565 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:23:47.022503 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:23:47.022503 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:23:47.022503 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:23:47.022503 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:23:47.022503 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:23:47.022503 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:23:47.022503 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:23:47.022503 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:23:47.022503 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:23:47.022503 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:23:47.022503 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:23:47.022503 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:23:47.022503 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:23:47.022503 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:23:47.022503 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:23:47.022503 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:23:47.023290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:23:47.023290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:23:47.023290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:23:47.023290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:23:47.023290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:23:47.023290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:23:47.023290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:23:47.023290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:23:47.023290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:23:47.023290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:23:47.023290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 17:23:47.023290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:23:47.023290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 101/194] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:23:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:23:47.023931 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e044d-1d8d-4ea3-931c-b552cb36ee44 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:47.031141 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56182eb-7a70-42bd-9ee7-4c6e32a6ca1d None admin] RBAC: Authorizing `identity:get_user(user_id=1105ddc2f5114ec1be71ec51372bfab7)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:47.032529 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56182eb-7a70-42bd-9ee7-4c6e32a6ca1d None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:47.034318 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 94/195] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:23:46 2022] GET /identity/v3/users/1105ddc2f5114ec1be71ec51372bfab7 => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:47.035149 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56182eb-7a70-42bd-9ee7-4c6e32a6ca1d None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:47.158420 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e044d-1d8d-4ea3-931c-b552cb36ee44 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:47.164395 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56182eb-7a70-42bd-9ee7-4c6e32a6ca1d None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:47.191655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:47.199134 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792296d9-adce-41fb-8b93-f69839fd3aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:47.199904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792296d9-adce-41fb-8b93-f69839fd3aff None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:47.200281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792296d9-adce-41fb-8b93-f69839fd3aff None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:47.200579 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792296d9-adce-41fb-8b93-f69839fd3aff None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:47.201403 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792296d9-adce-41fb-8b93-f69839fd3aff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:47.201962 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792296d9-adce-41fb-8b93-f69839fd3aff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:47.203362 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792296d9-adce-41fb-8b93-f69839fd3aff None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:47.212712 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 102/196] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:23:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:47.213242 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32572bb-5277-42a1-ae3e-abdb509293c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:47.213898 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792296d9-adce-41fb-8b93-f69839fd3aff None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:47.214452 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32572bb-5277-42a1-ae3e-abdb509293c4 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:47.214904 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32572bb-5277-42a1-ae3e-abdb509293c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:47.215348 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32572bb-5277-42a1-ae3e-abdb509293c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:47.216273 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32572bb-5277-42a1-ae3e-abdb509293c4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:47.217056 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32572bb-5277-42a1-ae3e-abdb509293c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:47.220386 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32572bb-5277-42a1-ae3e-abdb509293c4 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:47.224962 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:47.235449 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 95/197] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jul 15 17:23:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:47.237073 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32572bb-5277-42a1-ae3e-abdb509293c4 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:47.325532 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792296d9-adce-41fb-8b93-f69839fd3aff None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:47.355395 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32572bb-5277-42a1-ae3e-abdb509293c4 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:47.361742 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71db85-e3c0-4e83-b0a3-c6d7da5ec1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:47.362430 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71db85-e3c0-4e83-b0a3-c6d7da5ec1dc None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:47.362708 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71db85-e3c0-4e83-b0a3-c6d7da5ec1dc None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:47.362981 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71db85-e3c0-4e83-b0a3-c6d7da5ec1dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:47.390941 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec4bed-151f-466e-b092-fae76ba679e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:47.391833 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec4bed-151f-466e-b092-fae76ba679e1 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:47.392105 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec4bed-151f-466e-b092-fae76ba679e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:47.392373 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec4bed-151f-466e-b092-fae76ba679e1 None admin] PATH_INFO: `/v3/users/1105ddc2f5114ec1be71ec51372bfab7` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:47.393762 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec4bed-151f-466e-b092-fae76ba679e1 None admin] RBAC: Authorizing `identity:get_user(user_id=1105ddc2f5114ec1be71ec51372bfab7)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:47.395290 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec4bed-151f-466e-b092-fae76ba679e1 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:47.397097 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 96/198] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:23:47 2022] GET /identity/v3/users/1105ddc2f5114ec1be71ec51372bfab7 => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:47.397679 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec4bed-151f-466e-b092-fae76ba679e1 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:47.434778 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e71db85-e3c0-4e83-b0a3-c6d7da5ec1dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:47.436329 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e71db85-e3c0-4e83-b0a3-c6d7da5ec1dc None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:47.445619 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:47.454321 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:47.509610 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec4bed-151f-466e-b092-fae76ba679e1 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:47.546077 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a734ea-8999-4ace-b1c6-02fd61d6c8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:47.547446 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a734ea-8999-4ace-b1c6-02fd61d6c8f8 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:47.547993 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a734ea-8999-4ace-b1c6-02fd61d6c8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:47.548274 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a734ea-8999-4ace-b1c6-02fd61d6c8f8 None admin] PATH_INFO: `/v3/users/58ba77a3b3154cbaaa2d756dff52192e` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:47.550131 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a734ea-8999-4ace-b1c6-02fd61d6c8f8 None admin] RBAC: Authorizing `identity:get_user(user_id=58ba77a3b3154cbaaa2d756dff52192e)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:47.551867 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a734ea-8999-4ace-b1c6-02fd61d6c8f8 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:47.553315 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 103/199] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:23:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 17:23:47.554056 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 97/200] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:23:47 2022] GET /identity/v3/users/58ba77a3b3154cbaaa2d756dff52192e => generated 289 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:47.558834 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a734ea-8999-4ace-b1c6-02fd61d6c8f8 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:47.558967 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71db85-e3c0-4e83-b0a3-c6d7da5ec1dc None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:47.664904 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a734ea-8999-4ace-b1c6-02fd61d6c8f8 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:47.689367 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:47.693674 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71db85-e3c0-4e83-b0a3-c6d7da5ec1dc None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:47.703319 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0331e-a347-4b75-815c-9d3d40e4fba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:47.704133 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0331e-a347-4b75-815c-9d3d40e4fba9 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:47.704319 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:47.704455 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0331e-a347-4b75-815c-9d3d40e4fba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:47.704662 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0331e-a347-4b75-815c-9d3d40e4fba9 None admin] PATH_INFO: `/v3/projects/debcff5d6200462baae7bebc7bb34145` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:47.706208 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a0331e-a347-4b75-815c-9d3d40e4fba9 None admin] RBAC: Authorizing `identity:get_project(project_id=debcff5d6200462baae7bebc7bb34145)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:47.708164 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a0331e-a347-4b75-815c-9d3d40e4fba9 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:47.709721 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 98/201] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:23:47 2022] GET /identity/v3/projects/debcff5d6200462baae7bebc7bb34145 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:23:47.710506 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0331e-a347-4b75-815c-9d3d40e4fba9 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:47.741797 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29961f2d-a080-47a0-be6e-02cf5943b718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:47.742474 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29961f2d-a080-47a0-be6e-02cf5943b718 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:47.742752 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29961f2d-a080-47a0-be6e-02cf5943b718 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:47.743022 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29961f2d-a080-47a0-be6e-02cf5943b718 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:47.823584 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0331e-a347-4b75-815c-9d3d40e4fba9 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:47.839859 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29961f2d-a080-47a0-be6e-02cf5943b718 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:47.842124 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29961f2d-a080-47a0-be6e-02cf5943b718 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:47.868394 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faebe210-d853-47ce-bc98-96acca3a36cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:47.869981 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebe210-d853-47ce-bc98-96acca3a36cf None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:47.870749 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebe210-d853-47ce-bc98-96acca3a36cf None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:47.871224 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebe210-d853-47ce-bc98-96acca3a36cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:47.939136 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:47.951164 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faebe210-d853-47ce-bc98-96acca3a36cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:47.952900 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faebe210-d853-47ce-bc98-96acca3a36cf None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:47.956712 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 104/202] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:23:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 17:23:47.957806 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29961f2d-a080-47a0-be6e-02cf5943b718 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:47.966853 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:48.068480 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29961f2d-a080-47a0-be6e-02cf5943b718 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:48.070463 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 99/203] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:23:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 17:23:48.072259 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faebe210-d853-47ce-bc98-96acca3a36cf None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:48.106116 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c07fe95-6946-46ac-b3e7-b64f4b28dffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:48.107154 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07fe95-6946-46ac-b3e7-b64f4b28dffe None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:48.107632 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07fe95-6946-46ac-b3e7-b64f4b28dffe None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:48.108103 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07fe95-6946-46ac-b3e7-b64f4b28dffe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:48.109209 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c07fe95-6946-46ac-b3e7-b64f4b28dffe None admin] RBAC: Adding query filter params (role.id=c9b1f4b47f054f7a8a9a079e65a7197a, scope.project.id=debcff5d6200462baae7bebc7bb34145, user.id=1105ddc2f5114ec1be71ec51372bfab7) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:48.109751 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c07fe95-6946-46ac-b3e7-b64f4b28dffe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:48.111536 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c07fe95-6946-46ac-b3e7-b64f4b28dffe None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:48.118491 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 105/204] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jul 15 17:23:47 2022] GET /identity/v3/role_assignments?user.id=1105ddc2f5114ec1be71ec51372bfab7&scope.project.id=debcff5d6200462baae7bebc7bb34145&role.id=c9b1f4b47f054f7a8a9a079e65a7197a => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:48.119731 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c07fe95-6946-46ac-b3e7-b64f4b28dffe None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:48.230743 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:48.250936 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faebe210-d853-47ce-bc98-96acca3a36cf None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:48.280929 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:48.325099 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ebb7c-f9ae-49a9-87ef-14f6b0c94c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:48.328092 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ebb7c-f9ae-49a9-87ef-14f6b0c94c03 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:48.328388 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ebb7c-f9ae-49a9-87ef-14f6b0c94c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:48.328670 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ebb7c-f9ae-49a9-87ef-14f6b0c94c03 None admin] PATH_INFO: `/v3/projects/debcff5d6200462baae7bebc7bb34145` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:48.332232 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c07fe95-6946-46ac-b3e7-b64f4b28dffe None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:48.334065 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4ebb7c-f9ae-49a9-87ef-14f6b0c94c03 None admin] RBAC: Authorizing `identity:get_project(project_id=debcff5d6200462baae7bebc7bb34145)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:48.335531 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4ebb7c-f9ae-49a9-87ef-14f6b0c94c03 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:48.337276 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 100/205] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:23:48 2022] GET /identity/v3/projects/debcff5d6200462baae7bebc7bb34145 => generated 302 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:48.345655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ebb7c-f9ae-49a9-87ef-14f6b0c94c03 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:48.426889 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20e197-65ec-42d5-b765-d990ab3f49f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:48.427764 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20e197-65ec-42d5-b765-d990ab3f49f9 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:48.428043 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20e197-65ec-42d5-b765-d990ab3f49f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:48.428313 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20e197-65ec-42d5-b765-d990ab3f49f9 None admin] PATH_INFO: `/v3/projects/7660c9e611fc4315b714c975f6e5f41e` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:48.430407 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac20e197-65ec-42d5-b765-d990ab3f49f9 None admin] RBAC: Authorizing `identity:get_project(project_id=7660c9e611fc4315b714c975f6e5f41e)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:48.431870 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac20e197-65ec-42d5-b765-d990ab3f49f9 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:48.433606 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 106/206] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:23:48 2022] GET /identity/v3/projects/7660c9e611fc4315b714c975f6e5f41e => generated 298 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:48.440403 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20e197-65ec-42d5-b765-d990ab3f49f9 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:48.496912 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ebb7c-f9ae-49a9-87ef-14f6b0c94c03 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:48.561017 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b680b5f-cf52-4cff-b5cb-5c0153e35adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:48.562964 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b680b5f-cf52-4cff-b5cb-5c0153e35adf None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:48.563442 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b680b5f-cf52-4cff-b5cb-5c0153e35adf None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:48.563906 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b680b5f-cf52-4cff-b5cb-5c0153e35adf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:48.564941 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b680b5f-cf52-4cff-b5cb-5c0153e35adf None admin] RBAC: Adding query filter params (role.id=70d242b29ede4648b639c7ddae5eaead, scope.project.id=debcff5d6200462baae7bebc7bb34145, user.id=1105ddc2f5114ec1be71ec51372bfab7) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:48.565503 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b680b5f-cf52-4cff-b5cb-5c0153e35adf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:48.567237 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b680b5f-cf52-4cff-b5cb-5c0153e35adf None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:48.574082 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 101/207] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jul 15 17:23:48 2022] GET /identity/v3/role_assignments?user.id=1105ddc2f5114ec1be71ec51372bfab7&scope.project.id=debcff5d6200462baae7bebc7bb34145&role.id=70d242b29ede4648b639c7ddae5eaead => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:48.617989 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20e197-65ec-42d5-b765-d990ab3f49f9 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:48.661558 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81620871-59b1-43ce-92b5-98c22db8121b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:48.662532 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81620871-59b1-43ce-92b5-98c22db8121b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:48.662954 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81620871-59b1-43ce-92b5-98c22db8121b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:48.663361 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81620871-59b1-43ce-92b5-98c22db8121b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:48.664342 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81620871-59b1-43ce-92b5-98c22db8121b None admin] RBAC: Adding query filter params (role.id=a3a3c02087374a9086cf0d79e6118247, scope.project.id=7660c9e611fc4315b714c975f6e5f41e, user.id=58ba77a3b3154cbaaa2d756dff52192e) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:48.664803 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81620871-59b1-43ce-92b5-98c22db8121b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:48.666473 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81620871-59b1-43ce-92b5-98c22db8121b None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:48.674158 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 107/208] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jul 15 17:23:48 2022] GET /identity/v3/role_assignments?user.id=58ba77a3b3154cbaaa2d756dff52192e&scope.project.id=7660c9e611fc4315b714c975f6e5f41e&role.id=a3a3c02087374a9086cf0d79e6118247 => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:49.087769 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d165b-4eaf-4691-a364-1bc3f9085765 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:49.088148 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d165b-4eaf-4691-a364-1bc3f9085765 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:49.088337 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d165b-4eaf-4691-a364-1bc3f9085765 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:49.089860 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 102/209] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:23:49.095313 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389df242-1dda-4cb8-ae33-a557a78a0dce None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:49.095602 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389df242-1dda-4cb8-ae33-a557a78a0dce None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:49.095878 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389df242-1dda-4cb8-ae33-a557a78a0dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:49.100906 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:49.115795 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-389df242-1dda-4cb8-ae33-a557a78a0dce None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:23:49.117310 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-389df242-1dda-4cb8-ae33-a557a78a0dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:23:49.201399 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 108/210] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:23:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:23:49.208872 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d56f5-bd20-4ff3-b47e-339e1011e5b6 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:49.209164 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d56f5-bd20-4ff3-b47e-339e1011e5b6 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:49.209428 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d56f5-bd20-4ff3-b47e-339e1011e5b6 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:49.210846 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 103/211] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 17:23:49.216325 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a13328-1790-4ea5-ad34-66d235026d2a None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:49.216619 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a13328-1790-4ea5-ad34-66d235026d2a None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:49.216901 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a13328-1790-4ea5-ad34-66d235026d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:49.232025 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d56f5-bd20-4ff3-b47e-339e1011e5b6 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:49.234293 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-20a13328-1790-4ea5-ad34-66d235026d2a None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:23:49.235486 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-20a13328-1790-4ea5-ad34-66d235026d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:23:49.267437 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:49.330053 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 109/212] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:23:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:23:49.350103 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a13328-1790-4ea5-ad34-66d235026d2a None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:49.368826 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d56f5-bd20-4ff3-b47e-339e1011e5b6 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:49.417110 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:49.430650 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd12c9-9000-43a6-b48b-b9e1c247e44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:49.431606 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd12c9-9000-43a6-b48b-b9e1c247e44a None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:49.431981 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd12c9-9000-43a6-b48b-b9e1c247e44a None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:49.432353 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd12c9-9000-43a6-b48b-b9e1c247e44a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:49.447914 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfd12c9-9000-43a6-b48b-b9e1c247e44a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:23:49.460132 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-1cfd12c9-9000-43a6-b48b-b9e1c247e44a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 17:23:49.460132 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:23:49.460132 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:23:49.460132 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:23:49.460132 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:23:49.460132 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:23:49.460132 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:23:49.460132 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:23:49.460132 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:23:49.460132 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:23:49.460132 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:23:49.460132 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:23:49.460132 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:23:49.460132 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:23:49.460132 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:23:49.460132 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:23:49.461071 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:23:49.461071 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:23:49.461071 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:23:49.461071 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:23:49.461071 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:23:49.461071 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:23:49.461071 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:23:49.461071 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:23:49.461071 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:23:49.461071 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:23:49.461071 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:23:49.461071 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:23:49.461071 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:23:49.461071 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:23:49.461071 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:23:49.461071 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:23:49.462148 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:23:49.462148 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:23:49.462148 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:23:49.462148 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:23:49.462148 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:23:49.462148 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:23:49.462148 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:23:49.462148 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:23:49.462148 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:23:49.462148 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:23:49.462148 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 17:23:49.462148 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:23:49.464106 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a13328-1790-4ea5-ad34-66d235026d2a None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:49.465849 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 104/213] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:23:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:23:49.468817 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd12c9-9000-43a6-b48b-b9e1c247e44a None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:49.501355 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87b9b4-c11d-4bb4-b0b4-24416b4eb7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:49.502483 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87b9b4-c11d-4bb4-b0b4-24416b4eb7b6 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:49.502948 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87b9b4-c11d-4bb4-b0b4-24416b4eb7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:49.503425 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87b9b4-c11d-4bb4-b0b4-24416b4eb7b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:49.504816 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e87b9b4-c11d-4bb4-b0b4-24416b4eb7b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:49.506549 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e87b9b4-c11d-4bb4-b0b4-24416b4eb7b6 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:49.513208 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 110/214] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:23:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:49.514443 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87b9b4-c11d-4bb4-b0b4-24416b4eb7b6 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:49.571198 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:49.592022 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd12c9-9000-43a6-b48b-b9e1c247e44a None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:49.627029 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972041a-1896-4092-b28d-bf72baa47ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:49.628149 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972041a-1896-4092-b28d-bf72baa47ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:49.628634 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972041a-1896-4092-b28d-bf72baa47ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:49.629409 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972041a-1896-4092-b28d-bf72baa47ea9 None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:49.630660 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2972041a-1896-4092-b28d-bf72baa47ea9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:49.631378 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2972041a-1896-4092-b28d-bf72baa47ea9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:49.633630 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2972041a-1896-4092-b28d-bf72baa47ea9 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:49.634508 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87b9b4-c11d-4bb4-b0b4-24416b4eb7b6 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:49.644897 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 105/215] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jul 15 17:23:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:49.650550 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972041a-1896-4092-b28d-bf72baa47ea9 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:49.675735 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:49.684127 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb3e2f-47ab-4a49-a962-a4e026a9b20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:49.684803 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb3e2f-47ab-4a49-a962-a4e026a9b20b None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:49.685077 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb3e2f-47ab-4a49-a962-a4e026a9b20b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:49.685347 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb3e2f-47ab-4a49-a962-a4e026a9b20b None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:49.686285 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb3e2f-47ab-4a49-a962-a4e026a9b20b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:49.688482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb3e2f-47ab-4a49-a962-a4e026a9b20b None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:49.721416 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 111/216] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Jul 15 17:23:49 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 17:23:49.774266 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972041a-1896-4092-b28d-bf72baa47ea9 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:49.813427 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d8f3e5-e2f4-4003-aa80-f3b55456d696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:49.814418 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8f3e5-e2f4-4003-aa80-f3b55456d696 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:49.814700 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8f3e5-e2f4-4003-aa80-f3b55456d696 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:49.814970 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8f3e5-e2f4-4003-aa80-f3b55456d696 None admin] PATH_INFO: `/v3/users/2b76691221aa40a3a9087c084a47247d` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:49.831801 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d8f3e5-e2f4-4003-aa80-f3b55456d696 None admin] RBAC: Authorizing `identity:get_user(user_id=2b76691221aa40a3a9087c084a47247d)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:49.833310 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d8f3e5-e2f4-4003-aa80-f3b55456d696 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:49.835548 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 106/217] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:23:49 2022] GET /identity/v3/users/2b76691221aa40a3a9087c084a47247d => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:23:49.841318 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb3e2f-47ab-4a49-a962-a4e026a9b20b None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:49.951167 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb3e2f-47ab-4a49-a962-a4e026a9b20b None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:49.988099 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05549a6e-55c5-4c29-afb1-094a01456d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:49.989105 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05549a6e-55c5-4c29-afb1-094a01456d3d None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:49.989608 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05549a6e-55c5-4c29-afb1-094a01456d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:49.990180 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05549a6e-55c5-4c29-afb1-094a01456d3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:50.050341 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:50.071543 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05549a6e-55c5-4c29-afb1-094a01456d3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:50.073023 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05549a6e-55c5-4c29-afb1-094a01456d3d None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:50.181254 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 112/218] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:23:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 17:23:50.186567 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d8f3e5-e2f4-4003-aa80-f3b55456d696 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:50.190428 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:50.315676 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39707af-8fd8-45a9-b129-d51cb13ce1e4 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:50.315968 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39707af-8fd8-45a9-b129-d51cb13ce1e4 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:50.316245 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39707af-8fd8-45a9-b129-d51cb13ce1e4 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:50.317808 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 113/219] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:23:50.324616 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9efed-e753-4772-8b48-8641ab1360d2 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:50.324958 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9efed-e753-4772-8b48-8641ab1360d2 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:50.325239 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9efed-e753-4772-8b48-8641ab1360d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:50.338326 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d8f3e5-e2f4-4003-aa80-f3b55456d696 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:50.357132 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-77c9efed-e753-4772-8b48-8641ab1360d2 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:23:50.358289 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-77c9efed-e753-4772-8b48-8641ab1360d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:23:50.380567 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5076c49-066c-4a49-8fd3-ebc4ef15addd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:50.381834 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5076c49-066c-4a49-8fd3-ebc4ef15addd None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:50.382341 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5076c49-066c-4a49-8fd3-ebc4ef15addd None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:50.382805 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5076c49-066c-4a49-8fd3-ebc4ef15addd None admin] PATH_INFO: `/v3/projects/debcff5d6200462baae7bebc7bb34145` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:50.384968 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5076c49-066c-4a49-8fd3-ebc4ef15addd None admin] RBAC: Authorizing `identity:get_project(project_id=debcff5d6200462baae7bebc7bb34145)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:50.386659 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5076c49-066c-4a49-8fd3-ebc4ef15addd None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:50.389349 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 107/220] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:23:50 2022] GET /identity/v3/projects/debcff5d6200462baae7bebc7bb34145 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:50.396274 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5076c49-066c-4a49-8fd3-ebc4ef15addd None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:50.488340 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 114/221] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:23:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:23:50.505201 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:50.514751 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c9efed-e753-4772-8b48-8641ab1360d2 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:50.532921 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:50.576053 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5076c49-066c-4a49-8fd3-ebc4ef15addd None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:50.633125 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c9efed-e753-4772-8b48-8641ab1360d2 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:50.649493 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e7d270-3f5e-4231-bb38-10d83d7da8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:50.650189 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7d270-3f5e-4231-bb38-10d83d7da8ea None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:50.650469 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7d270-3f5e-4231-bb38-10d83d7da8ea None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:50.650738 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7d270-3f5e-4231-bb38-10d83d7da8ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:50.651578 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e7d270-3f5e-4231-bb38-10d83d7da8ea None admin] RBAC: Adding query filter params (role.id=d8d52b8fc62e44cd9d551b855f2ac84b, scope.project.id=debcff5d6200462baae7bebc7bb34145, user.id=2b76691221aa40a3a9087c084a47247d) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:50.651890 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e7d270-3f5e-4231-bb38-10d83d7da8ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:50.653365 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e7d270-3f5e-4231-bb38-10d83d7da8ea None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:50.669228 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 108/222] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jul 15 17:23:50 2022] GET /identity/v3/role_assignments?user.id=2b76691221aa40a3a9087c084a47247d&scope.project.id=debcff5d6200462baae7bebc7bb34145&role.id=d8d52b8fc62e44cd9d551b855f2ac84b => generated 259 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:50.683196 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf304c-c4ab-4bb0-b4b3-ea5e8f5441dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:50.684728 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf304c-c4ab-4bb0-b4b3-ea5e8f5441dc None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:50.685206 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf304c-c4ab-4bb0-b4b3-ea5e8f5441dc None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:50.685672 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf304c-c4ab-4bb0-b4b3-ea5e8f5441dc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:50.704878 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cf304c-c4ab-4bb0-b4b3-ea5e8f5441dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:23:50.714079 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-d4cf304c-c4ab-4bb0-b4b3-ea5e8f5441dc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 17:23:50.714079 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:23:50.714079 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:23:50.714079 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:23:50.714079 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:23:50.714079 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:23:50.714079 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:23:50.714079 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:23:50.714079 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:23:50.714079 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:23:50.714079 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:23:50.714079 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:23:50.714079 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:23:50.714079 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:23:50.714079 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:23:50.714079 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:23:50.715033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:23:50.715033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:23:50.715033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:23:50.715033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:23:50.715033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:23:50.715033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:23:50.715033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:23:50.715033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:23:50.715033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:23:50.715033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:23:50.715033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:23:50.715033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:23:50.715033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:23:50.715033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:23:50.715033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:23:50.715033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:23:50.715820 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:23:50.715820 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:23:50.715820 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:23:50.715820 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:23:50.715820 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:23:50.715820 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:23:50.715820 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:23:50.715820 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:23:50.715820 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:23:50.715820 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:23:50.715820 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 17:23:50.715820 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:23:50.719522 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 115/223] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Jul 15 17:23:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 17:23:50.725772 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e7d270-3f5e-4231-bb38-10d83d7da8ea None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:50.812437 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a258369-6c7e-4e1c-982f-10f854dff811 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:50.813093 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a258369-6c7e-4e1c-982f-10f854dff811 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:50.813568 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a258369-6c7e-4e1c-982f-10f854dff811 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:50.815284 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 116/224] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:23:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 17:23:50.832176 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7d4fb-fdad-419a-b3a6-814b9ec48270 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:50.832363 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7d4fb-fdad-419a-b3a6-814b9ec48270 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:50.832634 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7d4fb-fdad-419a-b3a6-814b9ec48270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:50.861577 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-7be7d4fb-fdad-419a-b3a6-814b9ec48270 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:23:50.863236 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7be7d4fb-fdad-419a-b3a6-814b9ec48270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:23:50.891384 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e7d270-3f5e-4231-bb38-10d83d7da8ea None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:50.934356 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d2ca9-87e1-4fa3-946b-8d42260517f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:50.935867 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d2ca9-87e1-4fa3-946b-8d42260517f8 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:50.936602 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d2ca9-87e1-4fa3-946b-8d42260517f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:50.937257 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d2ca9-87e1-4fa3-946b-8d42260517f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:50.938689 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1d2ca9-87e1-4fa3-946b-8d42260517f8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:50.939436 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1d2ca9-87e1-4fa3-946b-8d42260517f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:50.941851 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1d2ca9-87e1-4fa3-946b-8d42260517f8 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:50.944672 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:50.949607 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 117/225] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:23:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:23:50.966334 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 109/226] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:23:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:50.972332 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7d4fb-fdad-419a-b3a6-814b9ec48270 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:50.985249 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d2ca9-87e1-4fa3-946b-8d42260517f8 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:50.986252 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:51.091597 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d2ca9-87e1-4fa3-946b-8d42260517f8 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:51.128893 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da570e46-2c39-4f9b-b9f3-a0aadba79515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:51.130103 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da570e46-2c39-4f9b-b9f3-a0aadba79515 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:51.130661 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da570e46-2c39-4f9b-b9f3-a0aadba79515 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:51.131126 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da570e46-2c39-4f9b-b9f3-a0aadba79515 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:51.143368 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da570e46-2c39-4f9b-b9f3-a0aadba79515 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:23:51.151506 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-da570e46-2c39-4f9b-b9f3-a0aadba79515 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:23:51.151506 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:23:51.151506 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:23:51.151506 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:23:51.151506 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:23:51.151506 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:23:51.151506 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:23:51.151506 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:23:51.151506 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:23:51.151506 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:23:51.151506 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:23:51.151506 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:23:51.151506 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:23:51.151506 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:23:51.151506 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:23:51.151506 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:23:51.152387 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:23:51.152387 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:23:51.152387 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:23:51.152387 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:23:51.152387 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:23:51.152387 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:23:51.152387 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:23:51.152387 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:23:51.152387 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:23:51.152387 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:23:51.152387 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:23:51.152387 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:23:51.152387 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:23:51.152387 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:23:51.152387 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:23:51.152387 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:23:51.153207 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:23:51.153207 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:23:51.153207 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:23:51.153207 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:23:51.153207 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:23:51.153207 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:23:51.153207 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:23:51.153207 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:23:51.153207 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:23:51.153207 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:23:51.153207 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:23:51.153207 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:23:51.156645 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 110/227] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jul 15 17:23:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:23:51.162602 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da570e46-2c39-4f9b-b9f3-a0aadba79515 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:51.167752 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7d4fb-fdad-419a-b3a6-814b9ec48270 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:51.239627 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:51.276882 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da570e46-2c39-4f9b-b9f3-a0aadba79515 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:51.311360 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0288d34-bcd2-49dc-93c7-0acbc261c88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:51.312076 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0288d34-bcd2-49dc-93c7-0acbc261c88b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:51.312364 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0288d34-bcd2-49dc-93c7-0acbc261c88b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:51.312641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0288d34-bcd2-49dc-93c7-0acbc261c88b None admin] PATH_INFO: `/v3/users/1105ddc2f5114ec1be71ec51372bfab7` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:51.313896 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0288d34-bcd2-49dc-93c7-0acbc261c88b None admin] RBAC: Authorizing `identity:get_user(user_id=1105ddc2f5114ec1be71ec51372bfab7)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:51.315382 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0288d34-bcd2-49dc-93c7-0acbc261c88b None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:51.317248 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 118/228] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:23:50 2022] GET /identity/v3/users/1105ddc2f5114ec1be71ec51372bfab7 => generated 283 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:51.328173 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0288d34-bcd2-49dc-93c7-0acbc261c88b None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:51.328961 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e4fb8-de4b-4b86-9942-2edce8d2d0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:51.330024 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e4fb8-de4b-4b86-9942-2edce8d2d0bf None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:51.330498 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e4fb8-de4b-4b86-9942-2edce8d2d0bf None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:51.331277 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e4fb8-de4b-4b86-9942-2edce8d2d0bf None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:51.332233 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e4fb8-de4b-4b86-9942-2edce8d2d0bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:51.332724 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e4fb8-de4b-4b86-9942-2edce8d2d0bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:51.334367 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e4fb8-de4b-4b86-9942-2edce8d2d0bf None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:51.345250 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 111/229] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:23:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:23:51.363089 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e4fb8-de4b-4b86-9942-2edce8d2d0bf None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:51.435330 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:51.481623 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0288d34-bcd2-49dc-93c7-0acbc261c88b None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:51.497559 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e4fb8-de4b-4b86-9942-2edce8d2d0bf None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:51.518106 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:51.536717 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d0a95-895f-49a9-b060-57128a372df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:51.537922 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d0a95-895f-49a9-b060-57128a372df0 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:51.538965 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d0a95-895f-49a9-b060-57128a372df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:51.539584 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d0a95-895f-49a9-b060-57128a372df0 None admin] PATH_INFO: `/v3/users/1105ddc2f5114ec1be71ec51372bfab7` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:51.543198 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d0a95-895f-49a9-b060-57128a372df0 None admin] RBAC: Authorizing `identity:get_user(user_id=1105ddc2f5114ec1be71ec51372bfab7)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:51.545201 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d0a95-895f-49a9-b060-57128a372df0 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:51.546724 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6e08a-8a6f-4fa5-b126-f4982ad90fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:51.548657 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 112/230] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:23:51 2022] GET /identity/v3/users/1105ddc2f5114ec1be71ec51372bfab7 => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:23:51.549769 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6e08a-8a6f-4fa5-b126-f4982ad90fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:51.550278 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6e08a-8a6f-4fa5-b126-f4982ad90fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:51.550736 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6e08a-8a6f-4fa5-b126-f4982ad90fe3 None admin] PATH_INFO: `/v3/projects/debcff5d6200462baae7bebc7bb34145` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:51.552140 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b6e08a-8a6f-4fa5-b126-f4982ad90fe3 None admin] RBAC: Authorizing `identity:get_project(project_id=debcff5d6200462baae7bebc7bb34145)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:51.554482 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d0a95-895f-49a9-b060-57128a372df0 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:51.557631 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b6e08a-8a6f-4fa5-b126-f4982ad90fe3 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:51.562457 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 119/231] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:23:51 2022] GET /identity/v3/projects/debcff5d6200462baae7bebc7bb34145 => generated 302 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:51.568885 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6e08a-8a6f-4fa5-b126-f4982ad90fe3 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:51.734320 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d0a95-895f-49a9-b060-57128a372df0 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:51.771066 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b2274-5f4f-4c8f-a607-26e141002ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:51.772299 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b2274-5f4f-4c8f-a607-26e141002ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:51.772796 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b2274-5f4f-4c8f-a607-26e141002ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:51.773257 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b2274-5f4f-4c8f-a607-26e141002ae0 None admin] PATH_INFO: `/v3/projects/debcff5d6200462baae7bebc7bb34145` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:51.774658 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975b2274-5f4f-4c8f-a607-26e141002ae0 None admin] RBAC: Authorizing `identity:get_project(project_id=debcff5d6200462baae7bebc7bb34145)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:51.776611 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975b2274-5f4f-4c8f-a607-26e141002ae0 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:51.778983 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 113/232] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:23:51 2022] GET /identity/v3/projects/debcff5d6200462baae7bebc7bb34145 => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:51.788002 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6e08a-8a6f-4fa5-b126-f4982ad90fe3 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:51.789025 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b2274-5f4f-4c8f-a607-26e141002ae0 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:51.835422 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eff772-3295-406c-a3bd-2072d4fa608c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:51.836586 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eff772-3295-406c-a3bd-2072d4fa608c None admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:51.837030 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eff772-3295-406c-a3bd-2072d4fa608c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:51.837459 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eff772-3295-406c-a3bd-2072d4fa608c None admin] PATH_INFO: `/v3/projects/debcff5d6200462baae7bebc7bb34145/users/1105ddc2f5114ec1be71ec51372bfab7/roles/c9b1f4b47f054f7a8a9a079e65a7197a` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:51.843751 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eff772-3295-406c-a3bd-2072d4fa608c None admin] RBAC: Authorizing `identity:create_grant(project_id=debcff5d6200462baae7bebc7bb34145, user_id=1105ddc2f5114ec1be71ec51372bfab7, role_id=c9b1f4b47f054f7a8a9a079e65a7197a)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:51.845365 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eff772-3295-406c-a3bd-2072d4fa608c None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:51.851035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:51.884380 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 120/233] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Jul 15 17:23:51 2022] PUT /identity/v3/projects/debcff5d6200462baae7bebc7bb34145/users/1105ddc2f5114ec1be71ec51372bfab7/roles/c9b1f4b47f054f7a8a9a079e65a7197a => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:23:51.894241 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b2274-5f4f-4c8f-a607-26e141002ae0 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:51.931053 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98aeb5b-e73b-469a-bfe5-2a37be4568d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:51.932121 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98aeb5b-e73b-469a-bfe5-2a37be4568d9 None admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:51.932502 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98aeb5b-e73b-469a-bfe5-2a37be4568d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:51.932872 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98aeb5b-e73b-469a-bfe5-2a37be4568d9 None admin] PATH_INFO: `/v3/projects/debcff5d6200462baae7bebc7bb34145/users/1105ddc2f5114ec1be71ec51372bfab7/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:51.934988 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98aeb5b-e73b-469a-bfe5-2a37be4568d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=debcff5d6200462baae7bebc7bb34145, user_id=1105ddc2f5114ec1be71ec51372bfab7, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:51.936812 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98aeb5b-e73b-469a-bfe5-2a37be4568d9 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:51.954265 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 114/234] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Jul 15 17:23:51 2022] PUT /identity/v3/projects/debcff5d6200462baae7bebc7bb34145/users/1105ddc2f5114ec1be71ec51372bfab7/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:23:52.322497 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef45822-97cb-4b7d-be25-8154a1d7b2df None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:52.322923 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef45822-97cb-4b7d-be25-8154a1d7b2df None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:52.323297 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef45822-97cb-4b7d-be25-8154a1d7b2df None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:52.324777 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 121/235] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:23:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:23:52.340022 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fb028-810a-4f92-971a-91eee092f1b1 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:52.340300 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fb028-810a-4f92-971a-91eee092f1b1 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:52.340582 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fb028-810a-4f92-971a-91eee092f1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:52.368659 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-1e4fb028-810a-4f92-971a-91eee092f1b1 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:23:52.369967 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-1e4fb028-810a-4f92-971a-91eee092f1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:23:52.403033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5e31e-06d7-4694-bf59-7aec9d296ac7 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:52.403777 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5e31e-06d7-4694-bf59-7aec9d296ac7 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:52.404056 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5e31e-06d7-4694-bf59-7aec9d296ac7 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:52.405494 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 122/236] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:23:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 17:23:52.421670 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3737118-d493-4824-a9ce-ce8bcee52784 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:52.421997 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3737118-d493-4824-a9ce-ce8bcee52784 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:52.422250 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3737118-d493-4824-a9ce-ce8bcee52784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:52.430162 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:52.441812 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-c3737118-d493-4824-a9ce-ce8bcee52784 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:23:52.443011 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c3737118-d493-4824-a9ce-ce8bcee52784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:23:52.511696 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 115/237] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:23:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:23:52.524246 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 123/238] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:23:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 17:23:52.552537 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4fb028-810a-4f92-971a-91eee092f1b1 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:52.563080 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3737118-d493-4824-a9ce-ce8bcee52784 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:52.623917 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:52.700667 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3737118-d493-4824-a9ce-ce8bcee52784 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:52.743917 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4fb028-810a-4f92-971a-91eee092f1b1 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:52.762175 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:52.771693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad31763-5515-4ee0-be03-050cb4a89553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:52.772503 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad31763-5515-4ee0-be03-050cb4a89553 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:52.772780 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad31763-5515-4ee0-be03-050cb4a89553 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:52.773052 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad31763-5515-4ee0-be03-050cb4a89553 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:52.774312 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad31763-5515-4ee0-be03-050cb4a89553 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:52.775774 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad31763-5515-4ee0-be03-050cb4a89553 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:52.777401 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 124/239] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:23:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:23:52.787324 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad31763-5515-4ee0-be03-050cb4a89553 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:52.813730 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e361a-e68c-4a08-8500-d099ec472b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:52.814569 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e361a-e68c-4a08-8500-d099ec472b83 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:52.814920 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e361a-e68c-4a08-8500-d099ec472b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:52.815119 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e361a-e68c-4a08-8500-d099ec472b83 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:52.827825 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e361a-e68c-4a08-8500-d099ec472b83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:23:52.836098 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-7c8e361a-e68c-4a08-8500-d099ec472b83 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 17:23:52.836098 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:23:52.836098 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:23:52.836098 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:23:52.836098 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:23:52.836098 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:23:52.836098 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:23:52.836098 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:23:52.836098 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:23:52.836098 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:23:52.836098 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:23:52.836098 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:23:52.836098 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:23:52.836098 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:23:52.836098 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:23:52.836098 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:23:52.836998 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:23:52.836998 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:23:52.836998 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:23:52.836998 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:23:52.836998 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:23:52.836998 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:23:52.836998 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:23:52.836998 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:23:52.836998 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:23:52.836998 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:23:52.836998 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:23:52.836998 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:23:52.836998 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:23:52.836998 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:23:52.836998 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:23:52.836998 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:23:52.837841 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:23:52.837841 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:23:52.837841 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:23:52.837841 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:23:52.837841 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:23:52.837841 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:23:52.837841 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:23:52.837841 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:23:52.837841 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:23:52.837841 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:23:52.837841 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 17:23:52.837841 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:23:52.837841 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 116/240] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:23:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:23:52.845380 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e361a-e68c-4a08-8500-d099ec472b83 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:52.983126 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad31763-5515-4ee0-be03-050cb4a89553 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:53.028364 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1d583-9e13-472c-b948-8e242ce459e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:53.029042 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1d583-9e13-472c-b948-8e242ce459e9 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:53.029321 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1d583-9e13-472c-b948-8e242ce459e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:53.029593 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1d583-9e13-472c-b948-8e242ce459e9 None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:53.030546 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f1d583-9e13-472c-b948-8e242ce459e9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:53.032740 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f1d583-9e13-472c-b948-8e242ce459e9 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:53.033673 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e361a-e68c-4a08-8500-d099ec472b83 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:53.039662 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:53.059032 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 125/241] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Jul 15 17:23:52 2022] POST /identity/v3/users => generated 293 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:23:53.107197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58866b-14eb-4107-8fe2-87ded209d5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:53.107897 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58866b-14eb-4107-8fe2-87ded209d5f7 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:53.108177 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58866b-14eb-4107-8fe2-87ded209d5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:53.108498 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58866b-14eb-4107-8fe2-87ded209d5f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:53.109281 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a58866b-14eb-4107-8fe2-87ded209d5f7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:53.109582 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a58866b-14eb-4107-8fe2-87ded209d5f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:53.111042 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a58866b-14eb-4107-8fe2-87ded209d5f7 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:53.126544 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 117/242] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jul 15 17:23:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:53.132627 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1d583-9e13-472c-b948-8e242ce459e9 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:53.139329 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e97dd-39d5-42b0-b7bd-1ce7b40c1cdf None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:53.139651 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e97dd-39d5-42b0-b7bd-1ce7b40c1cdf None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:53.139931 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e97dd-39d5-42b0-b7bd-1ce7b40c1cdf None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:53.141308 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 118/243] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 17:23:53.151190 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20fb86-6113-429d-be31-9e72286b2864 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:53.151467 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20fb86-6113-429d-be31-9e72286b2864 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:53.151743 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20fb86-6113-429d-be31-9e72286b2864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:53.184950 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-fc20fb86-6113-429d-be31-9e72286b2864 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:23:53.186177 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-fc20fb86-6113-429d-be31-9e72286b2864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:23:53.197916 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:53.256427 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1d583-9e13-472c-b948-8e242ce459e9 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:53.300450 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302b91b-fd95-42b7-a512-98cb45dd2572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:53.301351 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302b91b-fd95-42b7-a512-98cb45dd2572 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:53.301626 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302b91b-fd95-42b7-a512-98cb45dd2572 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:53.301929 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302b91b-fd95-42b7-a512-98cb45dd2572 None admin] PATH_INFO: `/v3/users/fdec723e1b4840ef89efcd8129e0c68b` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:53.320566 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c302b91b-fd95-42b7-a512-98cb45dd2572 None admin] RBAC: Authorizing `identity:get_user(user_id=fdec723e1b4840ef89efcd8129e0c68b)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:53.322452 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c302b91b-fd95-42b7-a512-98cb45dd2572 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:53.324850 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 126/244] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:23:53 2022] GET /identity/v3/users/fdec723e1b4840ef89efcd8129e0c68b => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:53.325617 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 119/245] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:23:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 17:23:53.331358 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302b91b-fd95-42b7-a512-98cb45dd2572 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:53.349463 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20fb86-6113-429d-be31-9e72286b2864 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:53.448917 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302b91b-fd95-42b7-a512-98cb45dd2572 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:53.461770 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:53.468285 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20fb86-6113-429d-be31-9e72286b2864 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:53.469233 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:53.494009 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb9de8-3849-4720-9e45-5badbf2ada81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:53.494765 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb9de8-3849-4720-9e45-5badbf2ada81 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:53.495052 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb9de8-3849-4720-9e45-5badbf2ada81 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:53.495328 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb9de8-3849-4720-9e45-5badbf2ada81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:53.505508 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b82328-f6bc-4131-9424-fb84af7a86ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:53.506361 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b82328-f6bc-4131-9424-fb84af7a86ce None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:53.506754 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b82328-f6bc-4131-9424-fb84af7a86ce None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:53.506984 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b82328-f6bc-4131-9424-fb84af7a86ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:53.520693 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b82328-f6bc-4131-9424-fb84af7a86ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:23:53.528528 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-12b82328-f6bc-4131-9424-fb84af7a86ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 17:23:53.528528 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:23:53.528528 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:23:53.528528 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:23:53.528528 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:23:53.528528 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:23:53.528528 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:23:53.528528 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:23:53.528528 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:23:53.528528 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:23:53.528528 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:23:53.528528 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:23:53.528528 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:23:53.528528 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:23:53.528528 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:23:53.528528 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:23:53.529390 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:23:53.529390 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:23:53.529390 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:23:53.529390 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:23:53.529390 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:23:53.529390 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:23:53.529390 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:23:53.529390 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:23:53.529390 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:23:53.529390 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:23:53.529390 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:23:53.529390 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:23:53.529390 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:23:53.529390 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:23:53.529390 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:23:53.529390 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:23:53.530338 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:23:53.530338 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:23:53.530338 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:23:53.530338 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:23:53.530338 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:23:53.530338 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:23:53.530338 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:23:53.530338 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:23:53.530338 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:23:53.530338 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:23:53.530338 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 17:23:53.530338 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:23:53.530338 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 120/246] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:23:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 17:23:53.536441 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b82328-f6bc-4131-9424-fb84af7a86ce None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:53.574516 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb9de8-3849-4720-9e45-5badbf2ada81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:53.576799 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb9de8-3849-4720-9e45-5badbf2ada81 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:53.665265 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b82328-f6bc-4131-9424-fb84af7a86ce None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:53.700878 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 127/247] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:23:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 17:23:53.706582 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb9de8-3849-4720-9e45-5badbf2ada81 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:53.712435 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c5bb0-3388-448d-8478-2d686130556e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:53.713114 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c5bb0-3388-448d-8478-2d686130556e None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:53.713397 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c5bb0-3388-448d-8478-2d686130556e None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:53.713674 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c5bb0-3388-448d-8478-2d686130556e None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:53.714560 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48c5bb0-3388-448d-8478-2d686130556e None admin] RBAC: Adding query filter params (name=member) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:53.714868 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48c5bb0-3388-448d-8478-2d686130556e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:53.716438 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48c5bb0-3388-448d-8478-2d686130556e None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:53.726237 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:53.728981 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 121/248] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jul 15 17:23:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:53.739873 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c5bb0-3388-448d-8478-2d686130556e None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:53.764721 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:53.829859 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb9de8-3849-4720-9e45-5badbf2ada81 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:53.873438 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c5bb0-3388-448d-8478-2d686130556e None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:53.887467 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029de910-73c5-49ad-9bed-d946caa55a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:53.888798 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029de910-73c5-49ad-9bed-d946caa55a29 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:53.889080 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029de910-73c5-49ad-9bed-d946caa55a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:53.889550 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029de910-73c5-49ad-9bed-d946caa55a29 None admin] PATH_INFO: `/v3/projects/debcff5d6200462baae7bebc7bb34145` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:53.891303 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029de910-73c5-49ad-9bed-d946caa55a29 None admin] RBAC: Authorizing `identity:get_project(project_id=debcff5d6200462baae7bebc7bb34145)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:53.893519 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029de910-73c5-49ad-9bed-d946caa55a29 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:53.895811 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 128/249] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:23:53 2022] GET /identity/v3/projects/debcff5d6200462baae7bebc7bb34145 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:23:53.902198 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029de910-73c5-49ad-9bed-d946caa55a29 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:53.941026 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612a6f5-0c39-45e3-993e-505f96b42be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:53.942359 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612a6f5-0c39-45e3-993e-505f96b42be9 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:53.942869 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612a6f5-0c39-45e3-993e-505f96b42be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:53.943329 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612a6f5-0c39-45e3-993e-505f96b42be9 None admin] PATH_INFO: `/v3/users/2b76691221aa40a3a9087c084a47247d` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:53.947269 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a612a6f5-0c39-45e3-993e-505f96b42be9 None admin] RBAC: Authorizing `identity:get_user(user_id=2b76691221aa40a3a9087c084a47247d)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:53.949101 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a612a6f5-0c39-45e3-993e-505f96b42be9 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:53.951409 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 122/250] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:23:53 2022] GET /identity/v3/users/2b76691221aa40a3a9087c084a47247d => generated 297 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:53.956881 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612a6f5-0c39-45e3-993e-505f96b42be9 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:53.995802 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:54.014080 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029de910-73c5-49ad-9bed-d946caa55a29 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:54.063207 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd58ab53-eb5d-4070-be32-fed0daad1391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:54.064019 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58ab53-eb5d-4070-be32-fed0daad1391 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:54.064310 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58ab53-eb5d-4070-be32-fed0daad1391 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:54.064584 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58ab53-eb5d-4070-be32-fed0daad1391 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:54.065430 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd58ab53-eb5d-4070-be32-fed0daad1391 None admin] RBAC: Adding query filter params (role.id=a3a3c02087374a9086cf0d79e6118247, scope.project.id=debcff5d6200462baae7bebc7bb34145, user.id=fdec723e1b4840ef89efcd8129e0c68b) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:54.065743 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd58ab53-eb5d-4070-be32-fed0daad1391 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:54.067481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd58ab53-eb5d-4070-be32-fed0daad1391 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:54.074563 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 129/251] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jul 15 17:23:53 2022] GET /identity/v3/role_assignments?user.id=fdec723e1b4840ef89efcd8129e0c68b&scope.project.id=debcff5d6200462baae7bebc7bb34145&role.id=a3a3c02087374a9086cf0d79e6118247 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:23:54.164555 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:54.184998 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612a6f5-0c39-45e3-993e-505f96b42be9 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:54.232061 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89349c42-b836-4060-8d4e-ca68c28322bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:54.232942 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89349c42-b836-4060-8d4e-ca68c28322bb None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:54.233211 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89349c42-b836-4060-8d4e-ca68c28322bb None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:54.233585 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89349c42-b836-4060-8d4e-ca68c28322bb None admin] PATH_INFO: `/v3/projects/debcff5d6200462baae7bebc7bb34145` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:54.234788 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89349c42-b836-4060-8d4e-ca68c28322bb None admin] RBAC: Authorizing `identity:get_project(project_id=debcff5d6200462baae7bebc7bb34145)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:54.236248 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89349c42-b836-4060-8d4e-ca68c28322bb None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:54.238361 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 123/252] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:23:53 2022] GET /identity/v3/projects/debcff5d6200462baae7bebc7bb34145 => generated 302 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:54.243743 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd58ab53-eb5d-4070-be32-fed0daad1391 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:54.355428 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd58ab53-eb5d-4070-be32-fed0daad1391 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:54.392809 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb26aae6-610c-4064-9a86-cefc93f93115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:54.393834 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26aae6-610c-4064-9a86-cefc93f93115 None admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:54.394121 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26aae6-610c-4064-9a86-cefc93f93115 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:54.394393 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26aae6-610c-4064-9a86-cefc93f93115 None admin] PATH_INFO: `/v3/projects/debcff5d6200462baae7bebc7bb34145/users/2b76691221aa40a3a9087c084a47247d/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:54.396434 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb26aae6-610c-4064-9a86-cefc93f93115 None admin] RBAC: Authorizing `identity:create_grant(project_id=debcff5d6200462baae7bebc7bb34145, user_id=2b76691221aa40a3a9087c084a47247d, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:54.397967 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb26aae6-610c-4064-9a86-cefc93f93115 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:54.415114 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 130/253] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Jul 15 17:23:54 2022] PUT /identity/v3/projects/debcff5d6200462baae7bebc7bb34145/users/2b76691221aa40a3a9087c084a47247d/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:23:54.473573 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69014520-cb75-4521-b880-ed953e1fbbef None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:54.474227 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69014520-cb75-4521-b880-ed953e1fbbef None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:54.474676 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69014520-cb75-4521-b880-ed953e1fbbef None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:54.476628 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 124/254] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:23:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:23:54.482394 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6fff59-09e0-4ea8-b9d5-009246a249d3 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:54.482696 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6fff59-09e0-4ea8-b9d5-009246a249d3 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:54.482951 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6fff59-09e0-4ea8-b9d5-009246a249d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:54.497260 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:54.507303 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e2fc9-f416-40c9-9eae-f3675028cfec None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:54.507631 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e2fc9-f416-40c9-9eae-f3675028cfec None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:54.507851 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e2fc9-f416-40c9-9eae-f3675028cfec None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:54.508321 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-de6fff59-09e0-4ea8-b9d5-009246a249d3 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:23:54.509558 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 125/255] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:23:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:23:54.510820 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-de6fff59-09e0-4ea8-b9d5-009246a249d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:23:54.535840 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e195f-cde9-4ea3-83d9-87e32524738d None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:54.536171 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e195f-cde9-4ea3-83d9-87e32524738d None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:54.536391 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e195f-cde9-4ea3-83d9-87e32524738d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:54.573754 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-419e195f-cde9-4ea3-83d9-87e32524738d None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:23:54.574993 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-419e195f-cde9-4ea3-83d9-87e32524738d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:23:54.625578 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 131/256] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:23:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:23:54.649118 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6fff59-09e0-4ea8-b9d5-009246a249d3 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:54.707386 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 126/257] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:23:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 17:23:54.761071 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e195f-cde9-4ea3-83d9-87e32524738d None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:54.788522 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6fff59-09e0-4ea8-b9d5-009246a249d3 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:54.858562 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f71f8-9073-4762-8712-5745c531bf1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:54.859774 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f71f8-9073-4762-8712-5745c531bf1b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:54.860280 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f71f8-9073-4762-8712-5745c531bf1b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:54.860745 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f71f8-9073-4762-8712-5745c531bf1b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:54.864079 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:54.886745 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f71f8-9073-4762-8712-5745c531bf1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:23:54.895623 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-037f71f8-9073-4762-8712-5745c531bf1b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 17:23:54.895623 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:23:54.895623 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:23:54.895623 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:23:54.895623 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:23:54.895623 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:23:54.895623 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:23:54.895623 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:23:54.895623 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:23:54.895623 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:23:54.895623 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:23:54.895623 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:23:54.895623 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:23:54.895623 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:23:54.895623 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:23:54.895623 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:23:54.896509 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:23:54.896509 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:23:54.896509 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:23:54.896509 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:23:54.896509 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:23:54.896509 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:23:54.896509 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:23:54.896509 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:23:54.896509 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:23:54.896509 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:23:54.896509 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:23:54.896509 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:23:54.896509 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:23:54.896509 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:23:54.896509 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:23:54.896509 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:23:54.897317 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:23:54.897317 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:23:54.897317 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:23:54.897317 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:23:54.897317 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:23:54.897317 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:23:54.897317 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:23:54.897317 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:23:54.897317 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:23:54.897317 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:23:54.897317 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 17:23:54.897317 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:23:54.907941 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 132/258] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Jul 15 17:23:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:23:54.913603 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f71f8-9073-4762-8712-5745c531bf1b None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:54.979643 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:55.019662 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e195f-cde9-4ea3-83d9-87e32524738d None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:55.115937 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f71f8-9073-4762-8712-5745c531bf1b None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:55.117258 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d9afb-d7bd-4168-8992-b852ae5bf525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:55.118362 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d9afb-d7bd-4168-8992-b852ae5bf525 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:55.118842 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d9afb-d7bd-4168-8992-b852ae5bf525 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:55.119331 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d9afb-d7bd-4168-8992-b852ae5bf525 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:55.150758 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32d9afb-d7bd-4168-8992-b852ae5bf525 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:23:55.158930 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-a32d9afb-d7bd-4168-8992-b852ae5bf525 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:23:55.158930 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:23:55.158930 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:23:55.158930 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:23:55.158930 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:23:55.158930 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:23:55.158930 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:23:55.158930 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:23:55.158930 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:23:55.158930 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:23:55.158930 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:23:55.158930 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:23:55.158930 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:23:55.158930 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:23:55.158930 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:23:55.158930 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:23:55.159791 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:23:55.159791 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:23:55.159791 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:23:55.159791 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:23:55.159791 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:23:55.159791 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:23:55.159791 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:23:55.159791 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:23:55.159791 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:23:55.159791 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:23:55.159791 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:23:55.159791 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:23:55.159791 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:23:55.159791 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:23:55.159791 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:23:55.159791 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:23:55.160579 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:23:55.160579 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:23:55.160579 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:23:55.160579 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:23:55.160579 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:23:55.160579 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:23:55.160579 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:23:55.160579 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:23:55.160579 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:23:55.160579 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:23:55.160579 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:23:55.160579 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:23:55.171770 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 127/259] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jul 15 17:23:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 411 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 17:23:55.177447 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d9afb-d7bd-4168-8992-b852ae5bf525 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:55.201600 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd933c7c-b4a3-457d-b9dc-b7033ca511af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:55.202457 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd933c7c-b4a3-457d-b9dc-b7033ca511af None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:55.202926 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd933c7c-b4a3-457d-b9dc-b7033ca511af None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:55.203264 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd933c7c-b4a3-457d-b9dc-b7033ca511af None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:55.204025 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd933c7c-b4a3-457d-b9dc-b7033ca511af None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:55.204330 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd933c7c-b4a3-457d-b9dc-b7033ca511af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:55.206176 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd933c7c-b4a3-457d-b9dc-b7033ca511af None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:55.223436 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 133/260] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:23:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:23:55.229862 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd933c7c-b4a3-457d-b9dc-b7033ca511af None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:55.368962 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:55.371447 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d9afb-d7bd-4168-8992-b852ae5bf525 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:55.435522 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae631ce-e86d-484b-afeb-22650d349bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:55.436134 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae631ce-e86d-484b-afeb-22650d349bdc None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:55.436485 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae631ce-e86d-484b-afeb-22650d349bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:55.436786 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae631ce-e86d-484b-afeb-22650d349bdc None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:55.437553 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae631ce-e86d-484b-afeb-22650d349bdc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:55.437885 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae631ce-e86d-484b-afeb-22650d349bdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:55.439293 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae631ce-e86d-484b-afeb-22650d349bdc None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:55.452545 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 128/261] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:23:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:23:55.453830 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd933c7c-b4a3-457d-b9dc-b7033ca511af None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:55.461138 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae631ce-e86d-484b-afeb-22650d349bdc None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:55.478137 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:55.535353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2718ad-fccd-4497-b819-e6469c9e3ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:55.536239 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2718ad-fccd-4497-b819-e6469c9e3ec6 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:55.536514 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2718ad-fccd-4497-b819-e6469c9e3ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:55.536784 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2718ad-fccd-4497-b819-e6469c9e3ec6 None admin] PATH_INFO: `/v3/users/1105ddc2f5114ec1be71ec51372bfab7` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:55.538009 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2718ad-fccd-4497-b819-e6469c9e3ec6 None admin] RBAC: Authorizing `identity:get_user(user_id=1105ddc2f5114ec1be71ec51372bfab7)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:55.539454 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2718ad-fccd-4497-b819-e6469c9e3ec6 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:55.541262 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 134/262] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:23:55 2022] GET /identity/v3/users/1105ddc2f5114ec1be71ec51372bfab7 => generated 283 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:55.546891 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2718ad-fccd-4497-b819-e6469c9e3ec6 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:55.616577 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae631ce-e86d-484b-afeb-22650d349bdc None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:55.663725 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6484a15-4c91-406a-bba5-b325abf3053c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:55.664674 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6484a15-4c91-406a-bba5-b325abf3053c None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:55.664957 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6484a15-4c91-406a-bba5-b325abf3053c None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:55.665271 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6484a15-4c91-406a-bba5-b325abf3053c None admin] PATH_INFO: `/v3/users/1105ddc2f5114ec1be71ec51372bfab7` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:55.667809 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6484a15-4c91-406a-bba5-b325abf3053c None admin] RBAC: Authorizing `identity:get_user(user_id=1105ddc2f5114ec1be71ec51372bfab7)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:55.669263 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6484a15-4c91-406a-bba5-b325abf3053c None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:55.672192 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 129/263] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:23:55 2022] GET /identity/v3/users/1105ddc2f5114ec1be71ec51372bfab7 => generated 283 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:55.682705 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6484a15-4c91-406a-bba5-b325abf3053c None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:55.783997 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2718ad-fccd-4497-b819-e6469c9e3ec6 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:55.850161 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:55.863724 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:55.867407 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc31f2d-0627-4c49-988c-e2cfcc962444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:55.868073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc31f2d-0627-4c49-988c-e2cfcc962444 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:55.868355 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc31f2d-0627-4c49-988c-e2cfcc962444 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:55.868630 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc31f2d-0627-4c49-988c-e2cfcc962444 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:55.899238 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6484a15-4c91-406a-bba5-b325abf3053c None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:55.942190 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc31f2d-0627-4c49-988c-e2cfcc962444 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:55.944050 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc31f2d-0627-4c49-988c-e2cfcc962444 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:55.971256 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cbc368-2bb0-4ff4-8218-22773f60f5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:55.972291 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbc368-2bb0-4ff4-8218-22773f60f5dc None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:55.972777 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbc368-2bb0-4ff4-8218-22773f60f5dc None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:55.973275 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbc368-2bb0-4ff4-8218-22773f60f5dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:56.119665 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cbc368-2bb0-4ff4-8218-22773f60f5dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:56.127374 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cbc368-2bb0-4ff4-8218-22773f60f5dc None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:56.162635 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 135/264] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:23:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 17:23:56.168024 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc31f2d-0627-4c49-988c-e2cfcc962444 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:56.222160 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:56.286139 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:56.342018 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 130/265] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:23:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 660 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 17:23:56.343489 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f27821-4025-41bc-a64b-a0ebb54bf36e None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:56.343980 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f27821-4025-41bc-a64b-a0ebb54bf36e None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:56.344456 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f27821-4025-41bc-a64b-a0ebb54bf36e None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:56.345970 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 131/266] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:23:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:23:56.354689 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f27821-4025-41bc-a64b-a0ebb54bf36e None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:56.366107 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc31f2d-0627-4c49-988c-e2cfcc962444 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:56.400967 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33292d57-02ca-4626-b1e9-842bf762dc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:56.402391 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33292d57-02ca-4626-b1e9-842bf762dc95 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:56.402845 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33292d57-02ca-4626-b1e9-842bf762dc95 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:56.403284 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33292d57-02ca-4626-b1e9-842bf762dc95 None admin] PATH_INFO: `/v3/projects/debcff5d6200462baae7bebc7bb34145` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:56.405166 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33292d57-02ca-4626-b1e9-842bf762dc95 None admin] RBAC: Authorizing `identity:get_project(project_id=debcff5d6200462baae7bebc7bb34145)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:56.406962 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33292d57-02ca-4626-b1e9-842bf762dc95 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:56.409384 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 136/267] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:23:56 2022] GET /identity/v3/projects/debcff5d6200462baae7bebc7bb34145 => generated 302 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:23:56.411201 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6721b-5e58-4f0e-89f6-6cc6113056ba None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:56.411687 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6721b-5e58-4f0e-89f6-6cc6113056ba None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:56.412155 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6721b-5e58-4f0e-89f6-6cc6113056ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:56.430248 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-2bd6721b-5e58-4f0e-89f6-6cc6113056ba None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:23:56.431806 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-2bd6721b-5e58-4f0e-89f6-6cc6113056ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:23:56.547953 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 137/268] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:23:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:23:56.548815 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6721b-5e58-4f0e-89f6-6cc6113056ba None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:56.556619 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f27821-4025-41bc-a64b-a0ebb54bf36e None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:56.593059 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f25003b-45e6-40cd-bb00-8479a30d5587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:56.594441 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f25003b-45e6-40cd-bb00-8479a30d5587 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:56.594864 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f25003b-45e6-40cd-bb00-8479a30d5587 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:56.595428 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f25003b-45e6-40cd-bb00-8479a30d5587 None admin] PATH_INFO: `/v3/projects/debcff5d6200462baae7bebc7bb34145` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:56.596782 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f25003b-45e6-40cd-bb00-8479a30d5587 None admin] RBAC: Authorizing `identity:get_project(project_id=debcff5d6200462baae7bebc7bb34145)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:56.598445 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f25003b-45e6-40cd-bb00-8479a30d5587 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:56.600624 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 132/269] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:23:56 2022] GET /identity/v3/projects/debcff5d6200462baae7bebc7bb34145 => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:56.602108 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f25003b-45e6-40cd-bb00-8479a30d5587 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:56.614000 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:56.662361 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:56.706748 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f25003b-45e6-40cd-bb00-8479a30d5587 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:56.742665 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5fa93-e8b0-47d0-9893-3338deb5ffbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:56.743751 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5fa93-e8b0-47d0-9893-3338deb5ffbb None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:56.744172 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5fa93-e8b0-47d0-9893-3338deb5ffbb None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:56.744587 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5fa93-e8b0-47d0-9893-3338deb5ffbb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:56.756321 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce5fa93-e8b0-47d0-9893-3338deb5ffbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:23:56.765130 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-1ce5fa93-e8b0-47d0-9893-3338deb5ffbb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 17:23:56.765130 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:23:56.765130 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:23:56.765130 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:23:56.765130 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:23:56.765130 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:23:56.765130 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:23:56.765130 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:23:56.765130 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:23:56.765130 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:23:56.765130 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:23:56.765130 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:23:56.765130 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:23:56.765130 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:23:56.765130 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:23:56.765130 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:23:56.766270 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:23:56.766270 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:23:56.766270 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:23:56.766270 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:23:56.766270 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:23:56.766270 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:23:56.766270 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:23:56.766270 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:23:56.766270 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:23:56.766270 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:23:56.766270 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:23:56.766270 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:23:56.766270 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:23:56.766270 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:23:56.766270 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:23:56.766270 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:23:56.767223 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:23:56.767223 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:23:56.767223 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:23:56.767223 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:23:56.767223 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:23:56.767223 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:23:56.767223 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:23:56.767223 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:23:56.767223 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:23:56.767223 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:23:56.767223 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 17:23:56.767223 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:23:56.769390 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 133/270] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:23:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:23:56.770465 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5fa93-e8b0-47d0-9893-3338deb5ffbb None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:56.782269 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6721b-5e58-4f0e-89f6-6cc6113056ba None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:56.816871 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e14600-c77a-435a-b27e-fa4e1bb040ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:56.817925 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e14600-c77a-435a-b27e-fa4e1bb040ba None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:56.818408 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e14600-c77a-435a-b27e-fa4e1bb040ba None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:56.818898 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e14600-c77a-435a-b27e-fa4e1bb040ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:56.819939 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e14600-c77a-435a-b27e-fa4e1bb040ba None admin] RBAC: Adding query filter params (role.id=c9b1f4b47f054f7a8a9a079e65a7197a, scope.project.id=debcff5d6200462baae7bebc7bb34145, user.id=1105ddc2f5114ec1be71ec51372bfab7) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:56.820448 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e14600-c77a-435a-b27e-fa4e1bb040ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:56.822144 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e14600-c77a-435a-b27e-fa4e1bb040ba None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:56.828469 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 138/271] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jul 15 17:23:56 2022] GET /identity/v3/role_assignments?user.id=1105ddc2f5114ec1be71ec51372bfab7&scope.project.id=debcff5d6200462baae7bebc7bb34145&role.id=c9b1f4b47f054f7a8a9a079e65a7197a => generated 608 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:56.830038 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96b269-486b-4e1c-94d1-11dbd3ed2a72 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:56.830531 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96b269-486b-4e1c-94d1-11dbd3ed2a72 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:56.831339 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96b269-486b-4e1c-94d1-11dbd3ed2a72 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:56.836845 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 139/272] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:23:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:23:56.838167 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96b269-486b-4e1c-94d1-11dbd3ed2a72 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:56.878861 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5fa93-e8b0-47d0-9893-3338deb5ffbb None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:56.882203 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:56.914865 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c425b-0330-4b13-ab74-e45b2b809944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:56.915440 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c425b-0330-4b13-ab74-e45b2b809944 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:56.915958 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c425b-0330-4b13-ab74-e45b2b809944 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:56.916426 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c425b-0330-4b13-ab74-e45b2b809944 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:56.917463 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c425b-0330-4b13-ab74-e45b2b809944 None admin] RBAC: Adding query filter params (role.id=70d242b29ede4648b639c7ddae5eaead, scope.project.id=debcff5d6200462baae7bebc7bb34145, user.id=1105ddc2f5114ec1be71ec51372bfab7) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:56.918012 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c425b-0330-4b13-ab74-e45b2b809944 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:56.919698 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c425b-0330-4b13-ab74-e45b2b809944 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:56.926782 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 134/273] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jul 15 17:23:56 2022] GET /identity/v3/role_assignments?user.id=1105ddc2f5114ec1be71ec51372bfab7&scope.project.id=debcff5d6200462baae7bebc7bb34145&role.id=70d242b29ede4648b639c7ddae5eaead => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:56.928499 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad9ae6-2d15-4336-b060-3985feb443a2 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:56.928997 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad9ae6-2d15-4336-b060-3985feb443a2 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:56.929462 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad9ae6-2d15-4336-b060-3985feb443a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:56.938180 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:56.949718 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-a5ad9ae6-2d15-4336-b060-3985feb443a2 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:23:56.951530 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-a5ad9ae6-2d15-4336-b060-3985feb443a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:23:56.988897 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96b269-486b-4e1c-94d1-11dbd3ed2a72 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:57.054803 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a57fc-2235-4b4c-82a1-41e737d9028f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:57.055930 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a57fc-2235-4b4c-82a1-41e737d9028f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:57.056415 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a57fc-2235-4b4c-82a1-41e737d9028f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:57.056889 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a57fc-2235-4b4c-82a1-41e737d9028f None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:57.058087 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a57fc-2235-4b4c-82a1-41e737d9028f None admin] RBAC: Adding query filter params (name=member) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:57.058627 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a57fc-2235-4b4c-82a1-41e737d9028f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:57.060822 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a57fc-2235-4b4c-82a1-41e737d9028f None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:57.071809 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 140/274] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jul 15 17:23:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:57.073643 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7499bcb-83dd-44a1-bd1d-6ba0e400c1a9 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:57.074169 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7499bcb-83dd-44a1-bd1d-6ba0e400c1a9 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:57.075104 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7499bcb-83dd-44a1-bd1d-6ba0e400c1a9 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:57.077279 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 141/275] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:23:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:23:57.084954 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 135/276] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:23:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:23:57.087419 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7499bcb-83dd-44a1-bd1d-6ba0e400c1a9 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:57.088670 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4718c-fde5-459a-9b30-92b0c6230caa None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:57.089119 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4718c-fde5-459a-9b30-92b0c6230caa None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:57.089530 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4718c-fde5-459a-9b30-92b0c6230caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:57.123707 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-98e4718c-fde5-459a-9b30-92b0c6230caa None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:23:57.125679 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-98e4718c-fde5-459a-9b30-92b0c6230caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:23:57.222405 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7499bcb-83dd-44a1-bd1d-6ba0e400c1a9 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:57.222892 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 136/277] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:23:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:23:57.223263 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e4718c-fde5-459a-9b30-92b0c6230caa None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:57.254509 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:57.264088 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d5e89-f526-48d8-a336-1ba0851f29e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:57.265013 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d5e89-f526-48d8-a336-1ba0851f29e4 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:57.265303 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d5e89-f526-48d8-a336-1ba0851f29e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:57.265576 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d5e89-f526-48d8-a336-1ba0851f29e4 None admin] PATH_INFO: `/v3/users/3cb05cbbc4244cbe900c15ef994df859` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:57.281488 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07d5e89-f526-48d8-a336-1ba0851f29e4 None admin] RBAC: Authorizing `identity:get_user(user_id=3cb05cbbc4244cbe900c15ef994df859)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:57.282998 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07d5e89-f526-48d8-a336-1ba0851f29e4 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:57.284878 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 142/278] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:23:57 2022] GET /identity/v3/users/3cb05cbbc4244cbe900c15ef994df859 => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:57.286198 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dac4e2-fa4d-4fa3-a876-3bb8ed68159c None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:57.286479 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dac4e2-fa4d-4fa3-a876-3bb8ed68159c None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:57.286749 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dac4e2-fa4d-4fa3-a876-3bb8ed68159c None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:57.287968 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 143/279] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:23:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:23:57.288644 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dac4e2-fa4d-4fa3-a876-3bb8ed68159c None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:57.299750 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:57.334629 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e4718c-fde5-459a-9b30-92b0c6230caa None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:57.368237 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d0b03-6b45-4fe1-a33a-753c3210197c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:57.369059 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d0b03-6b45-4fe1-a33a-753c3210197c None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:57.369331 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d0b03-6b45-4fe1-a33a-753c3210197c None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:57.369598 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d0b03-6b45-4fe1-a33a-753c3210197c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:57.370789 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888d0b03-6b45-4fe1-a33a-753c3210197c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:57.372243 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888d0b03-6b45-4fe1-a33a-753c3210197c None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:57.374263 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 137/280] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:23:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:57.375220 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d0b03-6b45-4fe1-a33a-753c3210197c None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:57.395569 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dac4e2-fa4d-4fa3-a876-3bb8ed68159c None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:57.429392 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd1d4d-82b0-40cb-978e-b8bdbf135d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:57.430226 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd1d4d-82b0-40cb-978e-b8bdbf135d15 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:57.430502 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd1d4d-82b0-40cb-978e-b8bdbf135d15 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:57.430771 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd1d4d-82b0-40cb-978e-b8bdbf135d15 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:57.441508 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd1d4d-82b0-40cb-978e-b8bdbf135d15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:23:57.449231 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-4cbd1d4d-82b0-40cb-978e-b8bdbf135d15 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 17:23:57.449231 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:23:57.449231 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:23:57.449231 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:23:57.449231 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:23:57.449231 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:23:57.449231 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:23:57.449231 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:23:57.449231 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:23:57.449231 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:23:57.449231 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:23:57.449231 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:23:57.449231 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:23:57.449231 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:23:57.449231 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:23:57.449231 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:23:57.450130 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:23:57.450130 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:23:57.450130 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:23:57.450130 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:23:57.450130 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:23:57.450130 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:23:57.450130 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:23:57.450130 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:23:57.450130 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:23:57.450130 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:23:57.450130 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:23:57.450130 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:23:57.450130 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:23:57.450130 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:23:57.450130 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:23:57.450130 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:23:57.450904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:23:57.450904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:23:57.450904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:23:57.450904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:23:57.450904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:23:57.450904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:23:57.450904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:23:57.450904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:23:57.450904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:23:57.450904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:23:57.450904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 17:23:57.450904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:23:57.450904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 144/281] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:23:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:23:57.451753 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d291705-9e02-4577-a8ac-f7d5d05ab5ed None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:57.452000 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d291705-9e02-4577-a8ac-f7d5d05ab5ed None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:57.452229 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d291705-9e02-4577-a8ac-f7d5d05ab5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:57.468646 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-4d291705-9e02-4577-a8ac-f7d5d05ab5ed None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:23:57.469819 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-4d291705-9e02-4577-a8ac-f7d5d05ab5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:23:57.471432 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:57.478511 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d0b03-6b45-4fe1-a33a-753c3210197c None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:57.511607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf4791-27a6-41f9-9608-6711eabace03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:57.512258 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf4791-27a6-41f9-9608-6711eabace03 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:57.512533 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf4791-27a6-41f9-9608-6711eabace03 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:57.512801 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf4791-27a6-41f9-9608-6711eabace03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:57.513608 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf4791-27a6-41f9-9608-6711eabace03 None admin] RBAC: Adding query filter params (role.id=d8d52b8fc62e44cd9d551b855f2ac84b, user.id=3cb05cbbc4244cbe900c15ef994df859, scope.system=all) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:57.513941 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf4791-27a6-41f9-9608-6711eabace03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:57.515439 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf4791-27a6-41f9-9608-6711eabace03 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:57.520535 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 138/282] 10.222.0.27 () {56 vars in 1308 bytes} [Fri Jul 15 17:23:57 2022] GET /identity/v3/role_assignments?user.id=3cb05cbbc4244cbe900c15ef994df859&scope.system=all&role.id=d8d52b8fc62e44cd9d551b855f2ac84b => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:57.521170 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf4791-27a6-41f9-9608-6711eabace03 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:57.543649 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:57.554049 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 145/283] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:23:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:23:57.555758 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d291705-9e02-4577-a8ac-f7d5d05ab5ed None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:57.634801 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf4791-27a6-41f9-9608-6711eabace03 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:57.669794 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d291705-9e02-4577-a8ac-f7d5d05ab5ed None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:57.672267 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c891be-010b-43d4-b980-c956fd7f1418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:57.673052 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c891be-010b-43d4-b980-c956fd7f1418 None admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:57.673233 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c891be-010b-43d4-b980-c956fd7f1418 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:57.673482 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c891be-010b-43d4-b980-c956fd7f1418 None admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:57.674442 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c891be-010b-43d4-b980-c956fd7f1418 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:57.676634 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c891be-010b-43d4-b980-c956fd7f1418 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:57.706157 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 139/284] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Jul 15 17:23:57 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:23:57.706988 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d980b4-b59b-4352-a9f8-926b92f00984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:57.707138 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c891be-010b-43d4-b980-c956fd7f1418 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:57.708023 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d980b4-b59b-4352-a9f8-926b92f00984 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:57.708513 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d980b4-b59b-4352-a9f8-926b92f00984 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:57.708850 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d980b4-b59b-4352-a9f8-926b92f00984 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:57.709690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d980b4-b59b-4352-a9f8-926b92f00984 None admin] RBAC: Adding query filter params (name=member) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:57.710127 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d980b4-b59b-4352-a9f8-926b92f00984 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:57.711678 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d980b4-b59b-4352-a9f8-926b92f00984 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:57.722010 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 146/285] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jul 15 17:23:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:57.727976 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d980b4-b59b-4352-a9f8-926b92f00984 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:57.743953 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:57.804900 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:57.858355 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d980b4-b59b-4352-a9f8-926b92f00984 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:57.881848 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c891be-010b-43d4-b980-c956fd7f1418 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:57.903135 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46d21b-f8d6-43b0-8ea1-984e84b89c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:57.904017 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46d21b-f8d6-43b0-8ea1-984e84b89c61 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:57.904301 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46d21b-f8d6-43b0-8ea1-984e84b89c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:57.905028 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46d21b-f8d6-43b0-8ea1-984e84b89c61 None admin] PATH_INFO: `/v3/users/2b76691221aa40a3a9087c084a47247d` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:57.906666 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a46d21b-f8d6-43b0-8ea1-984e84b89c61 None admin] RBAC: Authorizing `identity:get_user(user_id=2b76691221aa40a3a9087c084a47247d)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:57.908634 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a46d21b-f8d6-43b0-8ea1-984e84b89c61 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:57.911402 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 147/286] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:23:57 2022] GET /identity/v3/users/2b76691221aa40a3a9087c084a47247d => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:57.916906 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46d21b-f8d6-43b0-8ea1-984e84b89c61 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:57.923261 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90849562-167f-4987-ac23-02e8c6583a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:57.924077 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90849562-167f-4987-ac23-02e8c6583a97 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:57.924354 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90849562-167f-4987-ac23-02e8c6583a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:57.924623 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90849562-167f-4987-ac23-02e8c6583a97 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:57.936183 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90849562-167f-4987-ac23-02e8c6583a97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:23:57.944295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-90849562-167f-4987-ac23-02e8c6583a97 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 17:23:57.944295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:23:57.944295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:23:57.944295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:23:57.944295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:23:57.944295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:23:57.944295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:23:57.944295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:23:57.944295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:23:57.944295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:23:57.944295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:23:57.944295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:23:57.944295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:23:57.944295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:23:57.944295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:23:57.944295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:23:57.945200 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:23:57.945200 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:23:57.945200 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:23:57.945200 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:23:57.945200 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:23:57.945200 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:23:57.945200 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:23:57.945200 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:23:57.945200 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:23:57.945200 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:23:57.945200 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:23:57.945200 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:23:57.945200 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:23:57.945200 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:23:57.945200 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:23:57.945200 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:23:57.946133 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:23:57.946133 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:23:57.946133 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:23:57.946133 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:23:57.946133 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:23:57.946133 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:23:57.946133 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:23:57.946133 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:23:57.946133 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:23:57.946133 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:23:57.946133 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 17:23:57.946133 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:23:57.946133 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 140/287] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:23:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:23:57.951944 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90849562-167f-4987-ac23-02e8c6583a97 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:58.040627 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46d21b-f8d6-43b0-8ea1-984e84b89c61 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:58.050055 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:58.078448 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:58.086849 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90849562-167f-4987-ac23-02e8c6583a97 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:58.087006 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea7efa-92fe-45aa-bee3-5cfec93c91e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:58.087577 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea7efa-92fe-45aa-bee3-5cfec93c91e7 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:58.087859 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea7efa-92fe-45aa-bee3-5cfec93c91e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:58.088132 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea7efa-92fe-45aa-bee3-5cfec93c91e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:58.126780 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e68cde-6ebb-482d-8a23-0216301d819d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:58.127308 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e68cde-6ebb-482d-8a23-0216301d819d None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:58.127557 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e68cde-6ebb-482d-8a23-0216301d819d None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:58.127872 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e68cde-6ebb-482d-8a23-0216301d819d None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:58.128663 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e68cde-6ebb-482d-8a23-0216301d819d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:58.128974 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e68cde-6ebb-482d-8a23-0216301d819d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:58.130414 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e68cde-6ebb-482d-8a23-0216301d819d None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:58.139775 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 141/288] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jul 15 17:23:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:58.144891 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e68cde-6ebb-482d-8a23-0216301d819d None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:58.165506 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea7efa-92fe-45aa-bee3-5cfec93c91e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:58.167379 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea7efa-92fe-45aa-bee3-5cfec93c91e7 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:58.259039 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e68cde-6ebb-482d-8a23-0216301d819d None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:58.277773 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 148/289] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:23:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 17:23:58.284170 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea7efa-92fe-45aa-bee3-5cfec93c91e7 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:58.297832 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47181bb6-b7cc-4089-8e98-ff09e8f82fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:58.298785 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47181bb6-b7cc-4089-8e98-ff09e8f82fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:58.299140 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47181bb6-b7cc-4089-8e98-ff09e8f82fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:58.299444 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47181bb6-b7cc-4089-8e98-ff09e8f82fd8 None admin] PATH_INFO: `/v3/users/fdec723e1b4840ef89efcd8129e0c68b` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:58.300789 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47181bb6-b7cc-4089-8e98-ff09e8f82fd8 None admin] RBAC: Authorizing `identity:get_user(user_id=fdec723e1b4840ef89efcd8129e0c68b)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:58.302563 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47181bb6-b7cc-4089-8e98-ff09e8f82fd8 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:58.304662 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 142/290] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:23:58 2022] GET /identity/v3/users/fdec723e1b4840ef89efcd8129e0c68b => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:58.319708 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47181bb6-b7cc-4089-8e98-ff09e8f82fd8 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:58.322661 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:58.326549 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:58.402584 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea7efa-92fe-45aa-bee3-5cfec93c91e7 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:58.439380 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a10c20-45e4-4e44-9479-59dcf16f6c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:58.440721 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a10c20-45e4-4e44-9479-59dcf16f6c4f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:58.441296 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a10c20-45e4-4e44-9479-59dcf16f6c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:58.441830 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a10c20-45e4-4e44-9479-59dcf16f6c4f None admin] PATH_INFO: `/v3/projects/debcff5d6200462baae7bebc7bb34145` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:58.443279 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a10c20-45e4-4e44-9479-59dcf16f6c4f None admin] RBAC: Authorizing `identity:get_project(project_id=debcff5d6200462baae7bebc7bb34145)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:58.445182 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a10c20-45e4-4e44-9479-59dcf16f6c4f None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:58.447475 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 149/291] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:23:58 2022] GET /identity/v3/projects/debcff5d6200462baae7bebc7bb34145 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:23:58.453821 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a10c20-45e4-4e44-9479-59dcf16f6c4f None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:58.481807 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47181bb6-b7cc-4089-8e98-ff09e8f82fd8 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:58.508976 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45bdd5c-1e97-4049-8906-f7eb0326e85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:58.509884 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bdd5c-1e97-4049-8906-f7eb0326e85d None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:58.510163 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bdd5c-1e97-4049-8906-f7eb0326e85d None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:58.510432 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bdd5c-1e97-4049-8906-f7eb0326e85d None admin] PATH_INFO: `/v3/projects/debcff5d6200462baae7bebc7bb34145` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:58.511605 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45bdd5c-1e97-4049-8906-f7eb0326e85d None admin] RBAC: Authorizing `identity:get_project(project_id=debcff5d6200462baae7bebc7bb34145)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:58.513037 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45bdd5c-1e97-4049-8906-f7eb0326e85d None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:58.515104 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 143/292] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:23:58 2022] GET /identity/v3/projects/debcff5d6200462baae7bebc7bb34145 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:58.520695 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45bdd5c-1e97-4049-8906-f7eb0326e85d None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:58.638241 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:58.643475 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a10c20-45e4-4e44-9479-59dcf16f6c4f None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:58.650159 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:23:58.657244 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45bdd5c-1e97-4049-8906-f7eb0326e85d None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:58.709406 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf3b5c-851c-40ab-9c58-2a5e3a8eabb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:58.710096 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf3b5c-851c-40ab-9c58-2a5e3a8eabb5 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:58.710373 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf3b5c-851c-40ab-9c58-2a5e3a8eabb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:58.710645 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf3b5c-851c-40ab-9c58-2a5e3a8eabb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:58.711486 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cf3b5c-851c-40ab-9c58-2a5e3a8eabb5 None admin] RBAC: Adding query filter params (role.id=d8d52b8fc62e44cd9d551b855f2ac84b, scope.project.id=debcff5d6200462baae7bebc7bb34145, user.id=2b76691221aa40a3a9087c084a47247d) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:23:58.711796 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cf3b5c-851c-40ab-9c58-2a5e3a8eabb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:58.713224 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cf3b5c-851c-40ab-9c58-2a5e3a8eabb5 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:58.722069 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b6142-c9e7-48f8-a18e-7c33cd608f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:58.722976 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b6142-c9e7-48f8-a18e-7c33cd608f20 None admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:58.723252 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b6142-c9e7-48f8-a18e-7c33cd608f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:58.723518 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b6142-c9e7-48f8-a18e-7c33cd608f20 None admin] PATH_INFO: `/v3/projects/debcff5d6200462baae7bebc7bb34145/users/fdec723e1b4840ef89efcd8129e0c68b/roles/a3a3c02087374a9086cf0d79e6118247` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:58.726381 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 150/293] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jul 15 17:23:58 2022] GET /identity/v3/role_assignments?user.id=2b76691221aa40a3a9087c084a47247d&scope.project.id=debcff5d6200462baae7bebc7bb34145&role.id=d8d52b8fc62e44cd9d551b855f2ac84b => generated 608 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:23:58.734881 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b6142-c9e7-48f8-a18e-7c33cd608f20 None admin] RBAC: Authorizing `identity:create_grant(project_id=debcff5d6200462baae7bebc7bb34145, user_id=fdec723e1b4840ef89efcd8129e0c68b, role_id=a3a3c02087374a9086cf0d79e6118247)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:23:58.736380 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b6142-c9e7-48f8-a18e-7c33cd608f20 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:23:58.773287 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 144/294] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Jul 15 17:23:58 2022] PUT /identity/v3/projects/debcff5d6200462baae7bebc7bb34145/users/fdec723e1b4840ef89efcd8129e0c68b/roles/a3a3c02087374a9086cf0d79e6118247 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:23:59.713213 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460289b-a819-4c51-8d8e-25cc9761b7ef None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:59.713706 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460289b-a819-4c51-8d8e-25cc9761b7ef None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:59.713706 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460289b-a819-4c51-8d8e-25cc9761b7ef None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:59.715352 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 151/295] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:23:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:23:59.720884 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479d787-a73e-4041-8be5-e0f9b1d84b28 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:59.721680 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479d787-a73e-4041-8be5-e0f9b1d84b28 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:59.722170 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479d787-a73e-4041-8be5-e0f9b1d84b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:59.739597 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-c479d787-a73e-4041-8be5-e0f9b1d84b28 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:23:59.741086 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-c479d787-a73e-4041-8be5-e0f9b1d84b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:23:59.806233 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 145/296] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:23:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:23:59.828192 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460289b-a819-4c51-8d8e-25cc9761b7ef None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:23:59.930919 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460289b-a819-4c51-8d8e-25cc9761b7ef None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:23:59.966888 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e517a-0e49-477e-93ca-9375ae4ac6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:23:59.968107 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e517a-0e49-477e-93ca-9375ae4ac6fb None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:23:59.968582 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e517a-0e49-477e-93ca-9375ae4ac6fb None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:23:59.969050 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e517a-0e49-477e-93ca-9375ae4ac6fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:23:59.979764 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e517a-0e49-477e-93ca-9375ae4ac6fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:23:59.987944 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-163e517a-0e49-477e-93ca-9375ae4ac6fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 17:23:59.987944 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:23:59.987944 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:23:59.987944 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:23:59.987944 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:23:59.987944 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:23:59.987944 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:23:59.987944 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:23:59.987944 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:23:59.987944 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:23:59.987944 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:23:59.987944 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:23:59.987944 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:23:59.987944 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:23:59.987944 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:23:59.987944 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:23:59.988807 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:23:59.988807 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:23:59.988807 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:23:59.988807 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:23:59.988807 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:23:59.988807 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:23:59.988807 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:23:59.988807 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:23:59.988807 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:23:59.988807 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:23:59.988807 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:23:59.988807 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:23:59.988807 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:23:59.988807 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:23:59.988807 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:23:59.988807 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:23:59.989596 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:23:59.989596 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:23:59.989596 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:23:59.989596 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:23:59.989596 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:23:59.989596 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:23:59.989596 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:23:59.989596 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:23:59.989596 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:23:59.989596 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:23:59.989596 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 17:23:59.989596 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:23:59.991989 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 152/297] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:23:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:23:59.998192 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479d787-a73e-4041-8be5-e0f9b1d84b28 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:00.061467 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:00.089918 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cc48a-307e-4f4b-943d-9912f4d14885 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:00.090224 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cc48a-307e-4f4b-943d-9912f4d14885 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:00.090476 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cc48a-307e-4f4b-943d-9912f4d14885 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:00.091993 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 153/298] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 17:24:00.097048 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f902567-eae6-4c40-964c-254299bd2898 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:00.097330 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f902567-eae6-4c40-964c-254299bd2898 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:00.097602 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f902567-eae6-4c40-964c-254299bd2898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:00.102877 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479d787-a73e-4041-8be5-e0f9b1d84b28 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:00.114342 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-2f902567-eae6-4c40-964c-254299bd2898 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:00.115533 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-2f902567-eae6-4c40-964c-254299bd2898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:00.130144 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:00.144757 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b0f1d-7aed-46f2-818b-63bacbc42d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:00.145698 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b0f1d-7aed-46f2-818b-63bacbc42d65 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:00.146002 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b0f1d-7aed-46f2-818b-63bacbc42d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:00.146275 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b0f1d-7aed-46f2-818b-63bacbc42d65 None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:00.147187 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2b0f1d-7aed-46f2-818b-63bacbc42d65 None admin] RBAC: Adding query filter params (name=member) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:00.147783 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2b0f1d-7aed-46f2-818b-63bacbc42d65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:00.149506 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2b0f1d-7aed-46f2-818b-63bacbc42d65 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:00.159942 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 146/299] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jul 15 17:23:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:00.165541 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b0f1d-7aed-46f2-818b-63bacbc42d65 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:00.189145 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 154/300] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 17:24:00.212231 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f902567-eae6-4c40-964c-254299bd2898 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:00.269695 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b0f1d-7aed-46f2-818b-63bacbc42d65 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:00.294108 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:00.306729 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790db8a-3ae1-465e-b673-01611ff99a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:00.307618 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790db8a-3ae1-465e-b673-01611ff99a95 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:00.307897 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790db8a-3ae1-465e-b673-01611ff99a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:00.308166 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790db8a-3ae1-465e-b673-01611ff99a95 None admin] PATH_INFO: `/v3/users/3cb05cbbc4244cbe900c15ef994df859` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:00.309591 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790db8a-3ae1-465e-b673-01611ff99a95 None admin] RBAC: Authorizing `identity:get_user(user_id=3cb05cbbc4244cbe900c15ef994df859)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:00.311136 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790db8a-3ae1-465e-b673-01611ff99a95 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:00.312950 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 147/301] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:24:00 2022] GET /identity/v3/users/3cb05cbbc4244cbe900c15ef994df859 => generated 293 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:00.316934 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea8cda-8b74-4948-b1c3-3cd871753e3e None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:00.316934 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea8cda-8b74-4948-b1c3-3cd871753e3e None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:00.316934 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea8cda-8b74-4948-b1c3-3cd871753e3e None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:00.316934 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 148/302] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:00.319674 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f902567-eae6-4c40-964c-254299bd2898 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:00.323589 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea8cda-8b74-4948-b1c3-3cd871753e3e None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:00.355007 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e9ea28-2e1f-4a5d-be78-b6563261675e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:00.355809 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9ea28-2e1f-4a5d-be78-b6563261675e None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:00.356085 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9ea28-2e1f-4a5d-be78-b6563261675e None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:00.356352 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9ea28-2e1f-4a5d-be78-b6563261675e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:00.367389 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e9ea28-2e1f-4a5d-be78-b6563261675e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:24:00.375187 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-d9e9ea28-2e1f-4a5d-be78-b6563261675e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 17:24:00.375187 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:00.375187 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:00.375187 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:00.375187 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:00.375187 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:00.375187 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:00.375187 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:00.375187 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:00.375187 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:00.375187 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:00.375187 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:00.375187 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:24:00.375187 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:24:00.375187 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:24:00.375187 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:24:00.376075 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:24:00.376075 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:24:00.376075 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:24:00.376075 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:24:00.376075 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:00.376075 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:00.376075 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:00.376075 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:00.376075 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:00.376075 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:00.376075 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:00.376075 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:00.376075 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:00.376075 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:00.376075 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:00.376075 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:00.377277 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:00.377277 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:00.377277 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:00.377277 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:00.377277 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:24:00.377277 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:24:00.377277 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:24:00.377277 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:24:00.377277 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:24:00.377277 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:24:00.377277 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 17:24:00.377277 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:00.377277 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 155/303] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:24:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 17:24:00.378172 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d032293-a9b2-4a0d-b37b-d47607d0b617 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:00.378172 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d032293-a9b2-4a0d-b37b-d47607d0b617 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:00.378494 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d032293-a9b2-4a0d-b37b-d47607d0b617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:00.394644 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-7d032293-a9b2-4a0d-b37b-d47607d0b617 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:00.395806 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7d032293-a9b2-4a0d-b37b-d47607d0b617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:00.399732 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:00.438656 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea8cda-8b74-4948-b1c3-3cd871753e3e None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:00.467388 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 156/304] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:24:00.468877 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d032293-a9b2-4a0d-b37b-d47607d0b617 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:00.479509 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d5b1d-077c-4ca7-a318-da4f7db4ecc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:00.480852 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d5b1d-077c-4ca7-a318-da4f7db4ecc0 None admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:00.481129 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d5b1d-077c-4ca7-a318-da4f7db4ecc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:00.481402 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d5b1d-077c-4ca7-a318-da4f7db4ecc0 None admin] PATH_INFO: `/v3/system/users/3cb05cbbc4244cbe900c15ef994df859/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:00.483782 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d5b1d-077c-4ca7-a318-da4f7db4ecc0 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3cb05cbbc4244cbe900c15ef994df859, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:00.485406 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d5b1d-077c-4ca7-a318-da4f7db4ecc0 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:00.496026 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 149/305] 10.222.0.27 () {58 vars in 1334 bytes} [Fri Jul 15 17:24:00 2022] PUT /identity/v3/system/users/3cb05cbbc4244cbe900c15ef994df859/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:24:00.496989 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d5b1d-077c-4ca7-a318-da4f7db4ecc0 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:00.562671 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:00.598002 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d032293-a9b2-4a0d-b37b-d47607d0b617 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:00.614309 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d5b1d-077c-4ca7-a318-da4f7db4ecc0 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:00.638288 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e645b-91b5-426f-9395-0fe08896bee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:00.639601 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e645b-91b5-426f-9395-0fe08896bee0 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:00.640080 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e645b-91b5-426f-9395-0fe08896bee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:00.640591 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e645b-91b5-426f-9395-0fe08896bee0 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:00.641560 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e645b-91b5-426f-9395-0fe08896bee0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:00.642084 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e645b-91b5-426f-9395-0fe08896bee0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:00.644100 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e645b-91b5-426f-9395-0fe08896bee0 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:00.651823 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c7a566-9327-44fa-8951-0c3998685455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:00.652645 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c7a566-9327-44fa-8951-0c3998685455 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:00.652923 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c7a566-9327-44fa-8951-0c3998685455 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:00.653198 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c7a566-9327-44fa-8951-0c3998685455 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:00.654443 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c7a566-9327-44fa-8951-0c3998685455 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:00.659955 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c7a566-9327-44fa-8951-0c3998685455 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:00.660786 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 157/307] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jul 15 17:24:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:00.662040 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e645b-91b5-426f-9395-0fe08896bee0 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:00.662401 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 150/307] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:00.663386 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c7a566-9327-44fa-8951-0c3998685455 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:00.666095 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:00.771615 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e645b-91b5-426f-9395-0fe08896bee0 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:00.805824 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c7a566-9327-44fa-8951-0c3998685455 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:00.810491 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420047d-0747-4a50-8dfd-246823870848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:00.811464 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420047d-0747-4a50-8dfd-246823870848 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:00.811744 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420047d-0747-4a50-8dfd-246823870848 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:00.812016 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420047d-0747-4a50-8dfd-246823870848 None admin] PATH_INFO: `/v3/users/fcdeb70d5e0f4001ab25ad50ea9b375e` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:00.825928 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9420047d-0747-4a50-8dfd-246823870848 None admin] RBAC: Authorizing `identity:get_user(user_id=fcdeb70d5e0f4001ab25ad50ea9b375e)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:00.827356 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9420047d-0747-4a50-8dfd-246823870848 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:00.829255 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 158/308] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:24:00 2022] GET /identity/v3/users/fcdeb70d5e0f4001ab25ad50ea9b375e => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:00.834390 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:00.835235 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420047d-0747-4a50-8dfd-246823870848 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:00.848378 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b02586-226f-4309-a3e3-fad796130df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:00.849451 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b02586-226f-4309-a3e3-fad796130df4 None admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:00.850015 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b02586-226f-4309-a3e3-fad796130df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:00.850294 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b02586-226f-4309-a3e3-fad796130df4 None admin] PATH_INFO: `/v3/groups` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:00.850995 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b02586-226f-4309-a3e3-fad796130df4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:00.853147 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b02586-226f-4309-a3e3-fad796130df4 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:00.873729 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 151/309] 10.222.0.27 () {60 vars in 1134 bytes} [Fri Jul 15 17:24:00 2022] POST /identity/v3/groups => generated 229 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:24:00.909319 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:00.937861 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4dbef-00f3-4c12-a999-fc824f3fff05 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:00.938373 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4dbef-00f3-4c12-a999-fc824f3fff05 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:00.938475 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4dbef-00f3-4c12-a999-fc824f3fff05 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:00.940087 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 152/310] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 17:24:00.947470 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609f51c-bfc2-4c0e-89e3-df466a0e0363 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:00.947904 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609f51c-bfc2-4c0e-89e3-df466a0e0363 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:00.948283 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609f51c-bfc2-4c0e-89e3-df466a0e0363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:00.957271 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420047d-0747-4a50-8dfd-246823870848 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:00.967362 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-a609f51c-bfc2-4c0e-89e3-df466a0e0363 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:00.968863 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-a609f51c-bfc2-4c0e-89e3-df466a0e0363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:00.994900 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ccdbe8-d083-40d2-beec-89d3038339fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:00.995688 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccdbe8-d083-40d2-beec-89d3038339fd None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:00.995971 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccdbe8-d083-40d2-beec-89d3038339fd None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:00.996337 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccdbe8-d083-40d2-beec-89d3038339fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:00.997192 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ccdbe8-d083-40d2-beec-89d3038339fd None admin] RBAC: Adding query filter params (role.id=a3a3c02087374a9086cf0d79e6118247, user.id=fcdeb70d5e0f4001ab25ad50ea9b375e, scope.system=all) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:00.997503 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ccdbe8-d083-40d2-beec-89d3038339fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:00.999247 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ccdbe8-d083-40d2-beec-89d3038339fd None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:01.006169 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 159/311] 10.222.0.27 () {56 vars in 1308 bytes} [Fri Jul 15 17:24:00 2022] GET /identity/v3/role_assignments?user.id=fcdeb70d5e0f4001ab25ad50ea9b375e&scope.system=all&role.id=a3a3c02087374a9086cf0d79e6118247 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:24:01.049353 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 153/312] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 17:24:01.071372 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ccdbe8-d083-40d2-beec-89d3038339fd None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:01.182088 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ccdbe8-d083-40d2-beec-89d3038339fd None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:01.206679 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:01.217756 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c5a87-484f-47f4-b46c-f99ef2e96194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:01.218773 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c5a87-484f-47f4-b46c-f99ef2e96194 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:01.219126 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c5a87-484f-47f4-b46c-f99ef2e96194 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:01.219551 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c5a87-484f-47f4-b46c-f99ef2e96194 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:01.230493 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c5a87-484f-47f4-b46c-f99ef2e96194 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:24:01.238620 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-470c5a87-484f-47f4-b46c-f99ef2e96194 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 17:24:01.238620 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:01.238620 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:01.238620 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:01.238620 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:01.238620 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:01.238620 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:01.238620 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:01.238620 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:01.238620 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:01.238620 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:01.238620 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:01.238620 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:24:01.238620 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:24:01.238620 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:24:01.238620 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:24:01.239511 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:24:01.239511 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:24:01.239511 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:24:01.239511 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:24:01.239511 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:01.239511 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:01.239511 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:01.239511 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:01.239511 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:01.239511 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:01.239511 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:01.239511 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:01.239511 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:01.239511 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:01.239511 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:01.239511 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:01.240310 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:01.240310 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:01.240310 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:01.240310 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:01.240310 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:24:01.240310 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:24:01.240310 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:24:01.240310 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:24:01.240310 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:24:01.240310 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:24:01.240310 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 17:24:01.240310 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:01.240310 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 160/313] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:24:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:01.247416 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609f51c-bfc2-4c0e-89e3-df466a0e0363 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:01.351706 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609f51c-bfc2-4c0e-89e3-df466a0e0363 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:01.366025 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:01.387471 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6abd5-756a-491a-9686-4d53e1c69eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:01.388459 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6abd5-756a-491a-9686-4d53e1c69eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:01.388953 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6abd5-756a-491a-9686-4d53e1c69eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:01.389476 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6abd5-756a-491a-9686-4d53e1c69eb2 None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:01.390657 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e6abd5-756a-491a-9686-4d53e1c69eb2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:01.391155 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e6abd5-756a-491a-9686-4d53e1c69eb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:01.392747 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e6abd5-756a-491a-9686-4d53e1c69eb2 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:01.401695 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 154/314] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jul 15 17:24:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:01.408187 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c5a87-484f-47f4-b46c-f99ef2e96194 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:01.515568 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c5a87-484f-47f4-b46c-f99ef2e96194 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:01.550282 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b4fcc-8808-4426-bdcd-fce75964f463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:01.551172 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b4fcc-8808-4426-bdcd-fce75964f463 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:01.551452 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b4fcc-8808-4426-bdcd-fce75964f463 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:01.551727 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b4fcc-8808-4426-bdcd-fce75964f463 None admin] PATH_INFO: `/v3/users/fdec723e1b4840ef89efcd8129e0c68b` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:01.552932 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b4fcc-8808-4426-bdcd-fce75964f463 None admin] RBAC: Authorizing `identity:get_user(user_id=fdec723e1b4840ef89efcd8129e0c68b)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:01.554474 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b4fcc-8808-4426-bdcd-fce75964f463 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:01.556363 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 161/315] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:24:01 2022] GET /identity/v3/users/fdec723e1b4840ef89efcd8129e0c68b => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:01.561815 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6abd5-756a-491a-9686-4d53e1c69eb2 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:01.662941 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6abd5-756a-491a-9686-4d53e1c69eb2 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:01.699054 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a600c3dc-f5b5-4de1-9c2b-83f1d129e40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:01.700080 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600c3dc-f5b5-4de1-9c2b-83f1d129e40e None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:01.700551 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600c3dc-f5b5-4de1-9c2b-83f1d129e40e None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:01.701035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600c3dc-f5b5-4de1-9c2b-83f1d129e40e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:01.747972 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:01.771213 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a600c3dc-f5b5-4de1-9c2b-83f1d129e40e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:01.772684 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a600c3dc-f5b5-4de1-9c2b-83f1d129e40e None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:01.869158 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 155/316] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:24:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 17:24:01.874675 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b4fcc-8808-4426-bdcd-fce75964f463 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:01.928771 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:01.979636 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b4fcc-8808-4426-bdcd-fce75964f463 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:02.013824 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3a05d-1d3e-4a27-aa48-63a6a69d62f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:02.014802 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3a05d-1d3e-4a27-aa48-63a6a69d62f0 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:02.015080 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3a05d-1d3e-4a27-aa48-63a6a69d62f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:02.015353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3a05d-1d3e-4a27-aa48-63a6a69d62f0 None admin] PATH_INFO: `/v3/projects/debcff5d6200462baae7bebc7bb34145` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:02.016561 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a3a05d-1d3e-4a27-aa48-63a6a69d62f0 None admin] RBAC: Authorizing `identity:get_project(project_id=debcff5d6200462baae7bebc7bb34145)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:02.018064 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a3a05d-1d3e-4a27-aa48-63a6a69d62f0 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:02.020063 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 162/317] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:24:01 2022] GET /identity/v3/projects/debcff5d6200462baae7bebc7bb34145 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:02.025955 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a600c3dc-f5b5-4de1-9c2b-83f1d129e40e None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:02.104849 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:02.133081 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a600c3dc-f5b5-4de1-9c2b-83f1d129e40e None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:02.168492 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ffb38e-349a-48aa-9a25-ba4df9368062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:02.169503 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffb38e-349a-48aa-9a25-ba4df9368062 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:02.169997 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffb38e-349a-48aa-9a25-ba4df9368062 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:02.170493 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffb38e-349a-48aa-9a25-ba4df9368062 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:02.171571 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ffb38e-349a-48aa-9a25-ba4df9368062 None admin] RBAC: Adding query filter params (role.id=a3a3c02087374a9086cf0d79e6118247, scope.project.id=debcff5d6200462baae7bebc7bb34145, user.id=fdec723e1b4840ef89efcd8129e0c68b) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:02.172070 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ffb38e-349a-48aa-9a25-ba4df9368062 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:02.173663 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ffb38e-349a-48aa-9a25-ba4df9368062 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:02.180327 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 156/318] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jul 15 17:24:02 2022] GET /identity/v3/role_assignments?user.id=fdec723e1b4840ef89efcd8129e0c68b&scope.project.id=debcff5d6200462baae7bebc7bb34145&role.id=a3a3c02087374a9086cf0d79e6118247 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:02.606230 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876b95d-17ab-4dd7-a740-dbf7c1ebda2e None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:02.606580 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876b95d-17ab-4dd7-a740-dbf7c1ebda2e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:02.606764 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876b95d-17ab-4dd7-a740-dbf7c1ebda2e None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:02.608292 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 163/319] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:02.613562 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9aa38-073f-482c-9885-eaedaa73328a None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:02.613863 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9aa38-073f-482c-9885-eaedaa73328a None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:02.614168 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9aa38-073f-482c-9885-eaedaa73328a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:02.630942 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-4df9aa38-073f-482c-9885-eaedaa73328a None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:02.632105 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-4df9aa38-073f-482c-9885-eaedaa73328a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:02.704421 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 157/320] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:24:02.727223 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876b95d-17ab-4dd7-a740-dbf7c1ebda2e None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:02.833114 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876b95d-17ab-4dd7-a740-dbf7c1ebda2e None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:02.853078 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:02.868753 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307588c3-5332-4be5-970d-e3699fd194df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:02.869482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307588c3-5332-4be5-970d-e3699fd194df None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:02.869742 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307588c3-5332-4be5-970d-e3699fd194df None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:02.870068 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307588c3-5332-4be5-970d-e3699fd194df None admin] PATH_INFO: `/v3/roles/member` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:02.881061 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307588c3-5332-4be5-970d-e3699fd194df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:24:02.888933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-307588c3-5332-4be5-970d-e3699fd194df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 17:24:02.888933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:02.888933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:02.888933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:02.888933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:02.888933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:02.888933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:02.888933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:02.888933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:02.888933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:02.888933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:02.888933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:02.888933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:24:02.888933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:24:02.888933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:24:02.888933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:24:02.890079 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:24:02.890079 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:24:02.890079 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:24:02.890079 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:24:02.890079 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:02.890079 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:02.890079 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:02.890079 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:02.890079 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:02.890079 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:02.890079 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:02.890079 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:02.890079 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:02.890079 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:02.890079 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:02.890079 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:02.890918 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:02.890918 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:02.890918 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:02.890918 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:02.890918 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:24:02.890918 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:24:02.890918 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:24:02.890918 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:24:02.890918 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:24:02.890918 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:24:02.890918 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 17:24:02.890918 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:02.890918 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 164/321] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:24:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:02.897655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df9aa38-073f-482c-9885-eaedaa73328a None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:02.971105 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:03.004940 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df9aa38-073f-482c-9885-eaedaa73328a None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:03.012247 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf5948-4d15-41de-bd1c-12c01ee3ccab None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:03.012543 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf5948-4d15-41de-bd1c-12c01ee3ccab None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:03.013288 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf5948-4d15-41de-bd1c-12c01ee3ccab None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:03.015224 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 165/322] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:03.016846 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa7e16-68fc-45a4-a3ea-cad23b84b114 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:03.017104 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa7e16-68fc-45a4-a3ea-cad23b84b114 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:03.017407 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa7e16-68fc-45a4-a3ea-cad23b84b114 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:03.018811 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 166/323] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 17:24:03.021058 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dde0dc-2bc7-42e9-b22e-f56078196ed3 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:03.021624 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dde0dc-2bc7-42e9-b22e-f56078196ed3 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:03.021935 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dde0dc-2bc7-42e9-b22e-f56078196ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:03.039172 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-f1dde0dc-2bc7-42e9-b22e-f56078196ed3 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:03.040841 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f1dde0dc-2bc7-42e9-b22e-f56078196ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:03.041126 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c28e1b-54cd-4acc-b97d-a0c79bbb9480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:03.041828 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c28e1b-54cd-4acc-b97d-a0c79bbb9480 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:03.042109 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c28e1b-54cd-4acc-b97d-a0c79bbb9480 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:03.042393 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c28e1b-54cd-4acc-b97d-a0c79bbb9480 None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:03.043307 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c28e1b-54cd-4acc-b97d-a0c79bbb9480 None admin] RBAC: Adding query filter params (name=member) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:03.043530 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c28e1b-54cd-4acc-b97d-a0c79bbb9480 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:03.044882 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c28e1b-54cd-4acc-b97d-a0c79bbb9480 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:03.053372 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 158/324] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jul 15 17:24:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:03.054608 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193579ad-dbfa-4f6d-9239-2996e7c92cd8 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:03.054889 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193579ad-dbfa-4f6d-9239-2996e7c92cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:03.055161 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193579ad-dbfa-4f6d-9239-2996e7c92cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:03.071624 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-193579ad-dbfa-4f6d-9239-2996e7c92cd8 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:03.072776 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-193579ad-dbfa-4f6d-9239-2996e7c92cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:03.109853 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 167/325] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:24:03.110690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dde0dc-2bc7-42e9-b22e-f56078196ed3 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:03.140908 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 159/326] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:24:03.141745 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193579ad-dbfa-4f6d-9239-2996e7c92cd8 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:03.199553 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:03.211864 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dde0dc-2bc7-42e9-b22e-f56078196ed3 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:03.222447 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:03.237301 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193579ad-dbfa-4f6d-9239-2996e7c92cd8 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:03.246597 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98485f0-e1ba-474b-90fb-29f6259f7adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:03.247494 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98485f0-e1ba-474b-90fb-29f6259f7adf None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:03.247784 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98485f0-e1ba-474b-90fb-29f6259f7adf None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:03.248031 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98485f0-e1ba-474b-90fb-29f6259f7adf None admin] PATH_INFO: `/v3/users/3cb05cbbc4244cbe900c15ef994df859` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:03.249242 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98485f0-e1ba-474b-90fb-29f6259f7adf None admin] RBAC: Authorizing `identity:get_user(user_id=3cb05cbbc4244cbe900c15ef994df859)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:03.250730 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98485f0-e1ba-474b-90fb-29f6259f7adf None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:03.257116 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 168/327] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:24:03 2022] GET /identity/v3/users/3cb05cbbc4244cbe900c15ef994df859 => generated 293 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:03.257116 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98485f0-e1ba-474b-90fb-29f6259f7adf None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:03.274566 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd52f816-0120-443e-b354-34325d0275a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:03.275364 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52f816-0120-443e-b354-34325d0275a6 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:03.275638 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52f816-0120-443e-b354-34325d0275a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:03.275903 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52f816-0120-443e-b354-34325d0275a6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:03.287535 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd52f816-0120-443e-b354-34325d0275a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:24:03.295362 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-fd52f816-0120-443e-b354-34325d0275a6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 17:24:03.295362 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:03.295362 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:03.295362 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:03.295362 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:03.295362 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:03.295362 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:03.295362 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:03.295362 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:03.295362 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:03.295362 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:03.295362 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:03.295362 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:24:03.295362 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:24:03.295362 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:24:03.295362 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:24:03.296418 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:24:03.296418 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:24:03.296418 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:24:03.296418 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:24:03.296418 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:03.296418 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:03.296418 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:03.296418 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:03.296418 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:03.296418 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:03.296418 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:03.296418 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:03.296418 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:03.296418 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:03.296418 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:03.296418 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:03.297221 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:03.297221 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:03.297221 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:03.297221 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:03.297221 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:24:03.297221 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:24:03.297221 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:24:03.297221 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:24:03.297221 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:24:03.297221 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:24:03.297221 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 17:24:03.297221 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:03.297221 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 160/328] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:24:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:03.297915 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd52f816-0120-443e-b354-34325d0275a6 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:03.361513 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98485f0-e1ba-474b-90fb-29f6259f7adf None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:03.395796 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a41685-0f60-43a5-8b64-4e1c9dc6f60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:03.396469 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd52f816-0120-443e-b354-34325d0275a6 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:03.396605 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a41685-0f60-43a5-8b64-4e1c9dc6f60d None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:03.396779 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a41685-0f60-43a5-8b64-4e1c9dc6f60d None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:03.397046 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a41685-0f60-43a5-8b64-4e1c9dc6f60d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:03.398211 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a41685-0f60-43a5-8b64-4e1c9dc6f60d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:03.399656 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a41685-0f60-43a5-8b64-4e1c9dc6f60d None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:03.401268 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 169/329] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:03.402067 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a41685-0f60-43a5-8b64-4e1c9dc6f60d None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:03.418334 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:03.429927 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadfd660-f1a4-4351-8faf-a83e17223f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:03.430584 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfd660-f1a4-4351-8faf-a83e17223f44 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:03.430862 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfd660-f1a4-4351-8faf-a83e17223f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:03.431130 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfd660-f1a4-4351-8faf-a83e17223f44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:03.431962 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadfd660-f1a4-4351-8faf-a83e17223f44 None admin] RBAC: Adding query filter params (role.id=d8d52b8fc62e44cd9d551b855f2ac84b, user.id=3cb05cbbc4244cbe900c15ef994df859, scope.system=all) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:03.432377 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadfd660-f1a4-4351-8faf-a83e17223f44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:03.433836 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadfd660-f1a4-4351-8faf-a83e17223f44 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:03.445575 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 161/330] 10.222.0.27 () {56 vars in 1308 bytes} [Fri Jul 15 17:24:03 2022] GET /identity/v3/role_assignments?user.id=3cb05cbbc4244cbe900c15ef994df859&scope.system=all&role.id=d8d52b8fc62e44cd9d551b855f2ac84b => generated 510 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:03.446372 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadfd660-f1a4-4351-8faf-a83e17223f44 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:03.470882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:03.511900 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a41685-0f60-43a5-8b64-4e1c9dc6f60d None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:03.550024 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb8acd-9299-45b1-a247-6674a2f33afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:03.550981 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb8acd-9299-45b1-a247-6674a2f33afe None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:03.551262 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb8acd-9299-45b1-a247-6674a2f33afe None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:03.551673 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb8acd-9299-45b1-a247-6674a2f33afe None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:03.552770 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb8acd-9299-45b1-a247-6674a2f33afe None admin] RBAC: Adding query filter params (name=reader) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:03.553076 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb8acd-9299-45b1-a247-6674a2f33afe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:03.554897 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb8acd-9299-45b1-a247-6674a2f33afe None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:03.561057 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadfd660-f1a4-4351-8faf-a83e17223f44 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:03.566447 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 170/331] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jul 15 17:24:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:03.572071 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb8acd-9299-45b1-a247-6674a2f33afe None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:03.601001 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec7f0e-e4d9-4b49-8a88-681e31a2682c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:03.601678 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec7f0e-e4d9-4b49-8a88-681e31a2682c None admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:03.601988 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec7f0e-e4d9-4b49-8a88-681e31a2682c None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:03.602264 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec7f0e-e4d9-4b49-8a88-681e31a2682c None admin] PATH_INFO: `/v3/groups` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:03.603012 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec7f0e-e4d9-4b49-8a88-681e31a2682c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:03.604469 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec7f0e-e4d9-4b49-8a88-681e31a2682c None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:03.623377 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 162/332] 10.222.0.27 () {60 vars in 1134 bytes} [Fri Jul 15 17:24:03 2022] POST /identity/v3/groups => generated 226 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:24:03.692708 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb8acd-9299-45b1-a247-6674a2f33afe None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:03.703318 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:03.731397 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94124b-6ba2-4620-95c0-f77d524a9080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:03.732290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94124b-6ba2-4620-95c0-f77d524a9080 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:03.732568 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94124b-6ba2-4620-95c0-f77d524a9080 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:03.732844 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94124b-6ba2-4620-95c0-f77d524a9080 None admin] PATH_INFO: `/v3/users/fcdeb70d5e0f4001ab25ad50ea9b375e` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:03.734387 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94124b-6ba2-4620-95c0-f77d524a9080 None admin] RBAC: Authorizing `identity:get_user(user_id=fcdeb70d5e0f4001ab25ad50ea9b375e)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:03.735851 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94124b-6ba2-4620-95c0-f77d524a9080 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:03.737546 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 171/333] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:24:03 2022] GET /identity/v3/users/fcdeb70d5e0f4001ab25ad50ea9b375e => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:24:03.743606 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec7f0e-e4d9-4b49-8a88-681e31a2682c None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:03.787135 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:03.846003 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec7f0e-e4d9-4b49-8a88-681e31a2682c None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:03.879682 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3f2a7-f1f7-44be-918e-b4a15c4ede5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:03.880557 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3f2a7-f1f7-44be-918e-b4a15c4ede5e None admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:03.880841 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3f2a7-f1f7-44be-918e-b4a15c4ede5e None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:03.881140 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3f2a7-f1f7-44be-918e-b4a15c4ede5e None admin] PATH_INFO: `/v3/system/users/fcdeb70d5e0f4001ab25ad50ea9b375e/roles/a3a3c02087374a9086cf0d79e6118247` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:03.882704 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f3f2a7-f1f7-44be-918e-b4a15c4ede5e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fcdeb70d5e0f4001ab25ad50ea9b375e, role_id=a3a3c02087374a9086cf0d79e6118247)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:03.884085 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f3f2a7-f1f7-44be-918e-b4a15c4ede5e None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:03.892655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 163/334] 10.222.0.27 () {58 vars in 1334 bytes} [Fri Jul 15 17:24:03 2022] PUT /identity/v3/system/users/fcdeb70d5e0f4001ab25ad50ea9b375e/roles/a3a3c02087374a9086cf0d79e6118247 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:24:05.958340 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c07e6-c7b1-4399-aa3e-9058370beb6a None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:05.959348 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c07e6-c7b1-4399-aa3e-9058370beb6a None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:05.959825 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c07e6-c7b1-4399-aa3e-9058370beb6a None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:05.961550 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 172/335] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:05.967133 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31388e08-720d-49ad-8c88-4b85d7f85e16 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:05.967611 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31388e08-720d-49ad-8c88-4b85d7f85e16 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:05.967801 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31388e08-720d-49ad-8c88-4b85d7f85e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:05.990821 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-31388e08-720d-49ad-8c88-4b85d7f85e16 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:05.992045 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-31388e08-720d-49ad-8c88-4b85d7f85e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:06.072201 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 164/336] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:24:06.107392 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c07e6-c7b1-4399-aa3e-9058370beb6a None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:06.237372 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c07e6-c7b1-4399-aa3e-9058370beb6a None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:06.280859 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c903d-7730-4cc2-b58c-674151a221c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:06.281688 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c903d-7730-4cc2-b58c-674151a221c0 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:06.281993 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c903d-7730-4cc2-b58c-674151a221c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:06.282330 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c903d-7730-4cc2-b58c-674151a221c0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:06.294883 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c903d-7730-4cc2-b58c-674151a221c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:24:06.303372 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-f65c903d-7730-4cc2-b58c-674151a221c0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 17:24:06.303372 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:06.303372 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:06.303372 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:06.303372 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:06.303372 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:06.303372 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:06.303372 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:06.303372 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:06.303372 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:06.303372 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:06.303372 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:06.303372 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:24:06.303372 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:24:06.303372 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:24:06.303372 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:24:06.304258 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:24:06.304258 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:24:06.304258 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:24:06.304258 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:24:06.304258 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:06.304258 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:06.304258 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:06.304258 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:06.304258 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:06.304258 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:06.304258 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:06.304258 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:06.304258 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:06.304258 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:06.304258 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:06.304258 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:06.305042 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:06.305042 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:06.305042 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:06.305042 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:06.305042 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:24:06.305042 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:24:06.305042 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:24:06.305042 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:24:06.305042 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:24:06.305042 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:24:06.305042 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 17:24:06.305042 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:06.305042 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 173/337] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Jul 15 17:24:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:06.308834 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb687dd5-bc84-49f4-8854-e1d694899113 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:06.308834 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb687dd5-bc84-49f4-8854-e1d694899113 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:06.308834 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb687dd5-bc84-49f4-8854-e1d694899113 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:06.308834 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 165/338] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:06.317900 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c903d-7730-4cc2-b58c-674151a221c0 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:06.330215 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07558868-8610-4d67-9f98-8f42c1f49b02 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:06.330516 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07558868-8610-4d67-9f98-8f42c1f49b02 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:06.331092 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07558868-8610-4d67-9f98-8f42c1f49b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:06.360977 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:06.381686 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-07558868-8610-4d67-9f98-8f42c1f49b02 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:06.382944 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-07558868-8610-4d67-9f98-8f42c1f49b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:06.430540 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:06.456636 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c903d-7730-4cc2-b58c-674151a221c0 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:06.508902 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 166/339] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 17:24:06.511514 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b06a19-abbf-43b0-a22b-3993d39d7c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:06.512201 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b06a19-abbf-43b0-a22b-3993d39d7c58 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:06.512486 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b06a19-abbf-43b0-a22b-3993d39d7c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:06.512759 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b06a19-abbf-43b0-a22b-3993d39d7c58 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:06.513578 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b06a19-abbf-43b0-a22b-3993d39d7c58 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:06.513942 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b06a19-abbf-43b0-a22b-3993d39d7c58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:06.515400 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b06a19-abbf-43b0-a22b-3993d39d7c58 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:06.524441 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 174/340] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:24:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:06.530032 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07558868-8610-4d67-9f98-8f42c1f49b02 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:06.559780 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b06a19-abbf-43b0-a22b-3993d39d7c58 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:06.702604 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07558868-8610-4d67-9f98-8f42c1f49b02 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:06.702962 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:06.714619 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b06a19-abbf-43b0-a22b-3993d39d7c58 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:06.760589 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f97c8-4d33-4706-a346-5d0761e1ef4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:06.761328 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f97c8-4d33-4706-a346-5d0761e1ef4a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:06.761612 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f97c8-4d33-4706-a346-5d0761e1ef4a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:06.761713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03372c3f-221d-4bf8-9bdb-21b61c7afe1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:06.761924 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f97c8-4d33-4706-a346-5d0761e1ef4a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:06.762338 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03372c3f-221d-4bf8-9bdb-21b61c7afe1a None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:06.762619 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03372c3f-221d-4bf8-9bdb-21b61c7afe1a None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:06.762891 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03372c3f-221d-4bf8-9bdb-21b61c7afe1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:06.773364 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f97c8-4d33-4706-a346-5d0761e1ef4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:24:06.781966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-343f97c8-4d33-4706-a346-5d0761e1ef4a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 17:24:06.781966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:06.781966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:06.781966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:06.781966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:06.781966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:06.781966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:06.781966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:06.781966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:06.781966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:06.781966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:06.781966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:06.781966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:24:06.781966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:24:06.781966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:24:06.781966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:24:06.782886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:24:06.782886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:24:06.782886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:24:06.782886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:24:06.782886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:06.782886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:06.782886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:06.782886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:06.782886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:06.782886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:06.782886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:06.782886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:06.782886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:06.782886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:06.782886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:06.782886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:06.783655 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:06.783655 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:06.783655 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:06.783655 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:06.783655 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:24:06.783655 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:24:06.783655 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:24:06.783655 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:24:06.783655 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:24:06.783655 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:24:06.783655 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 17:24:06.783655 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:06.783655 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 175/341] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:24:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 17:24:06.785459 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a02ad1-f442-4f44-b49c-2dd93e29bb42 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:06.790233 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a02ad1-f442-4f44-b49c-2dd93e29bb42 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:06.790623 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a02ad1-f442-4f44-b49c-2dd93e29bb42 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:06.792442 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 176/342] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:06.793749 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6345b9-d881-40de-ad26-0bca27c45387 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:06.794169 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6345b9-d881-40de-ad26-0bca27c45387 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:06.794541 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6345b9-d881-40de-ad26-0bca27c45387 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:06.796363 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 177/343] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:06.797762 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6345b9-d881-40de-ad26-0bca27c45387 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:06.803613 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:06.855168 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03372c3f-221d-4bf8-9bdb-21b61c7afe1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:06.856636 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03372c3f-221d-4bf8-9bdb-21b61c7afe1a None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:06.912748 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6345b9-d881-40de-ad26-0bca27c45387 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:06.952694 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719d7c5-2e09-4dd1-b86d-d5c20c83c3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:06.953475 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719d7c5-2e09-4dd1-b86d-d5c20c83c3b6 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:06.953760 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719d7c5-2e09-4dd1-b86d-d5c20c83c3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:06.954065 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719d7c5-2e09-4dd1-b86d-d5c20c83c3b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:06.954820 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3719d7c5-2e09-4dd1-b86d-d5c20c83c3b6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:06.955127 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3719d7c5-2e09-4dd1-b86d-d5c20c83c3b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:06.957028 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3719d7c5-2e09-4dd1-b86d-d5c20c83c3b6 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:06.968451 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 167/344] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:24:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 17:24:06.968950 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 178/345] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jul 15 17:24:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:24:06.970056 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c3a2a-f7db-4345-a6e9-7a4549263d4a None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:06.970344 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c3a2a-f7db-4345-a6e9-7a4549263d4a None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:06.970618 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c3a2a-f7db-4345-a6e9-7a4549263d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:06.972506 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0678c-4e57-46f4-9881-ea3f2c3057be None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:06.972822 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0678c-4e57-46f4-9881-ea3f2c3057be None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:06.973100 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0678c-4e57-46f4-9881-ea3f2c3057be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:06.992100 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-df2c3a2a-f7db-4345-a6e9-7a4549263d4a None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:06.993302 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-df2c3a2a-f7db-4345-a6e9-7a4549263d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:06.995449 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-7be0678c-4e57-46f4-9881-ea3f2c3057be None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:06.996763 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7be0678c-4e57-46f4-9881-ea3f2c3057be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:07.012699 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:07.064255 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:07.071131 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 179/346] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:24:07.071984 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be0678c-4e57-46f4-9881-ea3f2c3057be None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:07.073521 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 168/347] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:24:07.074674 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c3a2a-f7db-4345-a6e9-7a4549263d4a None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:07.176833 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be0678c-4e57-46f4-9881-ea3f2c3057be None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:07.186973 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c3a2a-f7db-4345-a6e9-7a4549263d4a None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:07.213794 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ab07b-9ef8-4b3e-8349-967c5f695243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:07.214736 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ab07b-9ef8-4b3e-8349-967c5f695243 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:07.215021 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ab07b-9ef8-4b3e-8349-967c5f695243 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:07.215299 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ab07b-9ef8-4b3e-8349-967c5f695243 None admin] PATH_INFO: `/v3/projects/7660c9e611fc4315b714c975f6e5f41e` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:07.216759 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ab07b-9ef8-4b3e-8349-967c5f695243 None admin] RBAC: Authorizing `identity:get_project(project_id=7660c9e611fc4315b714c975f6e5f41e)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:07.218623 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ab07b-9ef8-4b3e-8349-967c5f695243 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:07.220864 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 180/348] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:24:07 2022] GET /identity/v3/projects/7660c9e611fc4315b714c975f6e5f41e => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:07.222557 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ab07b-9ef8-4b3e-8349-967c5f695243 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:07.226069 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04caab2-6f28-49b5-81df-2bf409c1d18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:07.227126 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04caab2-6f28-49b5-81df-2bf409c1d18a None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:07.227556 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04caab2-6f28-49b5-81df-2bf409c1d18a None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:07.227962 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04caab2-6f28-49b5-81df-2bf409c1d18a None admin] PATH_INFO: `/v3/users/fcdeb70d5e0f4001ab25ad50ea9b375e` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:07.229306 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04caab2-6f28-49b5-81df-2bf409c1d18a None admin] RBAC: Authorizing `identity:get_user(user_id=fcdeb70d5e0f4001ab25ad50ea9b375e)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:07.231029 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04caab2-6f28-49b5-81df-2bf409c1d18a None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:07.232919 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 169/349] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:24:07 2022] GET /identity/v3/users/fcdeb70d5e0f4001ab25ad50ea9b375e => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:07.234119 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04caab2-6f28-49b5-81df-2bf409c1d18a None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:07.247378 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:07.314056 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:07.351420 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ab07b-9ef8-4b3e-8349-967c5f695243 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:07.363244 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04caab2-6f28-49b5-81df-2bf409c1d18a None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:07.391546 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52ee69-fc4f-451c-9561-d51c16e314e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:07.392352 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52ee69-fc4f-451c-9561-d51c16e314e4 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:07.392629 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52ee69-fc4f-451c-9561-d51c16e314e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:07.392901 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52ee69-fc4f-451c-9561-d51c16e314e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:07.405880 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888435fc-29ca-4a69-9df3-19d5c6daaaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:07.406579 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52ee69-fc4f-451c-9561-d51c16e314e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:24:07.407144 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888435fc-29ca-4a69-9df3-19d5c6daaaec None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:07.407582 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888435fc-29ca-4a69-9df3-19d5c6daaaec None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:07.408004 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888435fc-29ca-4a69-9df3-19d5c6daaaec None admin] PATH_INFO: `/v3/roles/member` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:07.415250 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-df52ee69-fc4f-451c-9561-d51c16e314e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 17:24:07.415250 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:07.415250 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:07.415250 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:07.415250 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:07.415250 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:07.415250 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:07.415250 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:07.415250 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:07.415250 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:07.415250 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:07.415250 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:07.415250 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:24:07.415250 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:24:07.415250 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:24:07.415250 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:24:07.416167 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:24:07.416167 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:24:07.416167 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:24:07.416167 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:24:07.416167 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:07.416167 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:07.416167 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:07.416167 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:07.416167 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:07.416167 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:07.416167 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:07.416167 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:07.416167 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:07.416167 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:07.416167 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:07.416167 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:07.417307 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:07.417307 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:07.417307 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:07.417307 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:07.417307 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:24:07.417307 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:24:07.417307 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:24:07.417307 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:24:07.417307 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:24:07.417307 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:24:07.417307 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 17:24:07.417307 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:07.417307 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 181/350] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:24:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:07.417307 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52ee69-fc4f-451c-9561-d51c16e314e4 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:07.426537 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888435fc-29ca-4a69-9df3-19d5c6daaaec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:24:07.434375 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-888435fc-29ca-4a69-9df3-19d5c6daaaec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 17:24:07.434375 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:07.434375 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:07.434375 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:07.434375 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:07.434375 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:07.434375 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:07.434375 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:07.434375 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:07.434375 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:07.434375 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:07.434375 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:07.434375 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:24:07.434375 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:24:07.434375 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:24:07.434375 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:24:07.435262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:24:07.435262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:24:07.435262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:24:07.435262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:24:07.435262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:07.435262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:07.435262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:07.435262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:07.435262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:07.435262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:07.435262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:07.435262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:07.435262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:07.435262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:07.435262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:07.435262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:07.436107 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:07.436107 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:07.436107 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:07.436107 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:07.436107 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:24:07.436107 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:24:07.436107 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:24:07.436107 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:24:07.436107 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:24:07.436107 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:24:07.436107 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 17:24:07.436107 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:07.436107 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 170/351] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:24:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:07.436841 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888435fc-29ca-4a69-9df3-19d5c6daaaec None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:07.508711 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:07.537384 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52ee69-fc4f-451c-9561-d51c16e314e4 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:07.568168 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888435fc-29ca-4a69-9df3-19d5c6daaaec None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:07.587875 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c76979-0575-46c5-bebb-df68e01f2d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:07.588759 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c76979-0575-46c5-bebb-df68e01f2d4b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:07.589042 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c76979-0575-46c5-bebb-df68e01f2d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:07.589318 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c76979-0575-46c5-bebb-df68e01f2d4b None admin] PATH_INFO: `/v3/groups/122175f93ab74220a2eaadd07b64bc72` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:07.599480 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c76979-0575-46c5-bebb-df68e01f2d4b None admin] RBAC: Authorizing `identity:get_group(group_id=122175f93ab74220a2eaadd07b64bc72)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:07.599942 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:07.602444 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c76979-0575-46c5-bebb-df68e01f2d4b None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:07.604392 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 182/352] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Jul 15 17:24:07 2022] GET /identity/v3/groups/122175f93ab74220a2eaadd07b64bc72 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:07.608408 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a667c28-7527-4c52-907f-69e452de12f1 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:07.608631 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a667c28-7527-4c52-907f-69e452de12f1 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:07.608869 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a667c28-7527-4c52-907f-69e452de12f1 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:07.610239 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 183/353] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:07.612380 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982139f-d112-454d-8b34-a453ab506ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:07.613042 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982139f-d112-454d-8b34-a453ab506ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:07.613320 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982139f-d112-454d-8b34-a453ab506ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:07.613591 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982139f-d112-454d-8b34-a453ab506ca6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:07.614020 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a667c28-7527-4c52-907f-69e452de12f1 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:07.614469 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5982139f-d112-454d-8b34-a453ab506ca6 None admin] RBAC: Adding query filter params (role.id=a3a3c02087374a9086cf0d79e6118247, user.id=fcdeb70d5e0f4001ab25ad50ea9b375e, scope.system=all) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:07.614777 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5982139f-d112-454d-8b34-a453ab506ca6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:07.616457 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5982139f-d112-454d-8b34-a453ab506ca6 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:07.632467 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 171/354] 10.222.0.27 () {56 vars in 1308 bytes} [Fri Jul 15 17:24:07 2022] GET /identity/v3/role_assignments?user.id=fcdeb70d5e0f4001ab25ad50ea9b375e&scope.system=all&role.id=a3a3c02087374a9086cf0d79e6118247 => generated 510 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:07.633166 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982139f-d112-454d-8b34-a453ab506ca6 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:07.757668 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a667c28-7527-4c52-907f-69e452de12f1 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:07.770073 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982139f-d112-454d-8b34-a453ab506ca6 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:07.798829 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688e2ad-ff66-490d-b3e1-6c0c854fff3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:07.799511 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688e2ad-ff66-490d-b3e1-6c0c854fff3e None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:07.799852 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688e2ad-ff66-490d-b3e1-6c0c854fff3e None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:07.800055 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688e2ad-ff66-490d-b3e1-6c0c854fff3e None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:07.800800 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a688e2ad-ff66-490d-b3e1-6c0c854fff3e None admin] RBAC: Adding query filter params (name=member) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:07.801098 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a688e2ad-ff66-490d-b3e1-6c0c854fff3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:07.802553 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a688e2ad-ff66-490d-b3e1-6c0c854fff3e None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:07.811729 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a19c2-0794-4679-b9a9-003db03c6aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:07.812656 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 184/355] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jul 15 17:24:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:07.813121 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a19c2-0794-4679-b9a9-003db03c6aab None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:07.813523 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688e2ad-ff66-490d-b3e1-6c0c854fff3e None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:07.814059 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a19c2-0794-4679-b9a9-003db03c6aab None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:07.814579 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a19c2-0794-4679-b9a9-003db03c6aab None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:07.815553 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a19c2-0794-4679-b9a9-003db03c6aab None admin] RBAC: Adding query filter params (name=member) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:07.816144 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a19c2-0794-4679-b9a9-003db03c6aab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:07.817950 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a19c2-0794-4679-b9a9-003db03c6aab None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:07.818892 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:07.833601 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 172/356] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jul 15 17:24:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:07.835334 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbc95e-b1c7-4de1-9ced-c62d16f39e30 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:07.835825 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbc95e-b1c7-4de1-9ced-c62d16f39e30 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:07.836343 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbc95e-b1c7-4de1-9ced-c62d16f39e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:07.853611 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-13bbc95e-b1c7-4de1-9ced-c62d16f39e30 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:07.855253 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-13bbc95e-b1c7-4de1-9ced-c62d16f39e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:07.911007 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:07.949336 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688e2ad-ff66-490d-b3e1-6c0c854fff3e None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:07.950840 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 173/357] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:24:07.951919 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbc95e-b1c7-4de1-9ced-c62d16f39e30 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:07.991736 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04738fe4-e387-4b4a-8108-2f4453fef0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:07.992400 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04738fe4-e387-4b4a-8108-2f4453fef0e6 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:07.992682 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04738fe4-e387-4b4a-8108-2f4453fef0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:07.992952 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04738fe4-e387-4b4a-8108-2f4453fef0e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:07.994666 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04738fe4-e387-4b4a-8108-2f4453fef0e6 None admin] RBAC: Adding query filter params (group.id=122175f93ab74220a2eaadd07b64bc72, role.id=c9b1f4b47f054f7a8a9a079e65a7197a, scope.project.id=7660c9e611fc4315b714c975f6e5f41e) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:07.994666 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04738fe4-e387-4b4a-8108-2f4453fef0e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:07.996121 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04738fe4-e387-4b4a-8108-2f4453fef0e6 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:08.002713 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 185/358] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Jul 15 17:24:07 2022] GET /identity/v3/role_assignments?group.id=122175f93ab74220a2eaadd07b64bc72&scope.project.id=7660c9e611fc4315b714c975f6e5f41e&role.id=c9b1f4b47f054f7a8a9a079e65a7197a => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:08.007078 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04738fe4-e387-4b4a-8108-2f4453fef0e6 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:08.070738 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbc95e-b1c7-4de1-9ced-c62d16f39e30 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:08.107796 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:08.117363 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdec13c-eebe-45a2-bb4d-26f21d0e9f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:08.118059 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdec13c-eebe-45a2-bb4d-26f21d0e9f9e None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:08.118341 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdec13c-eebe-45a2-bb4d-26f21d0e9f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:08.118615 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdec13c-eebe-45a2-bb4d-26f21d0e9f9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:08.151493 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04738fe4-e387-4b4a-8108-2f4453fef0e6 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:08.174249 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:08.199446 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0a796-848c-4878-8cec-d41dfa395756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:08.200105 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0a796-848c-4878-8cec-d41dfa395756 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:08.200389 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0a796-848c-4878-8cec-d41dfa395756 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:08.200853 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0a796-848c-4878-8cec-d41dfa395756 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:08.208467 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdec13c-eebe-45a2-bb4d-26f21d0e9f9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:08.210034 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdec13c-eebe-45a2-bb4d-26f21d0e9f9e None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:08.289132 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa0a796-848c-4878-8cec-d41dfa395756 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:08.290768 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa0a796-848c-4878-8cec-d41dfa395756 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:08.344296 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 174/359] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:24:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 17:24:08.345460 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdec13c-eebe-45a2-bb4d-26f21d0e9f9e None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:08.381072 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:08.435504 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 186/360] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:24:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 17:24:08.437693 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:08.437862 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f3fe4-7006-4d58-bd96-079bf99fad4d None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:08.437862 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f3fe4-7006-4d58-bd96-079bf99fad4d None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:08.438140 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f3fe4-7006-4d58-bd96-079bf99fad4d None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:08.439610 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 187/361] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:08.440169 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f3fe4-7006-4d58-bd96-079bf99fad4d None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:08.476539 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdec13c-eebe-45a2-bb4d-26f21d0e9f9e None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:08.523306 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee1401e-f7d0-4a77-a8ba-0113667cd45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:08.524302 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1401e-f7d0-4a77-a8ba-0113667cd45c None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:08.524585 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1401e-f7d0-4a77-a8ba-0113667cd45c None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:08.524858 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1401e-f7d0-4a77-a8ba-0113667cd45c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:08.539676 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee1401e-f7d0-4a77-a8ba-0113667cd45c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:24:08.549728 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-aee1401e-f7d0-4a77-a8ba-0113667cd45c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 17:24:08.549728 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:08.549728 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:08.549728 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:08.549728 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:08.549728 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:08.549728 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:08.549728 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:08.549728 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:08.549728 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:08.549728 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:08.549728 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:08.549728 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:24:08.549728 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:24:08.549728 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:24:08.549728 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:24:08.550712 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:24:08.550712 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:24:08.550712 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:24:08.550712 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:24:08.550712 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:08.550712 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:08.550712 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:08.550712 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:08.550712 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:08.550712 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:08.550712 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:08.550712 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:08.550712 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:08.550712 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:08.550712 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:08.550712 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:08.551514 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:08.551514 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:08.551514 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:08.551514 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:08.551514 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:24:08.551514 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:24:08.551514 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:24:08.551514 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:24:08.551514 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:24:08.551514 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:24:08.551514 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 17:24:08.551514 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:08.552132 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 175/362] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Jul 15 17:24:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:08.553271 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ef639-930a-4288-9183-d77ea2f95cbf None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:08.553432 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ef639-930a-4288-9183-d77ea2f95cbf None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:08.554096 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ef639-930a-4288-9183-d77ea2f95cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:08.573595 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-ed3ef639-930a-4288-9183-d77ea2f95cbf None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:08.574844 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-ed3ef639-930a-4288-9183-d77ea2f95cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:08.579007 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f3fe4-7006-4d58-bd96-079bf99fad4d None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:08.623066 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c53c62-8f10-4fb8-a03a-5cafcb1e483a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:08.623969 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c53c62-8f10-4fb8-a03a-5cafcb1e483a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:08.624305 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c53c62-8f10-4fb8-a03a-5cafcb1e483a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:08.624584 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c53c62-8f10-4fb8-a03a-5cafcb1e483a None admin] PATH_INFO: `/v3/projects/debcff5d6200462baae7bebc7bb34145` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:08.625818 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c53c62-8f10-4fb8-a03a-5cafcb1e483a None admin] RBAC: Authorizing `identity:get_project(project_id=debcff5d6200462baae7bebc7bb34145)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:08.627299 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c53c62-8f10-4fb8-a03a-5cafcb1e483a None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:08.629078 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 188/363] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:24:08 2022] GET /identity/v3/projects/debcff5d6200462baae7bebc7bb34145 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:08.629867 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c53c62-8f10-4fb8-a03a-5cafcb1e483a None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:08.664789 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 176/364] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:24:08.665077 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ef639-930a-4288-9183-d77ea2f95cbf None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:08.679765 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:08.743879 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:08.763466 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c53c62-8f10-4fb8-a03a-5cafcb1e483a None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:08.786955 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ef639-930a-4288-9183-d77ea2f95cbf None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:08.802921 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6daf66-a9cc-42e9-b8d3-d2f1713685c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:08.803800 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6daf66-a9cc-42e9-b8d3-d2f1713685c3 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:08.804080 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6daf66-a9cc-42e9-b8d3-d2f1713685c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:08.804354 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6daf66-a9cc-42e9-b8d3-d2f1713685c3 None admin] PATH_INFO: `/v3/projects/7660c9e611fc4315b714c975f6e5f41e` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:08.806521 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6daf66-a9cc-42e9-b8d3-d2f1713685c3 None admin] RBAC: Authorizing `identity:get_project(project_id=7660c9e611fc4315b714c975f6e5f41e)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:08.807974 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6daf66-a9cc-42e9-b8d3-d2f1713685c3 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:08.809875 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 189/365] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:24:08 2022] GET /identity/v3/projects/7660c9e611fc4315b714c975f6e5f41e => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:08.811137 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6daf66-a9cc-42e9-b8d3-d2f1713685c3 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:08.836994 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311bbd7a-90e8-43ca-9b7c-51bb4f45ed13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:08.837858 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311bbd7a-90e8-43ca-9b7c-51bb4f45ed13 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:08.838146 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311bbd7a-90e8-43ca-9b7c-51bb4f45ed13 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:08.838427 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311bbd7a-90e8-43ca-9b7c-51bb4f45ed13 None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:08.839308 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311bbd7a-90e8-43ca-9b7c-51bb4f45ed13 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:08.839722 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311bbd7a-90e8-43ca-9b7c-51bb4f45ed13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:08.841112 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311bbd7a-90e8-43ca-9b7c-51bb4f45ed13 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:08.850753 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 177/366] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:24:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:08.856810 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311bbd7a-90e8-43ca-9b7c-51bb4f45ed13 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:08.937298 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6daf66-a9cc-42e9-b8d3-d2f1713685c3 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:08.941935 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:08.985878 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006558e-ace5-4359-8afc-d7b36ae746ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:08.988978 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006558e-ace5-4359-8afc-d7b36ae746ec None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:08.989403 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006558e-ace5-4359-8afc-d7b36ae746ec None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:08.989692 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006558e-ace5-4359-8afc-d7b36ae746ec None admin] PATH_INFO: `/v3/groups/122175f93ab74220a2eaadd07b64bc72` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:08.991338 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d006558e-ace5-4359-8afc-d7b36ae746ec None admin] RBAC: Authorizing `identity:get_group(group_id=122175f93ab74220a2eaadd07b64bc72)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:08.992546 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d006558e-ace5-4359-8afc-d7b36ae746ec None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:08.994459 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311bbd7a-90e8-43ca-9b7c-51bb4f45ed13 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:08.994585 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 190/367] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Jul 15 17:24:08 2022] GET /identity/v3/groups/122175f93ab74220a2eaadd07b64bc72 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:09.000251 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006558e-ace5-4359-8afc-d7b36ae746ec None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:09.020505 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:09.036489 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222185da-d8cb-482b-825b-734f67912f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:09.037294 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222185da-d8cb-482b-825b-734f67912f60 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:09.037575 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222185da-d8cb-482b-825b-734f67912f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:09.037897 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222185da-d8cb-482b-825b-734f67912f60 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:09.050408 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222185da-d8cb-482b-825b-734f67912f60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:24:09.059279 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-222185da-d8cb-482b-825b-734f67912f60 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:24:09.059279 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:09.059279 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:09.059279 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:09.059279 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:09.059279 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:09.059279 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:09.059279 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:09.059279 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:09.059279 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:09.059279 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:09.059279 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:09.059279 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:24:09.059279 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:24:09.059279 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:24:09.059279 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:24:09.060363 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:24:09.060363 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:24:09.060363 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:24:09.060363 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:24:09.060363 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:09.060363 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:09.060363 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:09.060363 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:09.060363 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:09.060363 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:09.060363 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:09.060363 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:09.060363 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:09.060363 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:09.060363 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:09.060363 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:09.061378 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:09.061378 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:09.061378 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:09.061378 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:09.061378 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:24:09.061378 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:24:09.061378 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:24:09.061378 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:24:09.061378 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:24:09.061378 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:24:09.061378 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:24:09.061378 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:09.063493 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 178/368] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jul 15 17:24:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:09.064463 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222185da-d8cb-482b-825b-734f67912f60 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:09.129631 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006558e-ace5-4359-8afc-d7b36ae746ec None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:09.176401 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953024f-13aa-4095-8fea-b25bcc9d3001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:09.177289 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953024f-13aa-4095-8fea-b25bcc9d3001 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:09.177573 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953024f-13aa-4095-8fea-b25bcc9d3001 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:09.179066 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953024f-13aa-4095-8fea-b25bcc9d3001 None admin] PATH_INFO: `/v3/groups/122175f93ab74220a2eaadd07b64bc72` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:09.179956 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0953024f-13aa-4095-8fea-b25bcc9d3001 None admin] RBAC: Authorizing `identity:get_group(group_id=122175f93ab74220a2eaadd07b64bc72)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:09.181427 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0953024f-13aa-4095-8fea-b25bcc9d3001 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:09.183200 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 191/369] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Jul 15 17:24:08 2022] GET /identity/v3/groups/122175f93ab74220a2eaadd07b64bc72 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:09.183983 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953024f-13aa-4095-8fea-b25bcc9d3001 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:09.201475 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222185da-d8cb-482b-825b-734f67912f60 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:09.240997 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11651571-497a-4f85-9df3-d968415b038b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:09.242028 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11651571-497a-4f85-9df3-d968415b038b None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:09.242528 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11651571-497a-4f85-9df3-d968415b038b None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:09.243019 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11651571-497a-4f85-9df3-d968415b038b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:09.243890 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:09.321579 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:09.331916 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953024f-13aa-4095-8fea-b25bcc9d3001 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:09.341353 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11651571-497a-4f85-9df3-d968415b038b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:09.344131 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11651571-497a-4f85-9df3-d968415b038b None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:09.383844 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ffbc0-816b-4163-88cd-b10965ad8fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:09.384510 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ffbc0-816b-4163-88cd-b10965ad8fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:09.384797 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ffbc0-816b-4163-88cd-b10965ad8fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:09.385449 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ffbc0-816b-4163-88cd-b10965ad8fb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:09.385954 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ffbc0-816b-4163-88cd-b10965ad8fb7 None admin] RBAC: Adding query filter params (group.id=122175f93ab74220a2eaadd07b64bc72, role.id=d8d52b8fc62e44cd9d551b855f2ac84b, scope.project.id=debcff5d6200462baae7bebc7bb34145) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:09.386266 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ffbc0-816b-4163-88cd-b10965ad8fb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:09.387695 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ffbc0-816b-4163-88cd-b10965ad8fb7 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:09.394077 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 192/370] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Jul 15 17:24:09 2022] GET /identity/v3/role_assignments?group.id=122175f93ab74220a2eaadd07b64bc72&scope.project.id=debcff5d6200462baae7bebc7bb34145&role.id=d8d52b8fc62e44cd9d551b855f2ac84b => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:09.395295 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ffbc0-816b-4163-88cd-b10965ad8fb7 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:09.471444 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 179/371] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:24:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 17:24:09.472680 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11651571-497a-4f85-9df3-d968415b038b None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:09.534923 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ffbc0-816b-4163-88cd-b10965ad8fb7 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:09.538123 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:09.584120 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:09.588636 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a099dc-d7f8-41e8-a4d3-110458b97edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:09.589318 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a099dc-d7f8-41e8-a4d3-110458b97edc None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:09.589595 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a099dc-d7f8-41e8-a4d3-110458b97edc None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:09.589945 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a099dc-d7f8-41e8-a4d3-110458b97edc None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:09.591285 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a099dc-d7f8-41e8-a4d3-110458b97edc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:09.591536 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a099dc-d7f8-41e8-a4d3-110458b97edc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:09.592993 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a099dc-d7f8-41e8-a4d3-110458b97edc None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:09.602042 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 193/372] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:24:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:09.602858 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a099dc-d7f8-41e8-a4d3-110458b97edc None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:09.609992 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11651571-497a-4f85-9df3-d968415b038b None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:09.655372 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18fa5d-296f-46bb-8f29-f32266baf4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:09.656297 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18fa5d-296f-46bb-8f29-f32266baf4af None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:09.656684 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18fa5d-296f-46bb-8f29-f32266baf4af None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:09.657279 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18fa5d-296f-46bb-8f29-f32266baf4af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:09.658709 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f18fa5d-296f-46bb-8f29-f32266baf4af None admin] RBAC: Adding query filter params (group.id=122175f93ab74220a2eaadd07b64bc72, role.id=d8d52b8fc62e44cd9d551b855f2ac84b, scope.project.id=7660c9e611fc4315b714c975f6e5f41e) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:09.659030 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f18fa5d-296f-46bb-8f29-f32266baf4af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:09.661041 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f18fa5d-296f-46bb-8f29-f32266baf4af None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:09.670359 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 180/373] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Jul 15 17:24:09 2022] GET /identity/v3/role_assignments?group.id=122175f93ab74220a2eaadd07b64bc72&scope.project.id=7660c9e611fc4315b714c975f6e5f41e&role.id=d8d52b8fc62e44cd9d551b855f2ac84b => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:09.671467 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18fa5d-296f-46bb-8f29-f32266baf4af None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:09.743712 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a099dc-d7f8-41e8-a4d3-110458b97edc None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:09.832586 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10febd8-7d62-4479-b67f-7409e5ff316f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:09.833458 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10febd8-7d62-4479-b67f-7409e5ff316f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:09.833734 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10febd8-7d62-4479-b67f-7409e5ff316f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:09.834028 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10febd8-7d62-4479-b67f-7409e5ff316f None admin] PATH_INFO: `/v3/projects/debcff5d6200462baae7bebc7bb34145` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:09.835586 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10febd8-7d62-4479-b67f-7409e5ff316f None admin] RBAC: Authorizing `identity:get_project(project_id=debcff5d6200462baae7bebc7bb34145)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:09.837048 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10febd8-7d62-4479-b67f-7409e5ff316f None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:09.840675 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 194/374] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:24:09 2022] GET /identity/v3/projects/debcff5d6200462baae7bebc7bb34145 => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:09.848484 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10febd8-7d62-4479-b67f-7409e5ff316f None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:09.861023 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18fa5d-296f-46bb-8f29-f32266baf4af None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:09.898018 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:09.923793 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b114a2d1-f7cc-4c77-b878-e110bb6702ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:09.924826 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114a2d1-f7cc-4c77-b878-e110bb6702ad None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:09.925316 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114a2d1-f7cc-4c77-b878-e110bb6702ad None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:09.928046 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114a2d1-f7cc-4c77-b878-e110bb6702ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:09.947418 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:10.006095 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10febd8-7d62-4479-b67f-7409e5ff316f None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:10.014969 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b114a2d1-f7cc-4c77-b878-e110bb6702ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:10.016717 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b114a2d1-f7cc-4c77-b878-e110bb6702ad None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:10.043552 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a0321e-2d63-4c55-9386-1e2549bfc4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:10.044426 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0321e-2d63-4c55-9386-1e2549bfc4aa None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:10.044707 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0321e-2d63-4c55-9386-1e2549bfc4aa None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:10.044981 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0321e-2d63-4c55-9386-1e2549bfc4aa None admin] PATH_INFO: `/v3/groups/122175f93ab74220a2eaadd07b64bc72` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:10.046266 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a0321e-2d63-4c55-9386-1e2549bfc4aa None admin] RBAC: Authorizing `identity:get_group(group_id=122175f93ab74220a2eaadd07b64bc72)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:10.047702 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a0321e-2d63-4c55-9386-1e2549bfc4aa None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:10.049700 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 195/375] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Jul 15 17:24:09 2022] GET /identity/v3/groups/122175f93ab74220a2eaadd07b64bc72 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:24:10.055904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a0321e-2d63-4c55-9386-1e2549bfc4aa None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:10.162497 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a0321e-2d63-4c55-9386-1e2549bfc4aa None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:10.164814 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:10.204292 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59227482-c002-4c57-9a96-64d23f58294a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:10.204954 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59227482-c002-4c57-9a96-64d23f58294a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:10.205233 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59227482-c002-4c57-9a96-64d23f58294a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:10.205507 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59227482-c002-4c57-9a96-64d23f58294a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:10.206687 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59227482-c002-4c57-9a96-64d23f58294a None admin] RBAC: Adding query filter params (group.id=122175f93ab74220a2eaadd07b64bc72, role.id=c9b1f4b47f054f7a8a9a079e65a7197a, scope.project.id=debcff5d6200462baae7bebc7bb34145) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:10.206994 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59227482-c002-4c57-9a96-64d23f58294a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:10.208435 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59227482-c002-4c57-9a96-64d23f58294a None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:10.221473 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 196/376] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Jul 15 17:24:10 2022] GET /identity/v3/role_assignments?group.id=122175f93ab74220a2eaadd07b64bc72&scope.project.id=debcff5d6200462baae7bebc7bb34145&role.id=c9b1f4b47f054f7a8a9a079e65a7197a => generated 260 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:10.227480 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 181/377] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:24:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 17:24:10.234561 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59227482-c002-4c57-9a96-64d23f58294a None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:10.333468 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de9adc-f04f-4d9c-81f6-bbc93b4433fe None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:10.333816 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de9adc-f04f-4d9c-81f6-bbc93b4433fe None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:10.334054 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de9adc-f04f-4d9c-81f6-bbc93b4433fe None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:10.335428 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 182/378] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 17:24:10.341013 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f4281-2724-4013-8379-5c0734fd513d None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:10.341320 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f4281-2724-4013-8379-5c0734fd513d None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:10.341562 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f4281-2724-4013-8379-5c0734fd513d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:10.358071 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59227482-c002-4c57-9a96-64d23f58294a None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:10.361536 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-d95f4281-2724-4013-8379-5c0734fd513d None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:10.363917 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-d95f4281-2724-4013-8379-5c0734fd513d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:10.427539 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c3069-7c3f-499a-b1f9-140052d89cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:10.428430 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c3069-7c3f-499a-b1f9-140052d89cdc None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:10.428709 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c3069-7c3f-499a-b1f9-140052d89cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:10.428986 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c3069-7c3f-499a-b1f9-140052d89cdc None admin] PATH_INFO: `/v3/projects/3c32a3d29e5f4e56a46352866cc5acd0` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:10.430459 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c3069-7c3f-499a-b1f9-140052d89cdc None admin] RBAC: Authorizing `identity:get_project(project_id=3c32a3d29e5f4e56a46352866cc5acd0)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:10.431941 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c3069-7c3f-499a-b1f9-140052d89cdc None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:10.439392 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 197/379] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:24:10 2022] GET /identity/v3/projects/3c32a3d29e5f4e56a46352866cc5acd0 => generated 344 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:10.446626 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c3069-7c3f-499a-b1f9-140052d89cdc None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:10.469290 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:10.502444 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 183/380] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:24:10.506752 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:10.529394 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f4281-2724-4013-8379-5c0734fd513d None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:10.594924 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c3069-7c3f-499a-b1f9-140052d89cdc None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:10.642846 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2fe1ad-3272-4890-9bd2-1af8ee1f19e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:10.643781 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2fe1ad-3272-4890-9bd2-1af8ee1f19e1 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:10.644260 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2fe1ad-3272-4890-9bd2-1af8ee1f19e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:10.644603 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2fe1ad-3272-4890-9bd2-1af8ee1f19e1 None admin] PATH_INFO: `/v3/groups/be8ba8abbb06442ca073f2b9aa2b8c39` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:10.651524 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f4281-2724-4013-8379-5c0734fd513d None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:10.657204 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2fe1ad-3272-4890-9bd2-1af8ee1f19e1 None admin] RBAC: Authorizing `identity:get_group(group_id=be8ba8abbb06442ca073f2b9aa2b8c39)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:10.658765 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2fe1ad-3272-4890-9bd2-1af8ee1f19e1 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:10.660922 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 198/381] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Jul 15 17:24:10 2022] GET /identity/v3/groups/be8ba8abbb06442ca073f2b9aa2b8c39 => generated 229 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:10.679205 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2fe1ad-3272-4890-9bd2-1af8ee1f19e1 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:10.699402 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bfd2d9-a87d-4164-ad8c-80bb5a9e52c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:10.700244 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfd2d9-a87d-4164-ad8c-80bb5a9e52c4 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:10.700524 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfd2d9-a87d-4164-ad8c-80bb5a9e52c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:10.700798 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfd2d9-a87d-4164-ad8c-80bb5a9e52c4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:10.721968 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bfd2d9-a87d-4164-ad8c-80bb5a9e52c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:24:10.735052 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-10bfd2d9-a87d-4164-ad8c-80bb5a9e52c4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 17:24:10.735052 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:10.735052 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:10.735052 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:10.735052 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:10.735052 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:10.735052 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:10.735052 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:10.735052 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:10.735052 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:10.735052 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:10.735052 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:10.735052 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:24:10.735052 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:24:10.735052 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:24:10.735052 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:24:10.736080 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:24:10.736080 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:24:10.736080 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:24:10.736080 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:24:10.736080 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:10.736080 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:10.736080 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:10.736080 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:10.736080 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:10.736080 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:10.736080 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:10.736080 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:10.736080 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:10.736080 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:10.736080 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:10.736080 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:10.736895 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:10.736895 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:10.736895 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:10.736895 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:10.736895 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:24:10.736895 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:24:10.736895 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:24:10.736895 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:24:10.736895 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:24:10.736895 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:24:10.736895 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 17:24:10.736895 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:10.738877 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 184/382] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Jul 15 17:24:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 17:24:10.752940 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bfd2d9-a87d-4164-ad8c-80bb5a9e52c4 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:10.803258 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:10.811894 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:10.818954 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2fe1ad-3272-4890-9bd2-1af8ee1f19e1 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:10.870627 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5c565-10cb-4887-98d7-39a17f1329d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:10.871225 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5c565-10cb-4887-98d7-39a17f1329d9 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:10.871514 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5c565-10cb-4887-98d7-39a17f1329d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:10.871794 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5c565-10cb-4887-98d7-39a17f1329d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:10.872632 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef5c565-10cb-4887-98d7-39a17f1329d9 None admin] RBAC: Adding query filter params (group.id=be8ba8abbb06442ca073f2b9aa2b8c39, role.id=70d242b29ede4648b639c7ddae5eaead, scope.project.id=3c32a3d29e5f4e56a46352866cc5acd0) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:10.872945 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef5c565-10cb-4887-98d7-39a17f1329d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:10.874648 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef5c565-10cb-4887-98d7-39a17f1329d9 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:10.880916 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 199/383] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Jul 15 17:24:10 2022] GET /identity/v3/role_assignments?group.id=be8ba8abbb06442ca073f2b9aa2b8c39&scope.project.id=3c32a3d29e5f4e56a46352866cc5acd0&role.id=70d242b29ede4648b639c7ddae5eaead => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:24:10.888489 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bfd2d9-a87d-4164-ad8c-80bb5a9e52c4 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:10.947714 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f661db-99e4-4556-bbb6-a74705e0d6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:10.948390 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f661db-99e4-4556-bbb6-a74705e0d6d0 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:10.948670 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f661db-99e4-4556-bbb6-a74705e0d6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:10.948939 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f661db-99e4-4556-bbb6-a74705e0d6d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:10.949705 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f661db-99e4-4556-bbb6-a74705e0d6d0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:10.950031 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f661db-99e4-4556-bbb6-a74705e0d6d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:10.951412 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f661db-99e4-4556-bbb6-a74705e0d6d0 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:10.965607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 185/384] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:24:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:10.970673 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5c565-10cb-4887-98d7-39a17f1329d9 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:11.126702 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5c565-10cb-4887-98d7-39a17f1329d9 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:11.167516 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed9302-994c-48c6-b937-af0fee892b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:11.168404 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed9302-994c-48c6-b937-af0fee892b94 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:11.168688 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed9302-994c-48c6-b937-af0fee892b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:11.168966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed9302-994c-48c6-b937-af0fee892b94 None admin] PATH_INFO: `/v3/groups/122175f93ab74220a2eaadd07b64bc72` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:11.170672 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed9302-994c-48c6-b937-af0fee892b94 None admin] RBAC: Authorizing `identity:get_group(group_id=122175f93ab74220a2eaadd07b64bc72)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:11.172235 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed9302-994c-48c6-b937-af0fee892b94 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:11.174212 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 200/385] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Jul 15 17:24:10 2022] GET /identity/v3/groups/122175f93ab74220a2eaadd07b64bc72 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:11.179852 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f661db-99e4-4556-bbb6-a74705e0d6d0 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:11.325441 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f661db-99e4-4556-bbb6-a74705e0d6d0 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:11.334930 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:11.360628 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13339b32-0543-4861-8583-0b6e39a34051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:11.361497 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13339b32-0543-4861-8583-0b6e39a34051 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:11.361772 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13339b32-0543-4861-8583-0b6e39a34051 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:11.362069 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13339b32-0543-4861-8583-0b6e39a34051 None admin] PATH_INFO: `/v3/projects/7660c9e611fc4315b714c975f6e5f41e` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:11.363275 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13339b32-0543-4861-8583-0b6e39a34051 None admin] RBAC: Authorizing `identity:get_project(project_id=7660c9e611fc4315b714c975f6e5f41e)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:11.364729 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13339b32-0543-4861-8583-0b6e39a34051 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:11.366802 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 186/386] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:24:11 2022] GET /identity/v3/projects/7660c9e611fc4315b714c975f6e5f41e => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:11.372140 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed9302-994c-48c6-b937-af0fee892b94 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:11.435333 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:11.508506 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed9302-994c-48c6-b937-af0fee892b94 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:11.548737 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a5793-bb9e-43f6-858a-c0e81359fa32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:11.549639 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a5793-bb9e-43f6-858a-c0e81359fa32 None admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:11.549951 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a5793-bb9e-43f6-858a-c0e81359fa32 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:11.550228 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a5793-bb9e-43f6-858a-c0e81359fa32 None admin] PATH_INFO: `/v3/projects/7660c9e611fc4315b714c975f6e5f41e/groups/122175f93ab74220a2eaadd07b64bc72/roles/c9b1f4b47f054f7a8a9a079e65a7197a` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:11.552591 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a5793-bb9e-43f6-858a-c0e81359fa32 None admin] RBAC: Authorizing `identity:create_grant(project_id=7660c9e611fc4315b714c975f6e5f41e, group_id=122175f93ab74220a2eaadd07b64bc72, role_id=c9b1f4b47f054f7a8a9a079e65a7197a)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:11.554132 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a5793-bb9e-43f6-858a-c0e81359fa32 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:11.577735 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 201/387] 10.222.0.27 () {58 vars in 1442 bytes} [Fri Jul 15 17:24:11 2022] PUT /identity/v3/projects/7660c9e611fc4315b714c975f6e5f41e/groups/122175f93ab74220a2eaadd07b64bc72/roles/c9b1f4b47f054f7a8a9a079e65a7197a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:24:11.877563 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb44541-7318-4b06-91ab-f7c636125d44 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:11.878330 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb44541-7318-4b06-91ab-f7c636125d44 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:11.878815 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb44541-7318-4b06-91ab-f7c636125d44 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:11.880766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 187/388] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:11.886551 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11f03d-752e-46cf-8cfe-18c1e781d163 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:11.887096 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11f03d-752e-46cf-8cfe-18c1e781d163 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:11.887575 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11f03d-752e-46cf-8cfe-18c1e781d163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:11.907118 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-7d11f03d-752e-46cf-8cfe-18c1e781d163 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:11.908668 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7d11f03d-752e-46cf-8cfe-18c1e781d163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:11.988465 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 202/389] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:24:12.022546 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb44541-7318-4b06-91ab-f7c636125d44 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:12.165613 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb44541-7318-4b06-91ab-f7c636125d44 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:12.167863 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3dce0c-a771-45bc-9e9e-a5069ada4849 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:12.168315 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3dce0c-a771-45bc-9e9e-a5069ada4849 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:12.168407 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3dce0c-a771-45bc-9e9e-a5069ada4849 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:12.169924 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 203/390] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:12.175528 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967dd46-fd66-4330-9343-3eed92b30578 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:12.176221 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967dd46-fd66-4330-9343-3eed92b30578 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:12.176694 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967dd46-fd66-4330-9343-3eed92b30578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:12.194696 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-1967dd46-fd66-4330-9343-3eed92b30578 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:12.196256 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1967dd46-fd66-4330-9343-3eed92b30578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:12.222127 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:12.230016 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66025d-850e-4485-aa43-f89393807e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:12.230838 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66025d-850e-4485-aa43-f89393807e98 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:12.231172 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66025d-850e-4485-aa43-f89393807e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:12.231442 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66025d-850e-4485-aa43-f89393807e98 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:12.251838 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f66025d-850e-4485-aa43-f89393807e98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:24:12.259895 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-8f66025d-850e-4485-aa43-f89393807e98 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 17:24:12.259895 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:12.259895 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:12.259895 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:12.259895 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:12.259895 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:12.259895 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:12.259895 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:12.259895 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:12.259895 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:12.259895 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:12.259895 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:12.259895 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:24:12.259895 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:24:12.259895 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:24:12.259895 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:24:12.260774 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:24:12.260774 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:24:12.260774 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:24:12.260774 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:24:12.260774 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:12.260774 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:12.260774 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:12.260774 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:12.260774 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:12.260774 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:12.260774 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:12.260774 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:12.260774 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:12.260774 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:12.260774 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:12.260774 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:12.261639 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:12.261639 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:12.261639 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:12.261639 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:12.261639 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:24:12.261639 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:24:12.261639 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:24:12.261639 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:24:12.261639 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:24:12.261639 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:24:12.261639 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 17:24:12.261639 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:12.261639 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 188/391] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:24:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:12.267735 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66025d-850e-4485-aa43-f89393807e98 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:12.297882 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:12.339794 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 204/392] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 17:24:12.365368 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1967dd46-fd66-4330-9343-3eed92b30578 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:12.434325 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66025d-850e-4485-aa43-f89393807e98 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:12.507651 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f598e-7e1a-44ed-8874-bce966eaef2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:12.508339 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f598e-7e1a-44ed-8874-bce966eaef2a None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:12.508619 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f598e-7e1a-44ed-8874-bce966eaef2a None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:12.508890 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f598e-7e1a-44ed-8874-bce966eaef2a None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:12.509651 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381f598e-7e1a-44ed-8874-bce966eaef2a None admin] RBAC: Adding query filter params (name=member) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:12.509977 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381f598e-7e1a-44ed-8874-bce966eaef2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:12.511376 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381f598e-7e1a-44ed-8874-bce966eaef2a None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:12.534073 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 189/393] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jul 15 17:24:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:24:12.535852 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f598e-7e1a-44ed-8874-bce966eaef2a None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:12.558899 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1967dd46-fd66-4330-9343-3eed92b30578 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:12.614510 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84580f3-25dd-47c0-b43f-53491230d5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:12.615327 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84580f3-25dd-47c0-b43f-53491230d5fb None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:12.615610 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84580f3-25dd-47c0-b43f-53491230d5fb None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:12.615887 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84580f3-25dd-47c0-b43f-53491230d5fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:12.638835 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84580f3-25dd-47c0-b43f-53491230d5fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:24:12.650248 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-d84580f3-25dd-47c0-b43f-53491230d5fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 17:24:12.650248 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:12.650248 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:12.650248 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:12.650248 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:12.650248 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:12.650248 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:12.650248 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:12.650248 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:12.650248 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:12.650248 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:12.650248 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:12.650248 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:24:12.650248 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:24:12.650248 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:24:12.650248 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:24:12.651151 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:24:12.651151 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:24:12.651151 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:24:12.651151 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:24:12.651151 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:12.651151 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:12.651151 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:12.651151 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:12.651151 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:12.651151 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:12.651151 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:12.651151 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:12.651151 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:12.651151 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:12.651151 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:12.651151 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:12.651947 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:12.651947 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:12.651947 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:12.651947 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:12.651947 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:24:12.651947 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:24:12.651947 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:24:12.651947 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:24:12.651947 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:24:12.651947 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:24:12.651947 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 17:24:12.651947 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:12.651947 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 205/394] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:24:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 17:24:12.659244 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84580f3-25dd-47c0-b43f-53491230d5fb None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:12.673478 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:12.734386 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:12.745513 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f598e-7e1a-44ed-8874-bce966eaef2a None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:12.785047 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5787a-b567-47ad-b787-2f1749a2d4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:12.785373 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84580f3-25dd-47c0-b43f-53491230d5fb None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:12.786546 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5787a-b567-47ad-b787-2f1749a2d4fe None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:12.787283 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5787a-b567-47ad-b787-2f1749a2d4fe None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:12.788659 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5787a-b567-47ad-b787-2f1749a2d4fe None admin] PATH_INFO: `/v3/groups/122175f93ab74220a2eaadd07b64bc72` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:12.790119 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c5787a-b567-47ad-b787-2f1749a2d4fe None admin] RBAC: Authorizing `identity:get_group(group_id=122175f93ab74220a2eaadd07b64bc72)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:12.791752 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c5787a-b567-47ad-b787-2f1749a2d4fe None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:12.795075 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 190/395] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Jul 15 17:24:12 2022] GET /identity/v3/groups/122175f93ab74220a2eaadd07b64bc72 => generated 226 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:12.796637 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976aafb-3d05-4fc2-8d13-82676ade5074 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:12.797151 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976aafb-3d05-4fc2-8d13-82676ade5074 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:12.797617 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976aafb-3d05-4fc2-8d13-82676ade5074 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:12.799798 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 191/396] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:12.800982 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0976aafb-3d05-4fc2-8d13-82676ade5074 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:12.827998 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a449bc-5087-4680-a3e7-7016973bb12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:12.828670 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a449bc-5087-4680-a3e7-7016973bb12b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:12.828948 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a449bc-5087-4680-a3e7-7016973bb12b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:12.829218 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a449bc-5087-4680-a3e7-7016973bb12b None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:12.829987 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a449bc-5087-4680-a3e7-7016973bb12b None admin] RBAC: Adding query filter params (name=member) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:12.830288 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a449bc-5087-4680-a3e7-7016973bb12b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:12.831994 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a449bc-5087-4680-a3e7-7016973bb12b None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:12.845418 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 206/397] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jul 15 17:24:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:12.846793 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a2afb-5912-42dd-8db4-712d3bd3bce5 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:12.847080 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a2afb-5912-42dd-8db4-712d3bd3bce5 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:12.847353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a2afb-5912-42dd-8db4-712d3bd3bce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:12.864466 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-a59a2afb-5912-42dd-8db4-712d3bd3bce5 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:12.865647 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a59a2afb-5912-42dd-8db4-712d3bd3bce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:12.934481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 207/398] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:24:12.936136 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0976aafb-3d05-4fc2-8d13-82676ade5074 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:12.938643 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a2afb-5912-42dd-8db4-712d3bd3bce5 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:12.941077 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:12.977876 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9f038-9fff-4e9a-b81b-79829bb37ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:12.979164 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9f038-9fff-4e9a-b81b-79829bb37ff1 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:12.979655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9f038-9fff-4e9a-b81b-79829bb37ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:12.980221 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9f038-9fff-4e9a-b81b-79829bb37ff1 None admin] PATH_INFO: `/v3/projects/debcff5d6200462baae7bebc7bb34145` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:12.981856 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a9f038-9fff-4e9a-b81b-79829bb37ff1 None admin] RBAC: Authorizing `identity:get_project(project_id=debcff5d6200462baae7bebc7bb34145)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:12.983954 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a9f038-9fff-4e9a-b81b-79829bb37ff1 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:12.986320 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 192/399] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:24:12 2022] GET /identity/v3/projects/debcff5d6200462baae7bebc7bb34145 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:12.987371 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9f038-9fff-4e9a-b81b-79829bb37ff1 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:13.017115 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:13.064464 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a2afb-5912-42dd-8db4-712d3bd3bce5 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:13.099505 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9f038-9fff-4e9a-b81b-79829bb37ff1 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:13.099943 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb2f69-8e96-4783-b86d-ea240d443bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:13.100808 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb2f69-8e96-4783-b86d-ea240d443bcd None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:13.101082 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb2f69-8e96-4783-b86d-ea240d443bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:13.101403 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb2f69-8e96-4783-b86d-ea240d443bcd None admin] PATH_INFO: `/v3/groups/122175f93ab74220a2eaadd07b64bc72` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:13.102653 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb2f69-8e96-4783-b86d-ea240d443bcd None admin] RBAC: Authorizing `identity:get_group(group_id=122175f93ab74220a2eaadd07b64bc72)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:13.104087 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb2f69-8e96-4783-b86d-ea240d443bcd None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:13.105887 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 208/400] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Jul 15 17:24:12 2022] GET /identity/v3/groups/122175f93ab74220a2eaadd07b64bc72 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:13.106445 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb2f69-8e96-4783-b86d-ea240d443bcd None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:13.138276 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628d721-d42f-4542-b1fa-42524fb13321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:13.139610 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628d721-d42f-4542-b1fa-42524fb13321 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:13.140093 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628d721-d42f-4542-b1fa-42524fb13321 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:13.140578 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628d721-d42f-4542-b1fa-42524fb13321 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:13.151667 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6628d721-d42f-4542-b1fa-42524fb13321 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:24:13.160531 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-6628d721-d42f-4542-b1fa-42524fb13321 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 17:24:13.160531 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:13.160531 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:13.160531 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:13.160531 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:13.160531 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:13.160531 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:13.160531 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:13.160531 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:13.160531 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:13.160531 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:13.160531 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:13.160531 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:24:13.160531 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:24:13.160531 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:24:13.160531 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:24:13.161422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:24:13.161422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:24:13.161422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:24:13.161422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:24:13.161422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:13.161422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:13.161422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:13.161422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:13.161422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:13.161422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:13.161422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:13.161422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:13.161422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:13.161422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:13.161422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:13.161422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:13.162247 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:13.162247 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:13.162247 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:13.162247 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:13.162247 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:24:13.162247 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:24:13.162247 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:24:13.162247 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:24:13.162247 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:24:13.162247 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:24:13.162247 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 17:24:13.162247 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:13.164893 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 193/401] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Jul 15 17:24:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:13.165947 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628d721-d42f-4542-b1fa-42524fb13321 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:13.186535 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:13.219681 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb2f69-8e96-4783-b86d-ea240d443bcd None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:13.255449 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744b680-2c35-48de-98a5-36d9f5eed907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:13.256251 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744b680-2c35-48de-98a5-36d9f5eed907 None admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:13.256527 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744b680-2c35-48de-98a5-36d9f5eed907 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:13.256879 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744b680-2c35-48de-98a5-36d9f5eed907 None admin] PATH_INFO: `/v3/projects/debcff5d6200462baae7bebc7bb34145/groups/122175f93ab74220a2eaadd07b64bc72/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:13.258199 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:13.259080 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744b680-2c35-48de-98a5-36d9f5eed907 None admin] RBAC: Authorizing `identity:create_grant(project_id=debcff5d6200462baae7bebc7bb34145, group_id=122175f93ab74220a2eaadd07b64bc72, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:13.260737 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744b680-2c35-48de-98a5-36d9f5eed907 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:13.276061 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628d721-d42f-4542-b1fa-42524fb13321 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:13.284226 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 209/402] 10.222.0.27 () {58 vars in 1442 bytes} [Fri Jul 15 17:24:13 2022] PUT /identity/v3/projects/debcff5d6200462baae7bebc7bb34145/groups/122175f93ab74220a2eaadd07b64bc72/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:24:13.284226 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744b680-2c35-48de-98a5-36d9f5eed907 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:13.357552 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e96311-6a2c-44c5-a565-cc4b10b11e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:13.358904 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e96311-6a2c-44c5-a565-cc4b10b11e67 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:13.360470 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e96311-6a2c-44c5-a565-cc4b10b11e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:13.360730 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e96311-6a2c-44c5-a565-cc4b10b11e67 None admin] PATH_INFO: `/v3/projects/7660c9e611fc4315b714c975f6e5f41e` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:13.363002 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e96311-6a2c-44c5-a565-cc4b10b11e67 None admin] RBAC: Authorizing `identity:get_project(project_id=7660c9e611fc4315b714c975f6e5f41e)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:13.365758 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e96311-6a2c-44c5-a565-cc4b10b11e67 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:13.368584 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 194/403] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:24:13 2022] GET /identity/v3/projects/7660c9e611fc4315b714c975f6e5f41e => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:13.370031 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808df1d7-c703-4b81-a8e2-8b3461829dcb None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:13.370320 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808df1d7-c703-4b81-a8e2-8b3461829dcb None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:13.370595 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808df1d7-c703-4b81-a8e2-8b3461829dcb None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:13.372141 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 195/404] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:13.376511 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808df1d7-c703-4b81-a8e2-8b3461829dcb None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:13.462595 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744b680-2c35-48de-98a5-36d9f5eed907 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:13.499152 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808df1d7-c703-4b81-a8e2-8b3461829dcb None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:13.510261 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:13.521357 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232630d3-e28d-4f11-872d-0cd926993f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:13.522115 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232630d3-e28d-4f11-872d-0cd926993f58 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:13.522397 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232630d3-e28d-4f11-872d-0cd926993f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:13.522670 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232630d3-e28d-4f11-872d-0cd926993f58 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:13.523433 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232630d3-e28d-4f11-872d-0cd926993f58 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:13.523736 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232630d3-e28d-4f11-872d-0cd926993f58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:13.525117 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232630d3-e28d-4f11-872d-0cd926993f58 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:13.537489 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 210/405] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:24:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:13.541852 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f83b2-6316-4afd-8479-74c8b1572f50 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:13.541852 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f83b2-6316-4afd-8479-74c8b1572f50 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:13.541852 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f83b2-6316-4afd-8479-74c8b1572f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:13.545450 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458e496-e240-4a86-85e3-1e225aee6970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:13.546657 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458e496-e240-4a86-85e3-1e225aee6970 None admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:13.547191 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458e496-e240-4a86-85e3-1e225aee6970 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:13.547648 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458e496-e240-4a86-85e3-1e225aee6970 None admin] PATH_INFO: `/v3/projects/7660c9e611fc4315b714c975f6e5f41e/groups/122175f93ab74220a2eaadd07b64bc72/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:13.550123 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458e496-e240-4a86-85e3-1e225aee6970 None admin] RBAC: Authorizing `identity:create_grant(project_id=7660c9e611fc4315b714c975f6e5f41e, group_id=122175f93ab74220a2eaadd07b64bc72, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:13.551952 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458e496-e240-4a86-85e3-1e225aee6970 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:13.557328 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-c13f83b2-6316-4afd-8479-74c8b1572f50 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:13.559163 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c13f83b2-6316-4afd-8479-74c8b1572f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:13.572358 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 196/406] 10.222.0.27 () {58 vars in 1442 bytes} [Fri Jul 15 17:24:13 2022] PUT /identity/v3/projects/7660c9e611fc4315b714c975f6e5f41e/groups/122175f93ab74220a2eaadd07b64bc72/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:24:13.582380 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458e496-e240-4a86-85e3-1e225aee6970 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:13.606912 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:13.632911 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 211/407] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:24:13.661293 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f83b2-6316-4afd-8479-74c8b1572f50 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:13.748324 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458e496-e240-4a86-85e3-1e225aee6970 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:13.787159 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d238f-2231-4ac2-bace-ad84359430e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:13.788431 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d238f-2231-4ac2-bace-ad84359430e8 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:13.788929 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d238f-2231-4ac2-bace-ad84359430e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:13.789388 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d238f-2231-4ac2-bace-ad84359430e8 None admin] PATH_INFO: `/v3/groups/122175f93ab74220a2eaadd07b64bc72` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:13.790848 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d238f-2231-4ac2-bace-ad84359430e8 None admin] RBAC: Authorizing `identity:get_group(group_id=122175f93ab74220a2eaadd07b64bc72)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:13.792642 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d238f-2231-4ac2-bace-ad84359430e8 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:13.794951 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 197/408] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Jul 15 17:24:13 2022] GET /identity/v3/groups/122175f93ab74220a2eaadd07b64bc72 => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:13.800768 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d238f-2231-4ac2-bace-ad84359430e8 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:13.827651 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f83b2-6316-4afd-8479-74c8b1572f50 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:13.869552 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:13.888953 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79cacea-090d-49a2-98c7-05a562eeba2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:13.889920 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79cacea-090d-49a2-98c7-05a562eeba2b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:13.890206 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79cacea-090d-49a2-98c7-05a562eeba2b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:13.890525 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79cacea-090d-49a2-98c7-05a562eeba2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:13.898011 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:13.906079 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79cacea-090d-49a2-98c7-05a562eeba2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:24:13.917896 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-f79cacea-090d-49a2-98c7-05a562eeba2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:24:13.917896 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:13.917896 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:13.917896 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:13.917896 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:13.917896 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:13.917896 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:13.917896 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:13.917896 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:13.917896 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:13.917896 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:13.917896 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:13.917896 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:24:13.917896 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:24:13.917896 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:24:13.917896 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:24:13.918803 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:24:13.918803 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:24:13.918803 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:24:13.918803 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:24:13.918803 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:13.918803 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:13.918803 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:13.918803 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:13.918803 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:13.918803 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:13.918803 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:13.918803 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:13.918803 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:13.918803 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:13.918803 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:13.918803 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:13.919604 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:13.919604 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:13.919604 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:13.919604 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:13.919604 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:24:13.919604 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:24:13.919604 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:24:13.919604 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:24:13.919604 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:24:13.919604 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:24:13.919604 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:24:13.919604 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:13.920209 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d238f-2231-4ac2-bace-ad84359430e8 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:13.923630 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 212/409] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jul 15 17:24:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:13.929842 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79cacea-090d-49a2-98c7-05a562eeba2b None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:13.956760 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3928631-3e8e-49d2-af5c-89e70d0adab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:13.957638 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3928631-3e8e-49d2-af5c-89e70d0adab5 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:13.957941 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3928631-3e8e-49d2-af5c-89e70d0adab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:13.958209 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3928631-3e8e-49d2-af5c-89e70d0adab5 None admin] PATH_INFO: `/v3/projects/debcff5d6200462baae7bebc7bb34145` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:13.959396 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3928631-3e8e-49d2-af5c-89e70d0adab5 None admin] RBAC: Authorizing `identity:get_project(project_id=debcff5d6200462baae7bebc7bb34145)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:13.960936 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3928631-3e8e-49d2-af5c-89e70d0adab5 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:13.962965 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 198/410] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:24:13 2022] GET /identity/v3/projects/debcff5d6200462baae7bebc7bb34145 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:24:13.968900 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3928631-3e8e-49d2-af5c-89e70d0adab5 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:14.069919 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79cacea-090d-49a2-98c7-05a562eeba2b None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:14.081993 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3928631-3e8e-49d2-af5c-89e70d0adab5 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:14.110836 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455dee44-ed59-4501-ab3f-19fee2f4c880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:14.111511 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455dee44-ed59-4501-ab3f-19fee2f4c880 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:14.111795 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455dee44-ed59-4501-ab3f-19fee2f4c880 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:14.112156 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455dee44-ed59-4501-ab3f-19fee2f4c880 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:14.113107 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455dee44-ed59-4501-ab3f-19fee2f4c880 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:14.113419 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455dee44-ed59-4501-ab3f-19fee2f4c880 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:14.114843 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455dee44-ed59-4501-ab3f-19fee2f4c880 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:14.121890 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e1d895-973f-4695-8cdf-038037f0f9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:14.122897 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1d895-973f-4695-8cdf-038037f0f9c8 None admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:14.123171 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1d895-973f-4695-8cdf-038037f0f9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:14.123577 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1d895-973f-4695-8cdf-038037f0f9c8 None admin] PATH_INFO: `/v3/projects/debcff5d6200462baae7bebc7bb34145/groups/122175f93ab74220a2eaadd07b64bc72/roles/c9b1f4b47f054f7a8a9a079e65a7197a` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:14.124352 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 213/411] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:24:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:14.125662 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a5a36-6459-4857-a0b7-be622ee0e7be None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:14.125873 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e1d895-973f-4695-8cdf-038037f0f9c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=debcff5d6200462baae7bebc7bb34145, group_id=122175f93ab74220a2eaadd07b64bc72, role_id=c9b1f4b47f054f7a8a9a079e65a7197a)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:14.125974 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a5a36-6459-4857-a0b7-be622ee0e7be None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:14.126241 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a5a36-6459-4857-a0b7-be622ee0e7be None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:14.127325 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e1d895-973f-4695-8cdf-038037f0f9c8 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:14.131924 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 214/412] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:14.133085 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a5a36-6459-4857-a0b7-be622ee0e7be None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:14.143345 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 199/413] 10.222.0.27 () {58 vars in 1442 bytes} [Fri Jul 15 17:24:13 2022] PUT /identity/v3/projects/debcff5d6200462baae7bebc7bb34145/groups/122175f93ab74220a2eaadd07b64bc72/roles/c9b1f4b47f054f7a8a9a079e65a7197a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:24:14.146808 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0823a1-aeab-434f-8e3a-12e09305f8ca None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:14.147104 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0823a1-aeab-434f-8e3a-12e09305f8ca None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:14.147380 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0823a1-aeab-434f-8e3a-12e09305f8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:14.183630 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-6a0823a1-aeab-434f-8e3a-12e09305f8ca None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:14.186479 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-6a0823a1-aeab-434f-8e3a-12e09305f8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:14.193552 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:14.225284 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:14.325087 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 200/414] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:24:14.339483 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a5a36-6459-4857-a0b7-be622ee0e7be None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:14.364075 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0823a1-aeab-434f-8e3a-12e09305f8ca None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:14.380761 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2ed20-0687-486c-b386-ea784c3978dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:14.382114 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2ed20-0687-486c-b386-ea784c3978dc None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:14.382602 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2ed20-0687-486c-b386-ea784c3978dc None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:14.383081 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2ed20-0687-486c-b386-ea784c3978dc None admin] PATH_INFO: `/v3/groups/be8ba8abbb06442ca073f2b9aa2b8c39` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:14.384635 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf2ed20-0687-486c-b386-ea784c3978dc None admin] RBAC: Authorizing `identity:get_group(group_id=be8ba8abbb06442ca073f2b9aa2b8c39)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:14.386496 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf2ed20-0687-486c-b386-ea784c3978dc None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:14.388401 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 215/415] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Jul 15 17:24:14 2022] GET /identity/v3/groups/be8ba8abbb06442ca073f2b9aa2b8c39 => generated 229 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:14.394795 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2ed20-0687-486c-b386-ea784c3978dc None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:14.494461 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0823a1-aeab-434f-8e3a-12e09305f8ca None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:14.510356 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2ed20-0687-486c-b386-ea784c3978dc None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:14.526134 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:14.545082 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f915cd-e749-49eb-95bb-cc7c98e8399c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:14.547581 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f915cd-e749-49eb-95bb-cc7c98e8399c None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:14.548211 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f915cd-e749-49eb-95bb-cc7c98e8399c None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:14.550657 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f915cd-e749-49eb-95bb-cc7c98e8399c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:14.564648 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ac881-5def-495b-9ecd-909bc81d5890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:14.565917 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ac881-5def-495b-9ecd-909bc81d5890 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:14.566390 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ac881-5def-495b-9ecd-909bc81d5890 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:14.566849 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ac881-5def-495b-9ecd-909bc81d5890 None admin] PATH_INFO: `/v3/projects/3c32a3d29e5f4e56a46352866cc5acd0` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:14.568373 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:14.570928 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ac881-5def-495b-9ecd-909bc81d5890 None admin] RBAC: Authorizing `identity:get_project(project_id=3c32a3d29e5f4e56a46352866cc5acd0)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:14.572429 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ac881-5def-495b-9ecd-909bc81d5890 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:14.574179 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 216/416] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:24:14 2022] GET /identity/v3/projects/3c32a3d29e5f4e56a46352866cc5acd0 => generated 344 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:24:14.578603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f915cd-e749-49eb-95bb-cc7c98e8399c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:24:14.582805 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ac881-5def-495b-9ecd-909bc81d5890 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:14.599628 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-f6f915cd-e749-49eb-95bb-cc7c98e8399c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 17:24:14.599628 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:14.599628 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:14.599628 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:14.599628 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:14.599628 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:14.599628 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:14.599628 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:14.599628 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:14.599628 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:14.599628 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:14.599628 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:14.599628 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:24:14.599628 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:24:14.599628 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:24:14.599628 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:24:14.600603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:24:14.600603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:24:14.600603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:24:14.600603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:24:14.600603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:14.600603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:14.600603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:14.600603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:14.600603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:14.600603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:14.600603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:14.600603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:14.600603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:14.600603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:14.600603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:14.600603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:14.601390 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:14.601390 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:14.601390 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:14.601390 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:14.601390 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:24:14.601390 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:24:14.601390 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:24:14.601390 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:24:14.601390 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:24:14.601390 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:24:14.601390 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 17:24:14.601390 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:14.610315 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 201/417] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Jul 15 17:24:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 17:24:14.616496 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f915cd-e749-49eb-95bb-cc7c98e8399c None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:14.703166 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ac881-5def-495b-9ecd-909bc81d5890 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:14.747322 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d191146-cd84-4c38-a7df-9742716980d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:14.748778 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d191146-cd84-4c38-a7df-9742716980d0 None admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:14.755666 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d191146-cd84-4c38-a7df-9742716980d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:14.756167 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d191146-cd84-4c38-a7df-9742716980d0 None admin] PATH_INFO: `/v3/projects/3c32a3d29e5f4e56a46352866cc5acd0/groups/be8ba8abbb06442ca073f2b9aa2b8c39/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:14.758507 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d191146-cd84-4c38-a7df-9742716980d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=3c32a3d29e5f4e56a46352866cc5acd0, group_id=be8ba8abbb06442ca073f2b9aa2b8c39, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:14.760176 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d191146-cd84-4c38-a7df-9742716980d0 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:14.792762 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 217/418] 10.222.0.27 () {58 vars in 1442 bytes} [Fri Jul 15 17:24:14 2022] PUT /identity/v3/projects/3c32a3d29e5f4e56a46352866cc5acd0/groups/be8ba8abbb06442ca073f2b9aa2b8c39/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:24:14.799363 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f915cd-e749-49eb-95bb-cc7c98e8399c None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:14.845810 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d5d29-1aa5-461d-81b1-94ea55cd6f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:14.847175 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d5d29-1aa5-461d-81b1-94ea55cd6f5e None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:14.847883 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d5d29-1aa5-461d-81b1-94ea55cd6f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:14.848498 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d5d29-1aa5-461d-81b1-94ea55cd6f5e None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:14.849490 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693d5d29-1aa5-461d-81b1-94ea55cd6f5e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:14.850034 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693d5d29-1aa5-461d-81b1-94ea55cd6f5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:14.851698 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693d5d29-1aa5-461d-81b1-94ea55cd6f5e None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:14.861601 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 202/419] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:24:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:24:14.867616 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d191146-cd84-4c38-a7df-9742716980d0 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:14.926474 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:15.011500 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d191146-cd84-4c38-a7df-9742716980d0 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:15.051604 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c3c6c7-15c4-4dea-9feb-2ad4809e24e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:15.052282 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3c6c7-15c4-4dea-9feb-2ad4809e24e3 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:15.052564 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3c6c7-15c4-4dea-9feb-2ad4809e24e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:15.052839 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3c6c7-15c4-4dea-9feb-2ad4809e24e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:15.127450 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c3c6c7-15c4-4dea-9feb-2ad4809e24e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:15.128859 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c3c6c7-15c4-4dea-9feb-2ad4809e24e3 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:15.172018 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:15.232000 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 218/420] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:24:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 17:24:15.237808 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d5d29-1aa5-461d-81b1-94ea55cd6f5e None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:15.307785 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:15.359951 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d5d29-1aa5-461d-81b1-94ea55cd6f5e None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:15.407362 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94437d-e6f2-4aad-80bd-88f23999dfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:15.408176 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94437d-e6f2-4aad-80bd-88f23999dfaa None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:15.408458 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94437d-e6f2-4aad-80bd-88f23999dfaa None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:15.408735 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94437d-e6f2-4aad-80bd-88f23999dfaa None admin] PATH_INFO: `/v3/projects/7660c9e611fc4315b714c975f6e5f41e` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:15.409995 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94437d-e6f2-4aad-80bd-88f23999dfaa None admin] RBAC: Authorizing `identity:get_project(project_id=7660c9e611fc4315b714c975f6e5f41e)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:15.411436 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94437d-e6f2-4aad-80bd-88f23999dfaa None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:15.413157 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 203/421] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:24:15 2022] GET /identity/v3/projects/7660c9e611fc4315b714c975f6e5f41e => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:15.418762 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c3c6c7-15c4-4dea-9feb-2ad4809e24e3 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:15.521407 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c3c6c7-15c4-4dea-9feb-2ad4809e24e3 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:15.557111 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9083461-9832-44ef-ac5a-a1d50a469bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:15.558004 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9083461-9832-44ef-ac5a-a1d50a469bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:15.558288 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9083461-9832-44ef-ac5a-a1d50a469bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:15.558559 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9083461-9832-44ef-ac5a-a1d50a469bb9 None admin] PATH_INFO: `/v3/groups/122175f93ab74220a2eaadd07b64bc72` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:15.559725 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9083461-9832-44ef-ac5a-a1d50a469bb9 None admin] RBAC: Authorizing `identity:get_group(group_id=122175f93ab74220a2eaadd07b64bc72)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:15.561387 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9083461-9832-44ef-ac5a-a1d50a469bb9 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:15.563401 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 219/422] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Jul 15 17:24:15 2022] GET /identity/v3/groups/122175f93ab74220a2eaadd07b64bc72 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:15.569371 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94437d-e6f2-4aad-80bd-88f23999dfaa None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:15.583420 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeee9b2-011a-44c6-a40e-c660aa508ce4 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:15.583721 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeee9b2-011a-44c6-a40e-c660aa508ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:15.583977 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeee9b2-011a-44c6-a40e-c660aa508ce4 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:15.585616 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 220/423] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:15.593852 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b2b83-903c-437e-9555-35a673f008b0 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:15.594157 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b2b83-903c-437e-9555-35a673f008b0 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:15.594441 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b2b83-903c-437e-9555-35a673f008b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:15.626905 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-d39b2b83-903c-437e-9555-35a673f008b0 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:15.628137 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d39b2b83-903c-437e-9555-35a673f008b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:15.630381 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:15.686594 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94437d-e6f2-4aad-80bd-88f23999dfaa None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:15.732255 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 221/424] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:24:15.739953 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:15.744826 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89763fa5-e1e5-43d2-892e-2d6224d2832e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:15.745612 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89763fa5-e1e5-43d2-892e-2d6224d2832e None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:15.745999 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89763fa5-e1e5-43d2-892e-2d6224d2832e None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:15.746481 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89763fa5-e1e5-43d2-892e-2d6224d2832e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:15.747323 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89763fa5-e1e5-43d2-892e-2d6224d2832e None admin] RBAC: Adding query filter params (group.id=122175f93ab74220a2eaadd07b64bc72, role.id=c9b1f4b47f054f7a8a9a079e65a7197a, scope.project.id=7660c9e611fc4315b714c975f6e5f41e) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:15.747645 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89763fa5-e1e5-43d2-892e-2d6224d2832e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:15.749112 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89763fa5-e1e5-43d2-892e-2d6224d2832e None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:15.755676 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 204/425] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Jul 15 17:24:15 2022] GET /identity/v3/role_assignments?group.id=122175f93ab74220a2eaadd07b64bc72&scope.project.id=7660c9e611fc4315b714c975f6e5f41e&role.id=c9b1f4b47f054f7a8a9a079e65a7197a => generated 611 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:15.775378 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b2b83-903c-437e-9555-35a673f008b0 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:15.890195 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b2b83-903c-437e-9555-35a673f008b0 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:15.927516 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5499f2-5f2a-4da9-ab24-c2bbeb5ecb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:15.928421 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5499f2-5f2a-4da9-ab24-c2bbeb5ecb13 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:15.928705 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5499f2-5f2a-4da9-ab24-c2bbeb5ecb13 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:15.929028 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5499f2-5f2a-4da9-ab24-c2bbeb5ecb13 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:15.940668 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5499f2-5f2a-4da9-ab24-c2bbeb5ecb13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:24:15.946325 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:15.949234 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-1a5499f2-5f2a-4da9-ab24-c2bbeb5ecb13 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 17:24:15.949234 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:15.949234 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:15.949234 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:15.949234 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:15.949234 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:15.949234 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:15.949234 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:15.949234 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:15.949234 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:15.949234 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:15.949234 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:15.949234 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:24:15.949234 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:24:15.949234 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:24:15.949234 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:24:15.950331 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:24:15.950331 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:24:15.950331 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:24:15.950331 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:24:15.950331 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:15.950331 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:15.950331 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:15.950331 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:15.950331 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:15.950331 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:15.950331 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:15.950331 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:15.950331 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:15.950331 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:15.950331 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:15.950331 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:15.951303 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:15.951303 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:15.951303 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:15.951303 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:15.951303 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:24:15.951303 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:24:15.951303 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:24:15.951303 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:24:15.951303 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:24:15.951303 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:24:15.951303 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 17:24:15.951303 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:15.953916 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 222/426] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:24:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:15.961059 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89763fa5-e1e5-43d2-892e-2d6224d2832e None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:16.066020 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89763fa5-e1e5-43d2-892e-2d6224d2832e None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:16.104173 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c529914-bcaa-4c78-be39-e0eae02a9fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:16.104854 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c529914-bcaa-4c78-be39-e0eae02a9fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:16.105137 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c529914-bcaa-4c78-be39-e0eae02a9fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:16.105412 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c529914-bcaa-4c78-be39-e0eae02a9fe5 None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:16.106227 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c529914-bcaa-4c78-be39-e0eae02a9fe5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:16.106530 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c529914-bcaa-4c78-be39-e0eae02a9fe5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:16.108047 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c529914-bcaa-4c78-be39-e0eae02a9fe5 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:16.118423 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 205/427] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jul 15 17:24:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:16.126909 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5499f2-5f2a-4da9-ab24-c2bbeb5ecb13 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:16.242333 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5499f2-5f2a-4da9-ab24-c2bbeb5ecb13 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:16.285011 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45dec24-5a82-4db7-bbc8-69f91005749a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:16.285966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45dec24-5a82-4db7-bbc8-69f91005749a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:16.286445 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45dec24-5a82-4db7-bbc8-69f91005749a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:16.286846 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45dec24-5a82-4db7-bbc8-69f91005749a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:16.338796 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f284e5a-47bf-42ee-9a33-c3fc325e721e None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:16.339181 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f284e5a-47bf-42ee-9a33-c3fc325e721e None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:16.339524 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f284e5a-47bf-42ee-9a33-c3fc325e721e None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:16.340984 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 206/428] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:16.346811 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dbe910-ceac-44e8-9c64-9a984e6d333e None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:16.347099 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dbe910-ceac-44e8-9c64-9a984e6d333e None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:16.347375 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dbe910-ceac-44e8-9c64-9a984e6d333e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:16.366661 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:16.368944 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-56dbe910-ceac-44e8-9c64-9a984e6d333e None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:16.370663 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45dec24-5a82-4db7-bbc8-69f91005749a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:16.370968 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-56dbe910-ceac-44e8-9c64-9a984e6d333e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:16.372154 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45dec24-5a82-4db7-bbc8-69f91005749a None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:16.434439 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:16.465864 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 207/429] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:24:16.481452 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 223/430] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:24:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 17:24:16.484285 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dbe910-ceac-44e8-9c64-9a984e6d333e None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:16.487589 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45dec24-5a82-4db7-bbc8-69f91005749a None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:16.591645 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dbe910-ceac-44e8-9c64-9a984e6d333e None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:16.606810 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:16.611263 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45dec24-5a82-4db7-bbc8-69f91005749a None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:16.636735 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac0f55-f744-436f-b29f-f81cf9bd5b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:16.637754 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac0f55-f744-436f-b29f-f81cf9bd5b00 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:16.638194 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac0f55-f744-436f-b29f-f81cf9bd5b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:16.638657 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac0f55-f744-436f-b29f-f81cf9bd5b00 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:16.647123 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8498e-ca26-48c9-b09a-764196ac5ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:16.647993 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8498e-ca26-48c9-b09a-764196ac5ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:16.648277 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8498e-ca26-48c9-b09a-764196ac5ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:16.648551 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8498e-ca26-48c9-b09a-764196ac5ed1 None admin] PATH_INFO: `/v3/projects/debcff5d6200462baae7bebc7bb34145` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:16.649743 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad8498e-ca26-48c9-b09a-764196ac5ed1 None admin] RBAC: Authorizing `identity:get_project(project_id=debcff5d6200462baae7bebc7bb34145)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:16.650832 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac0f55-f744-436f-b29f-f81cf9bd5b00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:24:16.651208 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad8498e-ca26-48c9-b09a-764196ac5ed1 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:16.652910 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 224/431] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:24:16 2022] GET /identity/v3/projects/debcff5d6200462baae7bebc7bb34145 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:24:16.657799 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c96fff-aac4-4c0c-8618-b5907867a043 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:16.657799 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c96fff-aac4-4c0c-8618-b5907867a043 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:16.657799 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c96fff-aac4-4c0c-8618-b5907867a043 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:16.657799 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 225/432] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:16.658669 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c96fff-aac4-4c0c-8618-b5907867a043 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:16.664701 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-15ac0f55-f744-436f-b29f-f81cf9bd5b00 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 17:24:16.664701 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:16.664701 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:16.664701 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:16.664701 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:16.664701 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:16.664701 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:16.664701 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:16.664701 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:16.664701 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:16.664701 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:16.664701 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:16.664701 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:24:16.664701 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:24:16.664701 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:24:16.664701 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:24:16.665751 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:24:16.665751 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:24:16.665751 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:24:16.665751 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:24:16.665751 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:16.665751 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:16.665751 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:16.665751 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:16.665751 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:16.665751 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:16.665751 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:16.665751 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:16.665751 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:16.665751 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:16.665751 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:16.665751 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:16.666766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:16.666766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:16.666766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:16.666766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:16.666766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:24:16.666766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:24:16.666766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:24:16.666766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:24:16.666766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:24:16.666766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:24:16.666766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 17:24:16.666766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:16.669173 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 208/433] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:24:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:16.670678 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80127b-1b0d-4e0c-8c29-ceed3181ac28 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:16.670953 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80127b-1b0d-4e0c-8c29-ceed3181ac28 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:16.671227 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80127b-1b0d-4e0c-8c29-ceed3181ac28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:16.688914 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-cb80127b-1b0d-4e0c-8c29-ceed3181ac28 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:16.690101 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-cb80127b-1b0d-4e0c-8c29-ceed3181ac28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:16.731276 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:16.757029 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 209/434] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:24:16.757899 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb80127b-1b0d-4e0c-8c29-ceed3181ac28 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:16.774368 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c96fff-aac4-4c0c-8618-b5907867a043 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:16.810757 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ba745-09c9-449d-b7a2-7fae879f438c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:16.811785 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ba745-09c9-449d-b7a2-7fae879f438c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:16.812066 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ba745-09c9-449d-b7a2-7fae879f438c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:16.812342 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ba745-09c9-449d-b7a2-7fae879f438c None admin] PATH_INFO: `/v3/groups/122175f93ab74220a2eaadd07b64bc72` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:16.813529 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ba745-09c9-449d-b7a2-7fae879f438c None admin] RBAC: Authorizing `identity:get_group(group_id=122175f93ab74220a2eaadd07b64bc72)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:16.814991 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ba745-09c9-449d-b7a2-7fae879f438c None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:16.821387 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 226/435] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Jul 15 17:24:16 2022] GET /identity/v3/groups/122175f93ab74220a2eaadd07b64bc72 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:16.821387 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ba745-09c9-449d-b7a2-7fae879f438c None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:16.853628 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:16.869401 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb80127b-1b0d-4e0c-8c29-ceed3181ac28 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:16.906640 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7205fc4d-2788-4fee-a00e-97259d399189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:16.907317 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205fc4d-2788-4fee-a00e-97259d399189 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:16.907602 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205fc4d-2788-4fee-a00e-97259d399189 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:16.907880 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205fc4d-2788-4fee-a00e-97259d399189 None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:16.908631 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7205fc4d-2788-4fee-a00e-97259d399189 None admin] RBAC: Adding query filter params (name=member) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:16.908937 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7205fc4d-2788-4fee-a00e-97259d399189 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:16.910346 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7205fc4d-2788-4fee-a00e-97259d399189 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:16.921942 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 210/436] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jul 15 17:24:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:16.921942 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7205fc4d-2788-4fee-a00e-97259d399189 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:16.929156 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ba745-09c9-449d-b7a2-7fae879f438c None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:16.963801 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:16.964822 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaaa467-7900-4f2e-8f72-43bdd2a930d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:16.965650 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaaa467-7900-4f2e-8f72-43bdd2a930d7 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:16.965963 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaaa467-7900-4f2e-8f72-43bdd2a930d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:16.966240 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaaa467-7900-4f2e-8f72-43bdd2a930d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:16.977756 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaaa467-7900-4f2e-8f72-43bdd2a930d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:24:16.986209 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-8aaaa467-7900-4f2e-8f72-43bdd2a930d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 17:24:16.986209 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:16.986209 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:16.986209 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:16.986209 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:16.986209 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:16.986209 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:16.986209 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:16.986209 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:16.986209 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:16.986209 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:16.986209 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:16.986209 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:24:16.986209 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:24:16.986209 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:24:16.986209 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:24:16.987088 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:24:16.987088 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:24:16.987088 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:24:16.987088 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:24:16.987088 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:16.987088 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:16.987088 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:16.987088 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:16.987088 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:16.987088 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:16.987088 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:16.987088 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:16.987088 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:16.987088 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:16.987088 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:16.987088 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:16.987887 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:16.987887 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:16.987887 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:16.987887 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:16.987887 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:24:16.987887 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:24:16.987887 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:24:16.987887 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:24:16.987887 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:24:16.987887 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:24:16.987887 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 17:24:16.987887 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:16.987887 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 227/437] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Jul 15 17:24:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:16.988539 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaaa467-7900-4f2e-8f72-43bdd2a930d7 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:17.032602 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7205fc4d-2788-4fee-a00e-97259d399189 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:17.071180 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf535d2-badd-4c22-8fbb-1cb3321a94db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:17.072113 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf535d2-badd-4c22-8fbb-1cb3321a94db None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:17.072395 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf535d2-badd-4c22-8fbb-1cb3321a94db None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:17.072715 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf535d2-badd-4c22-8fbb-1cb3321a94db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:17.073705 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf535d2-badd-4c22-8fbb-1cb3321a94db None admin] RBAC: Adding query filter params (group.id=122175f93ab74220a2eaadd07b64bc72, role.id=d8d52b8fc62e44cd9d551b855f2ac84b, scope.project.id=debcff5d6200462baae7bebc7bb34145) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:17.074402 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf535d2-badd-4c22-8fbb-1cb3321a94db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:17.076092 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf535d2-badd-4c22-8fbb-1cb3321a94db None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:17.089841 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 211/438] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Jul 15 17:24:16 2022] GET /identity/v3/role_assignments?group.id=122175f93ab74220a2eaadd07b64bc72&scope.project.id=debcff5d6200462baae7bebc7bb34145&role.id=d8d52b8fc62e44cd9d551b855f2ac84b => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:17.089841 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf535d2-badd-4c22-8fbb-1cb3321a94db None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:17.090119 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:17.094258 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaaa467-7900-4f2e-8f72-43bdd2a930d7 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:17.139491 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e383926-9a5e-42c6-b44e-224c173a15ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:17.140053 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e383926-9a5e-42c6-b44e-224c173a15ab None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:17.140331 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e383926-9a5e-42c6-b44e-224c173a15ab None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:17.140601 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e383926-9a5e-42c6-b44e-224c173a15ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:17.229767 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf535d2-badd-4c22-8fbb-1cb3321a94db None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:17.231526 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:17.241074 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e383926-9a5e-42c6-b44e-224c173a15ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:17.242935 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e383926-9a5e-42c6-b44e-224c173a15ab None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:17.270601 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c7a7f0-ecf5-4877-aa6b-fcc9a06c8adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:17.271269 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7a7f0-ecf5-4877-aa6b-fcc9a06c8adb None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:17.271548 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7a7f0-ecf5-4877-aa6b-fcc9a06c8adb None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:17.271814 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7a7f0-ecf5-4877-aa6b-fcc9a06c8adb None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:17.272555 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c7a7f0-ecf5-4877-aa6b-fcc9a06c8adb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:17.272855 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c7a7f0-ecf5-4877-aa6b-fcc9a06c8adb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:17.274261 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c7a7f0-ecf5-4877-aa6b-fcc9a06c8adb None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:17.284530 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 212/439] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:24:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:17.290050 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c7a7f0-ecf5-4877-aa6b-fcc9a06c8adb None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:17.368644 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:17.377002 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 228/440] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:24:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 17:24:17.378339 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad2d54-fa92-4618-889c-8a1b3c682c41 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:17.378628 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad2d54-fa92-4618-889c-8a1b3c682c41 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:17.378905 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad2d54-fa92-4618-889c-8a1b3c682c41 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:17.380321 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 229/441] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:17.382409 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad2d54-fa92-4618-889c-8a1b3c682c41 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:17.405804 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c7a7f0-ecf5-4877-aa6b-fcc9a06c8adb None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:17.438246 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adcb192-f01f-48eb-9301-c634b808f5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:17.438890 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcb192-f01f-48eb-9301-c634b808f5f6 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:17.439167 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcb192-f01f-48eb-9301-c634b808f5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:17.439438 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcb192-f01f-48eb-9301-c634b808f5f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:17.469354 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:17.485254 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad2d54-fa92-4618-889c-8a1b3c682c41 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:17.506436 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adcb192-f01f-48eb-9301-c634b808f5f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:17.507912 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adcb192-f01f-48eb-9301-c634b808f5f6 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:17.520104 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9762d-0045-4fa8-b518-260530577b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:17.520971 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9762d-0045-4fa8-b518-260530577b73 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:17.521254 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9762d-0045-4fa8-b518-260530577b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:17.521528 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9762d-0045-4fa8-b518-260530577b73 None admin] PATH_INFO: `/v3/projects/7660c9e611fc4315b714c975f6e5f41e` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:17.522864 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f9762d-0045-4fa8-b518-260530577b73 None admin] RBAC: Authorizing `identity:get_project(project_id=7660c9e611fc4315b714c975f6e5f41e)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:17.524314 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f9762d-0045-4fa8-b518-260530577b73 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:17.526063 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 230/442] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:24:17 2022] GET /identity/v3/projects/7660c9e611fc4315b714c975f6e5f41e => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:24:17.530911 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9ea31-7f81-49d5-9bda-214b07717085 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:17.530911 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9ea31-7f81-49d5-9bda-214b07717085 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:17.530911 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9ea31-7f81-49d5-9bda-214b07717085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:17.543592 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-5eb9ea31-7f81-49d5-9bda-214b07717085 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:17.544788 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5eb9ea31-7f81-49d5-9bda-214b07717085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:17.601541 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:17.612527 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 213/443] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:24:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 17:24:17.613362 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adcb192-f01f-48eb-9301-c634b808f5f6 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:17.622046 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 231/444] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:24:17.622833 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9ea31-7f81-49d5-9bda-214b07717085 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:17.675680 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:17.715378 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adcb192-f01f-48eb-9301-c634b808f5f6 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:17.725081 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9ea31-7f81-49d5-9bda-214b07717085 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:17.749509 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28282816-e0bc-4705-9046-6b3fa0b464b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:17.750412 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28282816-e0bc-4705-9046-6b3fa0b464b8 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:17.750705 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28282816-e0bc-4705-9046-6b3fa0b464b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:17.750956 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28282816-e0bc-4705-9046-6b3fa0b464b8 None admin] PATH_INFO: `/v3/groups/122175f93ab74220a2eaadd07b64bc72` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:17.752120 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28282816-e0bc-4705-9046-6b3fa0b464b8 None admin] RBAC: Authorizing `identity:get_group(group_id=122175f93ab74220a2eaadd07b64bc72)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:17.753547 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28282816-e0bc-4705-9046-6b3fa0b464b8 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:17.755388 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 214/445] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Jul 15 17:24:17 2022] GET /identity/v3/groups/122175f93ab74220a2eaadd07b64bc72 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:17.755948 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28282816-e0bc-4705-9046-6b3fa0b464b8 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:17.760804 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d90bb-a9cd-4b9a-8bf2-9209bd62da3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:17.761680 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d90bb-a9cd-4b9a-8bf2-9209bd62da3a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:17.761988 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d90bb-a9cd-4b9a-8bf2-9209bd62da3a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:17.762260 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d90bb-a9cd-4b9a-8bf2-9209bd62da3a None admin] PATH_INFO: `/v3/projects/debcff5d6200462baae7bebc7bb34145` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:17.763448 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d90bb-a9cd-4b9a-8bf2-9209bd62da3a None admin] RBAC: Authorizing `identity:get_project(project_id=debcff5d6200462baae7bebc7bb34145)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:17.764947 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d90bb-a9cd-4b9a-8bf2-9209bd62da3a None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:17.766656 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 232/446] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:24:17 2022] GET /identity/v3/projects/debcff5d6200462baae7bebc7bb34145 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:17.767396 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d90bb-a9cd-4b9a-8bf2-9209bd62da3a None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:17.826902 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:17.853682 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28282816-e0bc-4705-9046-6b3fa0b464b8 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:17.866880 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d90bb-a9cd-4b9a-8bf2-9209bd62da3a None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:17.881986 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:17.887291 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0c30a-60c6-4889-a02d-0a63c30e6100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:17.888107 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0c30a-60c6-4889-a02d-0a63c30e6100 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:17.888368 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0c30a-60c6-4889-a02d-0a63c30e6100 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:17.888637 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0c30a-60c6-4889-a02d-0a63c30e6100 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:17.899131 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db0c30a-60c6-4889-a02d-0a63c30e6100 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:24:17.902074 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed37b4f-487e-420b-bc9b-f9028fb70467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:17.902730 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed37b4f-487e-420b-bc9b-f9028fb70467 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:17.903010 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed37b4f-487e-420b-bc9b-f9028fb70467 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:17.903281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed37b4f-487e-420b-bc9b-f9028fb70467 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:17.904107 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed37b4f-487e-420b-bc9b-f9028fb70467 None admin] RBAC: Adding query filter params (group.id=122175f93ab74220a2eaadd07b64bc72, role.id=d8d52b8fc62e44cd9d551b855f2ac84b, scope.project.id=7660c9e611fc4315b714c975f6e5f41e) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:17.904413 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed37b4f-487e-420b-bc9b-f9028fb70467 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:17.906116 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed37b4f-487e-420b-bc9b-f9028fb70467 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:17.906809 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-4db0c30a-60c6-4889-a02d-0a63c30e6100 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:24:17.906809 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:17.906809 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:17.906809 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:17.906809 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:17.906809 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:17.906809 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:17.906809 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:17.906809 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:17.906809 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:17.906809 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:17.906809 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:17.906809 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:24:17.906809 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:24:17.906809 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:24:17.906809 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:24:17.907706 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:24:17.907706 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:24:17.907706 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:24:17.907706 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:24:17.907706 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:17.907706 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:17.907706 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:17.907706 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:17.907706 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:17.907706 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:17.907706 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:17.907706 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:17.907706 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:17.907706 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:17.907706 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:17.907706 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:17.908517 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:17.908517 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:17.908517 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:17.908517 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:17.908517 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:24:17.908517 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:24:17.908517 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:24:17.908517 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:24:17.908517 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:24:17.908517 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:24:17.908517 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:24:17.908517 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:17.908517 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 215/447] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jul 15 17:24:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:17.909158 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0c30a-60c6-4889-a02d-0a63c30e6100 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:17.914286 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 233/448] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Jul 15 17:24:17 2022] GET /identity/v3/role_assignments?group.id=122175f93ab74220a2eaadd07b64bc72&scope.project.id=7660c9e611fc4315b714c975f6e5f41e&role.id=d8d52b8fc62e44cd9d551b855f2ac84b => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:17.915068 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed37b4f-487e-420b-bc9b-f9028fb70467 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:18.022568 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0c30a-60c6-4889-a02d-0a63c30e6100 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:18.026451 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed37b4f-487e-420b-bc9b-f9028fb70467 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:18.054381 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:18.064420 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5886a4-3bc4-4fb8-aef9-0b6e5b4da613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:18.065303 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5886a4-3bc4-4fb8-aef9-0b6e5b4da613 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:18.065584 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5886a4-3bc4-4fb8-aef9-0b6e5b4da613 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:18.065901 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5886a4-3bc4-4fb8-aef9-0b6e5b4da613 None admin] PATH_INFO: `/v3/groups/122175f93ab74220a2eaadd07b64bc72` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:18.067082 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5886a4-3bc4-4fb8-aef9-0b6e5b4da613 None admin] RBAC: Authorizing `identity:get_group(group_id=122175f93ab74220a2eaadd07b64bc72)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:18.067284 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119df299-dc5c-4516-a936-ff4a95bf9978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:18.067916 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119df299-dc5c-4516-a936-ff4a95bf9978 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:18.068199 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119df299-dc5c-4516-a936-ff4a95bf9978 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:18.068473 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119df299-dc5c-4516-a936-ff4a95bf9978 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:18.068567 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5886a4-3bc4-4fb8-aef9-0b6e5b4da613 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:18.069215 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119df299-dc5c-4516-a936-ff4a95bf9978 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:18.069512 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119df299-dc5c-4516-a936-ff4a95bf9978 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:18.070211 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 216/449] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Jul 15 17:24:17 2022] GET /identity/v3/groups/122175f93ab74220a2eaadd07b64bc72 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:18.070880 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119df299-dc5c-4516-a936-ff4a95bf9978 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:18.075967 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5886a4-3bc4-4fb8-aef9-0b6e5b4da613 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:18.080136 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 234/450] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:24:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:18.086335 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119df299-dc5c-4516-a936-ff4a95bf9978 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:18.148637 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:18.200353 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5886a4-3bc4-4fb8-aef9-0b6e5b4da613 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:18.207804 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119df299-dc5c-4516-a936-ff4a95bf9978 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:18.241623 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4113c2-6102-4d7f-9bb3-95192f420a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:18.242374 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4113c2-6102-4d7f-9bb3-95192f420a23 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:18.242656 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4113c2-6102-4d7f-9bb3-95192f420a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:18.242929 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4113c2-6102-4d7f-9bb3-95192f420a23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:18.243763 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4113c2-6102-4d7f-9bb3-95192f420a23 None admin] RBAC: Adding query filter params (group.id=122175f93ab74220a2eaadd07b64bc72, role.id=c9b1f4b47f054f7a8a9a079e65a7197a, scope.project.id=debcff5d6200462baae7bebc7bb34145) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:18.244072 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4113c2-6102-4d7f-9bb3-95192f420a23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:18.245499 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4113c2-6102-4d7f-9bb3-95192f420a23 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:18.251585 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b7359-da46-4bca-8808-6b1e8ef1fd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:18.252243 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b7359-da46-4bca-8808-6b1e8ef1fd13 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:18.252521 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b7359-da46-4bca-8808-6b1e8ef1fd13 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:18.252790 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b7359-da46-4bca-8808-6b1e8ef1fd13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:18.253423 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 217/451] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Jul 15 17:24:18 2022] GET /identity/v3/role_assignments?group.id=122175f93ab74220a2eaadd07b64bc72&scope.project.id=debcff5d6200462baae7bebc7bb34145&role.id=c9b1f4b47f054f7a8a9a079e65a7197a => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:18.320782 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:18.336442 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483b7359-da46-4bca-8808-6b1e8ef1fd13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:18.337994 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483b7359-da46-4bca-8808-6b1e8ef1fd13 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:18.446502 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 235/452] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:24:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 17:24:18.452741 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4113c2-6102-4d7f-9bb3-95192f420a23 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:18.577518 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4113c2-6102-4d7f-9bb3-95192f420a23 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:18.600771 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:18.611936 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53f724-6c3e-4efd-bd82-0c1142c8a693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:18.612820 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53f724-6c3e-4efd-bd82-0c1142c8a693 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:18.613356 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53f724-6c3e-4efd-bd82-0c1142c8a693 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:18.613356 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53f724-6c3e-4efd-bd82-0c1142c8a693 None admin] PATH_INFO: `/v3/projects/3c32a3d29e5f4e56a46352866cc5acd0` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:18.614550 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc53f724-6c3e-4efd-bd82-0c1142c8a693 None admin] RBAC: Authorizing `identity:get_project(project_id=3c32a3d29e5f4e56a46352866cc5acd0)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:18.615996 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc53f724-6c3e-4efd-bd82-0c1142c8a693 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:18.617740 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 218/453] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:24:18 2022] GET /identity/v3/projects/3c32a3d29e5f4e56a46352866cc5acd0 => generated 344 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:18.623446 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b7359-da46-4bca-8808-6b1e8ef1fd13 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:18.709439 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:18.725726 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b7359-da46-4bca-8808-6b1e8ef1fd13 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:18.760015 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e0309-22b2-4894-8169-0cc3093664dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:18.760878 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e0309-22b2-4894-8169-0cc3093664dd None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:18.761156 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e0309-22b2-4894-8169-0cc3093664dd None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:18.761425 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e0309-22b2-4894-8169-0cc3093664dd None admin] PATH_INFO: `/v3/groups/be8ba8abbb06442ca073f2b9aa2b8c39` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:18.762603 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e0309-22b2-4894-8169-0cc3093664dd None admin] RBAC: Authorizing `identity:get_group(group_id=be8ba8abbb06442ca073f2b9aa2b8c39)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:18.764237 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e0309-22b2-4894-8169-0cc3093664dd None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:18.766283 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 236/454] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Jul 15 17:24:18 2022] GET /identity/v3/groups/be8ba8abbb06442ca073f2b9aa2b8c39 => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:18.772289 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53f724-6c3e-4efd-bd82-0c1142c8a693 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:18.886923 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53f724-6c3e-4efd-bd82-0c1142c8a693 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:18.930225 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24419c-5205-428f-a319-f0ccc47a3bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:18.930877 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24419c-5205-428f-a319-f0ccc47a3bc5 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:18.931152 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24419c-5205-428f-a319-f0ccc47a3bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:18.931406 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24419c-5205-428f-a319-f0ccc47a3bc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:18.932227 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f24419c-5205-428f-a319-f0ccc47a3bc5 None admin] RBAC: Adding query filter params (group.id=be8ba8abbb06442ca073f2b9aa2b8c39, role.id=70d242b29ede4648b639c7ddae5eaead, scope.project.id=3c32a3d29e5f4e56a46352866cc5acd0) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:18.932527 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f24419c-5205-428f-a319-f0ccc47a3bc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:18.933974 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f24419c-5205-428f-a319-f0ccc47a3bc5 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:18.940125 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 219/455] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Jul 15 17:24:18 2022] GET /identity/v3/role_assignments?group.id=be8ba8abbb06442ca073f2b9aa2b8c39&scope.project.id=3c32a3d29e5f4e56a46352866cc5acd0&role.id=70d242b29ede4648b639c7ddae5eaead => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:21.257688 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9a8e2-a795-428b-8466-54aff9f89899 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:21.258298 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9a8e2-a795-428b-8466-54aff9f89899 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:21.258298 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9a8e2-a795-428b-8466-54aff9f89899 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:21.260030 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 237/456] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:21.265581 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768c3ce-7de1-49b3-931b-3d2beb24a503 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:21.266056 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768c3ce-7de1-49b3-931b-3d2beb24a503 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:21.266229 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768c3ce-7de1-49b3-931b-3d2beb24a503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:21.283159 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-2768c3ce-7de1-49b3-931b-3d2beb24a503 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:21.284339 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-2768c3ce-7de1-49b3-931b-3d2beb24a503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:21.362146 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:21.370736 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 220/457] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 17:24:21.419237 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9a8e2-a795-428b-8466-54aff9f89899 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:21.520922 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c939e4-9abb-42b3-bec9-46972fafe5ab None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:21.521112 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c939e4-9abb-42b3-bec9-46972fafe5ab None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:21.521380 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c939e4-9abb-42b3-bec9-46972fafe5ab None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:21.523024 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 221/458] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:21.527954 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce9f22-22ed-4ce0-916b-9e6f5fa82ab4 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:21.528451 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce9f22-22ed-4ce0-916b-9e6f5fa82ab4 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:21.528926 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce9f22-22ed-4ce0-916b-9e6f5fa82ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:21.533136 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9a8e2-a795-428b-8466-54aff9f89899 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:21.545825 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-bcce9f22-22ed-4ce0-916b-9e6f5fa82ab4 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:21.547361 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-bcce9f22-22ed-4ce0-916b-9e6f5fa82ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:21.591317 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752caf0-7dc0-47be-b2ea-e9264049979c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:21.592729 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752caf0-7dc0-47be-b2ea-e9264049979c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:21.593222 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752caf0-7dc0-47be-b2ea-e9264049979c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:21.593693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752caf0-7dc0-47be-b2ea-e9264049979c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:21.609302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4752caf0-7dc0-47be-b2ea-e9264049979c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:21.611623 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4752caf0-7dc0-47be-b2ea-e9264049979c None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:21.644760 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-4752caf0-7dc0-47be-b2ea-e9264049979c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:21.644760 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:21.644760 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:21.644760 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:21.644760 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:21.644760 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:21.644760 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:21.644760 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:21.644760 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:21.644760 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:21.644760 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:21.644760 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:21.644760 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:21.644760 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:21.644760 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:21.645690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:21.645690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:21.645690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:21.645690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:21.645690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:21.645690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:21.645690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:21.645690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:21.645690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:21.645690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:21.645690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:21.645690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:21.645690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:21.645690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:21.645690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:21.645690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:21.645690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:21.646585 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:21.646585 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:21.646585 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:21.646585 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:21.647508 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 238/459] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:21.654351 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752caf0-7dc0-47be-b2ea-e9264049979c None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:21.667784 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:21.675661 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 222/460] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:24:21.699547 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce9f22-22ed-4ce0-916b-9e6f5fa82ab4 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:21.818660 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752caf0-7dc0-47be-b2ea-e9264049979c None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:21.862383 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b089c-c6a2-4397-a35a-3cb004cf5962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:21.863483 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b089c-c6a2-4397-a35a-3cb004cf5962 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:21.863898 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b089c-c6a2-4397-a35a-3cb004cf5962 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:21.864311 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b089c-c6a2-4397-a35a-3cb004cf5962 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:21.865300 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1b089c-c6a2-4397-a35a-3cb004cf5962 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:21.865614 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1b089c-c6a2-4397-a35a-3cb004cf5962 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:21.867678 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1b089c-c6a2-4397-a35a-3cb004cf5962 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:21.868670 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce9f22-22ed-4ce0-916b-9e6f5fa82ab4 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:21.883711 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 239/461] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:24:21.885041 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0417c6-8ee1-46a0-a92c-9b477ff5ed22 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:21.885326 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0417c6-8ee1-46a0-a92c-9b477ff5ed22 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:21.885601 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0417c6-8ee1-46a0-a92c-9b477ff5ed22 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:21.887147 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 240/462] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:21.890740 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0417c6-8ee1-46a0-a92c-9b477ff5ed22 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:21.891624 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:21.911300 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2f6e2-e156-4bee-bc56-fc93e3233ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:21.912107 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2f6e2-e156-4bee-bc56-fc93e3233ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:21.912382 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2f6e2-e156-4bee-bc56-fc93e3233ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:21.912750 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2f6e2-e156-4bee-bc56-fc93e3233ec7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:21.923953 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c2f6e2-e156-4bee-bc56-fc93e3233ec7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:21.925605 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c2f6e2-e156-4bee-bc56-fc93e3233ec7 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:21.944514 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-59c2f6e2-e156-4bee-bc56-fc93e3233ec7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:21.944514 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:21.944514 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:21.944514 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:21.944514 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:21.944514 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:21.944514 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:21.944514 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:21.944514 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:21.944514 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:21.944514 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:21.944514 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:21.944514 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:21.944514 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:21.944514 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:21.945395 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:21.945395 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:21.945395 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:21.945395 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:21.945395 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:21.945395 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:21.945395 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:21.945395 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:21.945395 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:21.945395 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:21.945395 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:21.945395 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:21.945395 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:21.945395 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:21.945395 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:21.945395 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:21.945395 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:21.946274 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:21.946274 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:21.946274 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:21.946274 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:21.946274 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 223/463] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:21.947560 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c8a40-84a6-4040-b059-0d1ab417dfc8 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:21.947732 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c8a40-84a6-4040-b059-0d1ab417dfc8 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:21.952842 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c8a40-84a6-4040-b059-0d1ab417dfc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:21.966393 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-290c8a40-84a6-4040-b059-0d1ab417dfc8 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:21.967978 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-290c8a40-84a6-4040-b059-0d1ab417dfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:21.973047 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:22.026121 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0417c6-8ee1-46a0-a92c-9b477ff5ed22 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:22.047790 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 224/464] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:24:22.049034 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c8a40-84a6-4040-b059-0d1ab417dfc8 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:22.071647 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb63b80-43ae-42da-924b-d3e22ff0d1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:22.072254 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb63b80-43ae-42da-924b-d3e22ff0d1bd None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:22.072689 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb63b80-43ae-42da-924b-d3e22ff0d1bd None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:22.073130 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb63b80-43ae-42da-924b-d3e22ff0d1bd None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:22.073872 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb63b80-43ae-42da-924b-d3e22ff0d1bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:22.076321 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb63b80-43ae-42da-924b-d3e22ff0d1bd None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:22.103423 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 241/465] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Jul 15 17:24:21 2022] POST /identity/v3/users => generated 246 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:24:22.105421 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb63b80-43ae-42da-924b-d3e22ff0d1bd None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:22.206289 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:22.214340 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c8a40-84a6-4040-b059-0d1ab417dfc8 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:22.249233 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb63b80-43ae-42da-924b-d3e22ff0d1bd None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:22.272768 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f130a-3e62-4f56-9761-ca4b49cc0d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:22.273544 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f130a-3e62-4f56-9761-ca4b49cc0d87 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:22.273864 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f130a-3e62-4f56-9761-ca4b49cc0d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:22.274141 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f130a-3e62-4f56-9761-ca4b49cc0d87 None admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:22.274901 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746f130a-3e62-4f56-9761-ca4b49cc0d87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:22.275183 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746f130a-3e62-4f56-9761-ca4b49cc0d87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:22.276728 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746f130a-3e62-4f56-9761-ca4b49cc0d87 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:22.280567 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:22.293437 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 225/466] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:22.294528 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c340661-dbdc-494b-a256-6591a9addce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:22.295792 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c340661-dbdc-494b-a256-6591a9addce6 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:22.296398 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c340661-dbdc-494b-a256-6591a9addce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:22.297056 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c340661-dbdc-494b-a256-6591a9addce6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:22.297287 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fe2b7-d700-4282-9e85-32d5f6686fb4 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:22.297798 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fe2b7-d700-4282-9e85-32d5f6686fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:22.298215 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fe2b7-d700-4282-9e85-32d5f6686fb4 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:22.299836 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 226/467] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:22.300802 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618fe2b7-d700-4282-9e85-32d5f6686fb4 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:22.320030 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c340661-dbdc-494b-a256-6591a9addce6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:22.321541 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c340661-dbdc-494b-a256-6591a9addce6 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:22.340944 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-1c340661-dbdc-494b-a256-6591a9addce6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:22.340944 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:22.340944 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:22.340944 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:22.340944 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:22.340944 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:22.340944 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:22.340944 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:22.340944 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:22.340944 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:22.340944 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:22.340944 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:22.340944 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:22.340944 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:22.340944 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:22.341881 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:22.341881 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:22.341881 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:22.341881 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:22.341881 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:22.341881 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:22.341881 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:22.341881 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:22.341881 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:22.341881 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:22.341881 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:22.341881 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:22.341881 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:22.341881 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:22.341881 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:22.341881 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:22.341881 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:22.342889 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:22.342889 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:22.342889 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:22.342889 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:22.342889 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 242/468] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:22.344302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee4628-8342-427b-9743-d567845b4d7b None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:22.344302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee4628-8342-427b-9743-d567845b4d7b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:22.344302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee4628-8342-427b-9743-d567845b4d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:22.362593 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-62ee4628-8342-427b-9743-d567845b4d7b None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:22.363500 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-62ee4628-8342-427b-9743-d567845b4d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:22.447249 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618fe2b7-d700-4282-9e85-32d5f6686fb4 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:22.454744 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 243/469] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:24:22.455984 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee4628-8342-427b-9743-d567845b4d7b None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:22.492660 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13235ec0-f1dd-499f-a9d3-b78b1a63f600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:22.494618 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13235ec0-f1dd-499f-a9d3-b78b1a63f600 None admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:22.495099 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13235ec0-f1dd-499f-a9d3-b78b1a63f600 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:22.495561 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13235ec0-f1dd-499f-a9d3-b78b1a63f600 None admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:22.496453 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13235ec0-f1dd-499f-a9d3-b78b1a63f600 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:22.498099 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13235ec0-f1dd-499f-a9d3-b78b1a63f600 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:22.527580 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 227/470] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Jul 15 17:24:22 2022] POST /identity/v3/users => generated 248 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:24:22.529754 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13235ec0-f1dd-499f-a9d3-b78b1a63f600 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:22.555329 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:22.569685 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee4628-8342-427b-9743-d567845b4d7b None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:22.573932 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:22.656714 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad71c7-9c0c-43f2-8ecd-d542a2014248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:22.657546 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad71c7-9c0c-43f2-8ecd-d542a2014248 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:22.657741 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad71c7-9c0c-43f2-8ecd-d542a2014248 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:22.658047 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad71c7-9c0c-43f2-8ecd-d542a2014248 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:22.658893 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad71c7-9c0c-43f2-8ecd-d542a2014248 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:22.659136 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad71c7-9c0c-43f2-8ecd-d542a2014248 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:22.660556 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad71c7-9c0c-43f2-8ecd-d542a2014248 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:22.669178 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13235ec0-f1dd-499f-a9d3-b78b1a63f600 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:22.690076 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 244/471] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:22.696648 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad71c7-9c0c-43f2-8ecd-d542a2014248 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:22.738349 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0263f251-b839-49d8-a66d-cf1866233f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:22.739170 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263f251-b839-49d8-a66d-cf1866233f38 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:22.739460 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263f251-b839-49d8-a66d-cf1866233f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:22.739738 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263f251-b839-49d8-a66d-cf1866233f38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:22.753411 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0263f251-b839-49d8-a66d-cf1866233f38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:22.754915 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0263f251-b839-49d8-a66d-cf1866233f38 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:22.773308 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-0263f251-b839-49d8-a66d-cf1866233f38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:22.773308 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:22.773308 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:22.773308 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:22.773308 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:22.773308 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:22.773308 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:22.773308 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:22.773308 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:22.773308 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:22.773308 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:22.773308 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:22.773308 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:22.773308 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:22.773308 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:22.774238 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:22.774238 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:22.774238 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:22.774238 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:22.774238 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:22.774238 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:22.774238 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:22.774238 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:22.774238 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:22.774238 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:22.774238 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:22.774238 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:22.774238 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:22.774238 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:22.774238 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:22.774238 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:22.774238 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:22.775520 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:22.775520 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:22.775520 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:22.775520 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:22.775520 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 228/472] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:22.781413 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0263f251-b839-49d8-a66d-cf1866233f38 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:22.822819 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad71c7-9c0c-43f2-8ecd-d542a2014248 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:22.853247 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:22.864586 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9dd30-ad3f-433e-ae4e-83fa736b8268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:22.865565 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9dd30-ad3f-433e-ae4e-83fa736b8268 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:22.866014 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9dd30-ad3f-433e-ae4e-83fa736b8268 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:22.866459 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9dd30-ad3f-433e-ae4e-83fa736b8268 None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:22.867415 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f9dd30-ad3f-433e-ae4e-83fa736b8268 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:22.869112 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f9dd30-ad3f-433e-ae4e-83fa736b8268 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:22.892809 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0263f251-b839-49d8-a66d-cf1866233f38 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:22.893599 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 245/473] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Jul 15 17:24:22 2022] POST /identity/v3/users => generated 248 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:24:22.894802 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f9e17-5aca-452a-8fb3-23841909914f None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:22.895081 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f9e17-5aca-452a-8fb3-23841909914f None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:22.895365 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f9e17-5aca-452a-8fb3-23841909914f None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:22.897099 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 246/474] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:22.904066 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d32dc-6d56-44ce-b740-a2b333ee7a20 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:22.904437 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d32dc-6d56-44ce-b740-a2b333ee7a20 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:22.904740 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d32dc-6d56-44ce-b740-a2b333ee7a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:22.923266 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-811d32dc-6d56-44ce-b740-a2b333ee7a20 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:22.924527 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-811d32dc-6d56-44ce-b740-a2b333ee7a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:22.937552 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028deefc-aa21-4ce0-9b6a-a12ad83f1188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:22.938654 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028deefc-aa21-4ce0-9b6a-a12ad83f1188 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:22.939475 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028deefc-aa21-4ce0-9b6a-a12ad83f1188 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:22.940075 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028deefc-aa21-4ce0-9b6a-a12ad83f1188 None admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:22.941139 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028deefc-aa21-4ce0-9b6a-a12ad83f1188 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:22.941624 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028deefc-aa21-4ce0-9b6a-a12ad83f1188 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:22.943754 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:22.944957 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028deefc-aa21-4ce0-9b6a-a12ad83f1188 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:22.963036 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 229/475] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:22.971525 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028deefc-aa21-4ce0-9b6a-a12ad83f1188 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:23.011860 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 247/476] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:24:23.078791 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d32dc-6d56-44ce-b740-a2b333ee7a20 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:23.117347 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028deefc-aa21-4ce0-9b6a-a12ad83f1188 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:23.152459 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:23.165636 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64424e2f-fac7-4927-80f7-10d3da86dd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:23.166768 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64424e2f-fac7-4927-80f7-10d3da86dd45 None admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:23.167058 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64424e2f-fac7-4927-80f7-10d3da86dd45 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:23.167337 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64424e2f-fac7-4927-80f7-10d3da86dd45 None admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:23.168341 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64424e2f-fac7-4927-80f7-10d3da86dd45 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:23.170506 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64424e2f-fac7-4927-80f7-10d3da86dd45 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:23.197627 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 230/477] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Jul 15 17:24:22 2022] POST /identity/v3/users => generated 249 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:24:23.221674 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d32dc-6d56-44ce-b740-a2b333ee7a20 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:23.261034 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a115e4-f300-4551-b4a1-5607d38d35c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:23.262233 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a115e4-f300-4551-b4a1-5607d38d35c9 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:23.262717 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a115e4-f300-4551-b4a1-5607d38d35c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:23.263180 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a115e4-f300-4551-b4a1-5607d38d35c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:23.264446 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a115e4-f300-4551-b4a1-5607d38d35c9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:23.266383 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a115e4-f300-4551-b4a1-5607d38d35c9 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:23.279119 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.sql.core [None req-56a115e4-f300-4551-b4a1-5607d38d35c9 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 15 17:24:23.279119 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 15 17:24:23.279119 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [parameters: {'id': '56d015e9626141ae9c7b44eb6b269e8d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 15 17:24:23.279119 dv-cinder-836973-11-smb devstack@keystone.service[80149]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80149) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 15 17:24:23.297445 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-56a115e4-f300-4551-b4a1-5607d38d35c9 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 15 17:24:23.297445 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:23.297445 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 15 17:24:23.297445 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 15 17:24:23.297445 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 15 17:24:23.297445 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 15 17:24:23.297445 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 15 17:24:23.297445 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application result = self._query(query) Jul 15 17:24:23.297445 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 15 17:24:23.297445 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application conn.query(q) Jul 15 17:24:23.297445 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 15 17:24:23.297445 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 15 17:24:23.297445 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 15 17:24:23.297445 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application result.read() Jul 15 17:24:23.297445 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 15 17:24:23.298917 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 15 17:24:23.298917 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 15 17:24:23.298917 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 15 17:24:23.298917 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 15 17:24:23.298917 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 15 17:24:23.298917 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 15 17:24:23.298917 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 15 17:24:23.298917 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 15 17:24:23.298917 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:23.298917 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 15 17:24:23.298917 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:23.298917 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:23.298917 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 15 17:24:23.298917 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 15 17:24:23.298917 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 15 17:24:23.298917 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return ref.to_dict() Jul 15 17:24:23.298917 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 15 17:24:23.298917 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application next(self.gen) Jul 15 17:24:23.300281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 15 17:24:23.300281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application yield resource Jul 15 17:24:23.300281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 15 17:24:23.300281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application next(self.gen) Jul 15 17:24:23.300281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 15 17:24:23.300281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self.session.rollback() Jul 15 17:24:23.300281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 15 17:24:23.300281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self.force_reraise() Jul 15 17:24:23.300281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 15 17:24:23.300281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise self.value Jul 15 17:24:23.300281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 15 17:24:23.300281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 15 17:24:23.300281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 15 17:24:23.300281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application session.commit() Jul 15 17:24:23.300281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 15 17:24:23.300281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 15 17:24:23.300281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 15 17:24:23.301142 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._prepare_impl() Jul 15 17:24:23.301142 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 15 17:24:23.301142 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self.session.flush() Jul 15 17:24:23.301142 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 15 17:24:23.301142 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._flush(objects) Jul 15 17:24:23.301142 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 15 17:24:23.301142 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 15 17:24:23.301142 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 15 17:24:23.301142 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application compat.raise_( Jul 15 17:24:23.301142 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 15 17:24:23.301142 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception Jul 15 17:24:23.301142 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 15 17:24:23.301142 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application flush_context.execute() Jul 15 17:24:23.301142 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 15 17:24:23.301142 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rec.execute(self) Jul 15 17:24:23.301142 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 15 17:24:23.301142 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 15 17:24:23.302032 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 15 17:24:23.302032 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 15 17:24:23.302032 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 15 17:24:23.302032 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 15 17:24:23.302032 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 15 17:24:23.302032 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 15 17:24:23.302032 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 15 17:24:23.302032 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 15 17:24:23.302032 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 15 17:24:23.302032 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 15 17:24:23.302032 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 15 17:24:23.302032 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 15 17:24:23.302032 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 15 17:24:23.302032 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 15 17:24:23.302032 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 15 17:24:23.302032 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception Jul 15 17:24:23.302826 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 15 17:24:23.302826 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 15 17:24:23.302826 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 15 17:24:23.302826 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 15 17:24:23.302826 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 15 17:24:23.302826 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application result = self._query(query) Jul 15 17:24:23.302826 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 15 17:24:23.302826 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application conn.query(q) Jul 15 17:24:23.302826 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 15 17:24:23.302826 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 15 17:24:23.302826 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 15 17:24:23.302826 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application result.read() Jul 15 17:24:23.302826 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 15 17:24:23.302826 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 15 17:24:23.302826 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 15 17:24:23.302826 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 15 17:24:23.307470 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 15 17:24:23.307470 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 15 17:24:23.307470 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 15 17:24:23.307470 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 15 17:24:23.307470 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 15 17:24:23.307470 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 15 17:24:23.307470 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [parameters: {'id': '56d015e9626141ae9c7b44eb6b269e8d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 15 17:24:23.307470 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 15 17:24:23.307470 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:23.307470 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 17:24:23.307470 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:23.307470 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:23.307470 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:23.307470 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:23.307470 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:23.307470 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:23.309404 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:23.309404 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:23.309404 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:23.309404 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:23.309404 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:23.309404 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:23.309404 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 15 17:24:23.309404 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 15 17:24:23.309404 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:23.309404 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:23.309404 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 15 17:24:23.309404 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 15 17:24:23.309404 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 15 17:24:23.309404 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 15 17:24:23.309404 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 15 17:24:23.309404 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:23.310522 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 248/478] 10.222.0.27 () {60 vars in 1131 bytes} [Fri Jul 15 17:24:23 2022] POST /identity/v3/roles => generated 144 bytes in 221 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 15 17:24:23.310599 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64424e2f-fac7-4927-80f7-10d3da86dd45 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:23.448809 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64424e2f-fac7-4927-80f7-10d3da86dd45 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:23.487632 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf42196-be2e-4de3-9a22-02ee75228d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:23.488458 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf42196-be2e-4de3-9a22-02ee75228d3d None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:23.488735 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf42196-be2e-4de3-9a22-02ee75228d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:23.489005 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf42196-be2e-4de3-9a22-02ee75228d3d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:23.500156 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf42196-be2e-4de3-9a22-02ee75228d3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:24:23.508298 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-0cf42196-be2e-4de3-9a22-02ee75228d3d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 17:24:23.508298 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:23.508298 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:23.508298 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:23.508298 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:23.508298 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:23.508298 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:23.508298 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:23.508298 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:23.508298 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:23.508298 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:23.508298 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:23.508298 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:24:23.508298 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:24:23.508298 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:24:23.508298 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:24:23.509153 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:24:23.509153 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:24:23.509153 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:24:23.509153 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:24:23.509153 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:23.509153 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:23.509153 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:23.509153 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:23.509153 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:23.509153 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:23.509153 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:23.509153 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:23.509153 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:23.509153 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:23.509153 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:23.509153 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:23.510376 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:23.510376 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:23.510376 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:23.510376 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:23.510376 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:24:23.510376 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:24:23.510376 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:24:23.510376 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:24:23.510376 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:24:23.510376 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:24:23.510376 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 17:24:23.510376 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:23.510376 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 231/479] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Jul 15 17:24:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 17:24:23.515332 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a115e4-f300-4551-b4a1-5607d38d35c9 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:23.535130 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:23.627369 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a115e4-f300-4551-b4a1-5607d38d35c9 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:23.668808 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75612ef4-54b2-4f4b-abb7-a300dd4a9fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:23.669484 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75612ef4-54b2-4f4b-abb7-a300dd4a9fce None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:23.669762 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75612ef4-54b2-4f4b-abb7-a300dd4a9fce None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:23.670352 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75612ef4-54b2-4f4b-abb7-a300dd4a9fce None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:23.671111 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75612ef4-54b2-4f4b-abb7-a300dd4a9fce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:23.671411 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75612ef4-54b2-4f4b-abb7-a300dd4a9fce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:23.672777 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75612ef4-54b2-4f4b-abb7-a300dd4a9fce None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:23.681892 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 249/480] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:24:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:24.461966 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df226de-610b-4d49-9ac5-8587e33aeb25 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:24.462518 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df226de-610b-4d49-9ac5-8587e33aeb25 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:24.462518 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df226de-610b-4d49-9ac5-8587e33aeb25 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:24.463875 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 232/481] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:24.479970 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdce92-e866-4464-bfc8-18c85a0cca4f None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:24.480485 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdce92-e866-4464-bfc8-18c85a0cca4f None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:24.480588 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdce92-e866-4464-bfc8-18c85a0cca4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:24.506801 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-26cdce92-e866-4464-bfc8-18c85a0cca4f None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:24.508021 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-26cdce92-e866-4464-bfc8-18c85a0cca4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:24.591509 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 250/482] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:24:24.628226 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df226de-610b-4d49-9ac5-8587e33aeb25 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:24.701517 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:24.773159 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df226de-610b-4d49-9ac5-8587e33aeb25 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:24.807050 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d80fb-abcc-4b08-9964-87facf4fbedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:24.807853 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d80fb-abcc-4b08-9964-87facf4fbedb None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:24.808128 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d80fb-abcc-4b08-9964-87facf4fbedb None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:24.808395 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d80fb-abcc-4b08-9964-87facf4fbedb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:24.818743 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d80fb-abcc-4b08-9964-87facf4fbedb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:24:24.826681 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-854d80fb-abcc-4b08-9964-87facf4fbedb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 17:24:24.826681 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:24.826681 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:24.826681 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:24.826681 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:24.826681 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:24.826681 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:24.826681 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:24.826681 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:24.826681 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:24.826681 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:24.826681 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:24.826681 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:24:24.826681 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:24:24.826681 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:24:24.826681 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:24:24.827624 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:24:24.827624 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:24:24.827624 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:24:24.827624 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:24:24.827624 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:24.827624 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:24.827624 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:24.827624 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:24.827624 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:24.827624 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:24.827624 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:24.827624 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:24.827624 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:24.827624 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:24.827624 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:24.827624 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:24.828486 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:24.828486 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:24.828486 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:24.828486 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:24.828486 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:24:24.828486 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:24:24.828486 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:24:24.828486 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:24:24.828486 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:24:24.828486 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:24:24.828486 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 17:24:24.828486 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:24.833423 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 233/483] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Jul 15 17:24:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:24.838885 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cdce92-e866-4464-bfc8-18c85a0cca4f None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:24.854211 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:24.997522 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cdce92-e866-4464-bfc8-18c85a0cca4f None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:25.009921 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c9a7b-fdf5-4ac9-ba80-9b051c62da25 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:25.010532 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c9a7b-fdf5-4ac9-ba80-9b051c62da25 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:25.010997 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c9a7b-fdf5-4ac9-ba80-9b051c62da25 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:25.013002 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 234/484] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 17:24:25.019554 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11465d6-c68d-4b10-9e5c-d7aaad227287 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:25.019842 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11465d6-c68d-4b10-9e5c-d7aaad227287 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:25.020116 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11465d6-c68d-4b10-9e5c-d7aaad227287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:25.040610 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4749f9-2275-43c0-ad47-b007b1232c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:25.042050 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4749f9-2275-43c0-ad47-b007b1232c8a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:25.042523 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4749f9-2275-43c0-ad47-b007b1232c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:25.042997 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4749f9-2275-43c0-ad47-b007b1232c8a None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:25.043937 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4749f9-2275-43c0-ad47-b007b1232c8a None admin] RBAC: Adding query filter params (name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:25.044425 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4749f9-2275-43c0-ad47-b007b1232c8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:25.046104 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4749f9-2275-43c0-ad47-b007b1232c8a None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:25.051882 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-e11465d6-c68d-4b10-9e5c-d7aaad227287 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:25.053195 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-e11465d6-c68d-4b10-9e5c-d7aaad227287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:25.056146 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 251/485] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Jul 15 17:24:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:25.066787 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4749f9-2275-43c0-ad47-b007b1232c8a None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:25.142292 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:25.175627 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 235/486] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:24:25.181806 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4749f9-2275-43c0-ad47-b007b1232c8a None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:25.228719 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11465d6-c68d-4b10-9e5c-d7aaad227287 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:25.231793 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d33abe-f531-4258-b3ab-e45e52ef8520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:25.233047 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d33abe-f531-4258-b3ab-e45e52ef8520 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:25.233517 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d33abe-f531-4258-b3ab-e45e52ef8520 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:25.234001 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d33abe-f531-4258-b3ab-e45e52ef8520 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:25.245583 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d33abe-f531-4258-b3ab-e45e52ef8520 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:25.247344 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d33abe-f531-4258-b3ab-e45e52ef8520 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:25.265124 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-10d33abe-f531-4258-b3ab-e45e52ef8520 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:25.265124 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:25.265124 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:25.265124 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:25.265124 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:25.265124 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:25.265124 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:25.265124 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:25.265124 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:25.265124 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:25.265124 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:25.265124 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:25.265124 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:25.265124 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:25.265124 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:25.266033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:25.266033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:25.266033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:25.266033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:25.266033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:25.266033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:25.266033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:25.266033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:25.266033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:25.266033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:25.266033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:25.266033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:25.266033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:25.266033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:25.266033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:25.266033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:25.266033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:25.266867 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:25.266867 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:25.266867 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:25.266867 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:25.269099 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 252/487] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:25.278906 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d33abe-f531-4258-b3ab-e45e52ef8520 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:25.279496 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:25.414611 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11465d6-c68d-4b10-9e5c-d7aaad227287 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:25.416657 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d33abe-f531-4258-b3ab-e45e52ef8520 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:25.438686 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:25.457808 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa3572-0123-4bfb-8c49-c92a013a64b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:25.457808 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa3572-0123-4bfb-8c49-c92a013a64b1 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:25.457808 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa3572-0123-4bfb-8c49-c92a013a64b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:25.457808 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa3572-0123-4bfb-8c49-c92a013a64b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:25.459914 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa3572-0123-4bfb-8c49-c92a013a64b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:25.459914 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa3572-0123-4bfb-8c49-c92a013a64b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:25.459914 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa3572-0123-4bfb-8c49-c92a013a64b1 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:25.467572 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fcac21-a177-46ba-ac84-81ff4be2734a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:25.469220 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fcac21-a177-46ba-ac84-81ff4be2734a None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:25.469645 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fcac21-a177-46ba-ac84-81ff4be2734a None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:25.470101 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fcac21-a177-46ba-ac84-81ff4be2734a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:25.474169 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 253/488] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:25.486292 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fcac21-a177-46ba-ac84-81ff4be2734a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:24:25.487087 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa3572-0123-4bfb-8c49-c92a013a64b1 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:25.495422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-83fcac21-a177-46ba-ac84-81ff4be2734a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 17:24:25.495422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:25.495422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:25.495422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:25.495422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:25.495422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:25.495422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:25.495422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:25.495422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:25.495422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:25.495422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:25.495422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:25.495422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:24:25.495422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:24:25.495422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:24:25.495422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:24:25.496337 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:24:25.496337 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:24:25.496337 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:24:25.496337 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:24:25.496337 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:25.496337 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:25.496337 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:25.496337 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:25.496337 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:25.496337 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:25.496337 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:25.496337 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:25.496337 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:25.496337 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:25.496337 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:25.496337 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:25.497150 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:25.497150 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:25.497150 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:25.497150 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:25.497150 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:24:25.497150 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:24:25.497150 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:24:25.497150 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:24:25.497150 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:24:25.497150 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:24:25.497150 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 17:24:25.497150 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:25.500050 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 236/489] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Jul 15 17:24:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 17:24:25.505571 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fcac21-a177-46ba-ac84-81ff4be2734a None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:25.656056 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:25.667088 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fcac21-a177-46ba-ac84-81ff4be2734a None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:25.693251 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa3572-0123-4bfb-8c49-c92a013a64b1 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:25.711062 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e1e41-56c5-4846-a989-4056dca4aaef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:25.712255 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e1e41-56c5-4846-a989-4056dca4aaef None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:25.712645 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e1e41-56c5-4846-a989-4056dca4aaef None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:25.713023 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e1e41-56c5-4846-a989-4056dca4aaef None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:25.713909 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e1e41-56c5-4846-a989-4056dca4aaef None admin] RBAC: Adding query filter params (name=service) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:25.714339 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e1e41-56c5-4846-a989-4056dca4aaef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:25.716335 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e1e41-56c5-4846-a989-4056dca4aaef None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:25.728264 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 237/490] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Jul 15 17:24:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:25.729716 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c4949-7abc-4099-a1ae-f757d9bc204c None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:25.730121 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c4949-7abc-4099-a1ae-f757d9bc204c None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:25.730330 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccba5bf-c996-4071-b1d6-32cb688ca941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:25.730588 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c4949-7abc-4099-a1ae-f757d9bc204c None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:25.731466 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccba5bf-c996-4071-b1d6-32cb688ca941 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:25.731889 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccba5bf-c996-4071-b1d6-32cb688ca941 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:25.732146 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 238/491] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:25.732478 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccba5bf-c996-4071-b1d6-32cb688ca941 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:25.738040 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c4949-7abc-4099-a1ae-f757d9bc204c None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:25.742593 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccba5bf-c996-4071-b1d6-32cb688ca941 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:25.744233 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccba5bf-c996-4071-b1d6-32cb688ca941 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:25.760949 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-bccba5bf-c996-4071-b1d6-32cb688ca941 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 17:24:25.760949 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:25.760949 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:25.760949 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:25.760949 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:25.760949 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:25.760949 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:25.760949 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:25.760949 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:25.760949 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:25.760949 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:25.760949 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:25.760949 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 17:24:25.760949 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 17:24:25.760949 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 17:24:25.760949 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 17:24:25.762091 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:25.762091 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:25.762091 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 17:24:25.762091 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:24:25.762091 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 17:24:25.762091 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:24:25.762091 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:25.762091 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:25.762091 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:25.762091 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:25.762091 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:25.762091 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:25.762091 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:25.762091 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:25.762091 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:25.762091 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:25.762091 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:25.762091 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:25.763059 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:25.763059 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:25.763059 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 17:24:25.763059 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 17:24:25.763059 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 17:24:25.763059 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 17:24:25.763059 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 17:24:25.763059 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 17:24:25.763059 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 17:24:25.763059 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:25.765198 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 254/492] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Jul 15 17:24:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:25.766655 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94bd6a-6ad2-435c-9132-ce0720362d61 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:25.767156 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94bd6a-6ad2-435c-9132-ce0720362d61 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:25.767625 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94bd6a-6ad2-435c-9132-ce0720362d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:25.784904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-3e94bd6a-6ad2-435c-9132-ce0720362d61 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:25.786813 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-3e94bd6a-6ad2-435c-9132-ce0720362d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:25.829980 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:25.860135 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c4949-7abc-4099-a1ae-f757d9bc204c None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:25.874193 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 255/493] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:24:25.875296 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94bd6a-6ad2-435c-9132-ce0720362d61 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:25.899662 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7f892-07f8-4672-84bf-1219de1db623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:25.900464 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7f892-07f8-4672-84bf-1219de1db623 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:25.900735 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7f892-07f8-4672-84bf-1219de1db623 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:25.901004 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7f892-07f8-4672-84bf-1219de1db623 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:25.912568 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e7f892-07f8-4672-84bf-1219de1db623 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:25.914065 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e7f892-07f8-4672-84bf-1219de1db623 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:25.933113 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-98e7f892-07f8-4672-84bf-1219de1db623 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:25.933113 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:25.933113 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:25.933113 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:25.933113 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:25.933113 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:25.933113 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:25.933113 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:25.933113 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:25.933113 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:25.933113 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:25.933113 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:25.933113 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:25.933113 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:25.933113 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:25.934241 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:25.934241 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:25.934241 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:25.934241 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:25.934241 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:25.934241 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:25.934241 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:25.934241 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:25.934241 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:25.934241 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:25.934241 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:25.934241 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:25.934241 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:25.934241 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:25.934241 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:25.934241 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:25.934241 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:25.935069 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:25.935069 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:25.935069 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:25.935069 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:25.935069 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 239/494] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:25.935847 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee148cc-1368-4c4c-9f41-52cdfd02afb9 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:25.936135 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee148cc-1368-4c4c-9f41-52cdfd02afb9 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:25.936565 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee148cc-1368-4c4c-9f41-52cdfd02afb9 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:25.941957 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 240/495] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:25.941957 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee148cc-1368-4c4c-9f41-52cdfd02afb9 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:25.948090 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:25.995193 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94bd6a-6ad2-435c-9132-ce0720362d61 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:26.031335 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c495b0a-65b5-410b-b662-a70164442519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:26.032015 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c495b0a-65b5-410b-b662-a70164442519 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:26.032297 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c495b0a-65b5-410b-b662-a70164442519 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:26.032571 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c495b0a-65b5-410b-b662-a70164442519 None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:26.033414 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c495b0a-65b5-410b-b662-a70164442519 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:26.033723 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c495b0a-65b5-410b-b662-a70164442519 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:26.035212 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c495b0a-65b5-410b-b662-a70164442519 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:26.057920 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee148cc-1368-4c4c-9f41-52cdfd02afb9 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:26.073848 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 256/496] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Jul 15 17:24:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:26.074692 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c495b0a-65b5-410b-b662-a70164442519 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:26.100374 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2608b-b9dd-4cfb-8e2a-bb164de7f03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:26.101186 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2608b-b9dd-4cfb-8e2a-bb164de7f03f None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:26.101466 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2608b-b9dd-4cfb-8e2a-bb164de7f03f None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:26.101738 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2608b-b9dd-4cfb-8e2a-bb164de7f03f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:26.106351 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:26.113866 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d2608b-b9dd-4cfb-8e2a-bb164de7f03f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:24:26.123916 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-88d2608b-b9dd-4cfb-8e2a-bb164de7f03f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 17:24:26.123916 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:26.123916 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:26.123916 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:26.123916 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:26.123916 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:26.123916 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:26.123916 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:26.123916 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:26.123916 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:26.123916 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:26.123916 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:26.123916 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:24:26.123916 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:24:26.123916 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:24:26.123916 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:24:26.124806 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:24:26.124806 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:24:26.124806 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:24:26.124806 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:24:26.124806 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:26.124806 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:26.124806 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:26.124806 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:26.124806 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:26.124806 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:26.124806 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:26.124806 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:26.124806 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:26.124806 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:26.124806 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:26.124806 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:26.125623 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:26.125623 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:26.125623 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:26.125623 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:26.125623 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:24:26.125623 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:24:26.125623 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:24:26.125623 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:24:26.125623 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:24:26.125623 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:24:26.125623 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 17:24:26.125623 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:26.125623 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 241/497] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Jul 15 17:24:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:26.126924 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff89e42-cc02-4695-9869-c3c4241439e7 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:26.126924 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff89e42-cc02-4695-9869-c3c4241439e7 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:26.127230 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff89e42-cc02-4695-9869-c3c4241439e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:26.145088 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-7ff89e42-cc02-4695-9869-c3c4241439e7 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:26.146306 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-7ff89e42-cc02-4695-9869-c3c4241439e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:26.189561 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c495b0a-65b5-410b-b662-a70164442519 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:26.210886 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:26.226097 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 242/498] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:24:26.226895 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff89e42-cc02-4695-9869-c3c4241439e7 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:26.228949 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89015842-80d0-4b5e-9e2f-b57b9281aa73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:26.230081 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89015842-80d0-4b5e-9e2f-b57b9281aa73 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:26.231427 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89015842-80d0-4b5e-9e2f-b57b9281aa73 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:26.231853 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89015842-80d0-4b5e-9e2f-b57b9281aa73 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:26.232754 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89015842-80d0-4b5e-9e2f-b57b9281aa73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:26.233210 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89015842-80d0-4b5e-9e2f-b57b9281aa73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:26.234761 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89015842-80d0-4b5e-9e2f-b57b9281aa73 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:26.250275 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 257/499] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:26.251400 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89015842-80d0-4b5e-9e2f-b57b9281aa73 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:26.343343 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:26.348678 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff89e42-cc02-4695-9869-c3c4241439e7 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:26.359051 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89015842-80d0-4b5e-9e2f-b57b9281aa73 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:26.385676 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d7a3d-424c-4ca8-b058-314de90494fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:26.386377 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d7a3d-424c-4ca8-b058-314de90494fd None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:26.386656 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d7a3d-424c-4ca8-b058-314de90494fd None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:26.386926 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d7a3d-424c-4ca8-b058-314de90494fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:26.395138 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8701fa-baf7-4667-9a81-49a0d5b365bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:26.395805 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8701fa-baf7-4667-9a81-49a0d5b365bc None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:26.396086 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8701fa-baf7-4667-9a81-49a0d5b365bc None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:26.396365 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8701fa-baf7-4667-9a81-49a0d5b365bc None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:26.397113 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8701fa-baf7-4667-9a81-49a0d5b365bc None admin] RBAC: Adding query filter params (name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:26.397416 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8701fa-baf7-4667-9a81-49a0d5b365bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:26.398828 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8701fa-baf7-4667-9a81-49a0d5b365bc None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:26.407353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 258/500] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Jul 15 17:24:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:26.410676 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8701fa-baf7-4667-9a81-49a0d5b365bc None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:26.453755 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:26.461025 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d7a3d-424c-4ca8-b058-314de90494fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:26.462618 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d7a3d-424c-4ca8-b058-314de90494fd None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:26.520244 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8701fa-baf7-4667-9a81-49a0d5b365bc None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:26.553645 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1541b225-999d-48a7-a229-e9cdc911ed96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:26.554476 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541b225-999d-48a7-a229-e9cdc911ed96 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:26.554758 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541b225-999d-48a7-a229-e9cdc911ed96 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:26.555030 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541b225-999d-48a7-a229-e9cdc911ed96 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:26.557637 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 243/501] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:24:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 17:24:26.558579 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d7a3d-424c-4ca8-b058-314de90494fd None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:26.566270 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1541b225-999d-48a7-a229-e9cdc911ed96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:24:26.574276 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-1541b225-999d-48a7-a229-e9cdc911ed96 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 17:24:26.574276 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:26.574276 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:26.574276 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:26.574276 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:26.574276 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:26.574276 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:26.574276 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:26.574276 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:26.574276 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:26.574276 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:26.574276 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:26.574276 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:24:26.574276 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:24:26.574276 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:24:26.574276 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:24:26.575198 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:24:26.575198 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:24:26.575198 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:24:26.575198 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:24:26.575198 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:26.575198 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:26.575198 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:26.575198 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:26.575198 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:26.575198 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:26.575198 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:26.575198 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:26.575198 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:26.575198 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:26.575198 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:26.575198 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:26.576010 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:26.576010 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:26.576010 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:26.576010 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:26.576010 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:24:26.576010 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:24:26.576010 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:24:26.576010 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:24:26.576010 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:24:26.576010 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:24:26.576010 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 17:24:26.576010 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:26.576010 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 259/502] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Jul 15 17:24:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:26.576745 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1541b225-999d-48a7-a229-e9cdc911ed96 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:26.589123 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:26.654775 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:26.660908 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d7a3d-424c-4ca8-b058-314de90494fd None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:26.677431 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1541b225-999d-48a7-a229-e9cdc911ed96 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:26.695060 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07537983-dcd1-448f-8506-f50f0ee5e3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:26.695888 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07537983-dcd1-448f-8506-f50f0ee5e3c7 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:26.696162 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07537983-dcd1-448f-8506-f50f0ee5e3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:26.696427 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07537983-dcd1-448f-8506-f50f0ee5e3c7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:26.703677 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07537983-dcd1-448f-8506-f50f0ee5e3c7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:26.705177 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07537983-dcd1-448f-8506-f50f0ee5e3c7 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:26.710345 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c68f84-0c50-46a2-994b-d69facec1499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:26.711135 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c68f84-0c50-46a2-994b-d69facec1499 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:26.711415 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c68f84-0c50-46a2-994b-d69facec1499 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:26.711690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c68f84-0c50-46a2-994b-d69facec1499 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:26.721197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-07537983-dcd1-448f-8506-f50f0ee5e3c7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 15 17:24:26.721197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:26.721197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:26.721197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:26.721197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:26.721197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:26.721197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:26.721197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:26.721197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:26.721197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:26.721197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:26.721197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:26.721197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 17:24:26.721197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 17:24:26.721197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 17:24:26.721197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 17:24:26.722260 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:26.722260 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:26.722260 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 17:24:26.722260 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:24:26.722260 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 17:24:26.722260 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:24:26.722260 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:26.722260 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:26.722260 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:26.722260 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:26.722260 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:26.722260 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:26.722260 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:26.722260 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:26.722260 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:26.722260 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:26.722260 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:26.722260 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:26.723168 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:26.723168 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:26.723168 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 17:24:26.723168 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 17:24:26.723168 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 17:24:26.723168 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 17:24:26.723168 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 17:24:26.723168 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 17:24:26.723168 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 15 17:24:26.723168 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:26.723168 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 244/503] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:24:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:26.723734 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9088b7e-7f90-4ae8-9c4d-f06c49e4e774 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:26.723948 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9088b7e-7f90-4ae8-9c4d-f06c49e4e774 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:26.724193 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9088b7e-7f90-4ae8-9c4d-f06c49e4e774 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:26.725603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 245/504] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:26.726176 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9088b7e-7f90-4ae8-9c4d-f06c49e4e774 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:26.730379 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c68f84-0c50-46a2-994b-d69facec1499 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:26.731878 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c68f84-0c50-46a2-994b-d69facec1499 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:26.749882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-86c68f84-0c50-46a2-994b-d69facec1499 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:26.749882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:26.749882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:26.749882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:26.749882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:26.749882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:26.749882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:26.749882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:26.749882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:26.749882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:26.749882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:26.749882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:26.749882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:26.749882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:26.749882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:26.750751 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:26.750751 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:26.750751 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:26.750751 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:26.750751 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:26.750751 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:26.750751 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:26.750751 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:26.750751 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:26.750751 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:26.750751 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:26.750751 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:26.750751 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:26.750751 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:26.750751 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:26.750751 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:26.750751 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:26.751582 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:26.751582 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:26.751582 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:26.751582 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:26.751582 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 260/505] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:26.751949 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c68f84-0c50-46a2-994b-d69facec1499 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:26.811461 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:26.830976 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9088b7e-7f90-4ae8-9c4d-f06c49e4e774 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:26.851133 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c68f84-0c50-46a2-994b-d69facec1499 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:26.864955 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d80fc-de6f-4b35-8cbe-d042b4cc52d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:26.865764 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d80fc-de6f-4b35-8cbe-d042b4cc52d7 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:26.866072 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d80fc-de6f-4b35-8cbe-d042b4cc52d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:26.866347 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d80fc-de6f-4b35-8cbe-d042b4cc52d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:26.876676 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839d80fc-de6f-4b35-8cbe-d042b4cc52d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:26.878165 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839d80fc-de6f-4b35-8cbe-d042b4cc52d7 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:26.883877 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1409be-7d01-47f4-abcc-337133fdd52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:26.884538 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1409be-7d01-47f4-abcc-337133fdd52c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:26.884843 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1409be-7d01-47f4-abcc-337133fdd52c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:26.885111 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1409be-7d01-47f4-abcc-337133fdd52c None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:26.885886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1409be-7d01-47f4-abcc-337133fdd52c None admin] RBAC: Adding query filter params (name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:26.886194 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1409be-7d01-47f4-abcc-337133fdd52c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:26.887539 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1409be-7d01-47f4-abcc-337133fdd52c None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:26.895639 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 261/506] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Jul 15 17:24:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:26.895906 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-839d80fc-de6f-4b35-8cbe-d042b4cc52d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:26.895906 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:26.895906 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:26.895906 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:26.895906 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:26.895906 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:26.895906 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:26.895906 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:26.895906 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:26.895906 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:26.895906 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:26.895906 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:26.895906 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:26.895906 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:26.895906 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:26.896747 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:26.896747 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:26.896747 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:26.896747 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:26.896747 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:26.896747 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:26.896747 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:26.896747 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:26.896747 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:26.896747 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:26.896747 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:26.896747 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:26.896747 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:26.896747 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:26.896747 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:26.896747 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:26.896747 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:26.897582 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:26.897582 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:26.897582 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:26.897582 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:26.897824 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1409be-7d01-47f4-abcc-337133fdd52c None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:26.897898 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 246/507] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:26.898320 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893caee8-ec28-4950-a2c7-822ff68502ec None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:26.898557 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893caee8-ec28-4950-a2c7-822ff68502ec None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:26.898828 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893caee8-ec28-4950-a2c7-822ff68502ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:26.915827 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-893caee8-ec28-4950-a2c7-822ff68502ec None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:26.917035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-893caee8-ec28-4950-a2c7-822ff68502ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:26.919070 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:26.985743 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 247/508] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:24:26.986525 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893caee8-ec28-4950-a2c7-822ff68502ec None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:27.005323 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1409be-7d01-47f4-abcc-337133fdd52c None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:27.031362 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:27.042978 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bcd176-6273-443d-8026-2e731dc44ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:27.043653 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcd176-6273-443d-8026-2e731dc44ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:27.043937 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcd176-6273-443d-8026-2e731dc44ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:27.044213 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcd176-6273-443d-8026-2e731dc44ce7 None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:27.045222 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bcd176-6273-443d-8026-2e731dc44ce7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:27.045563 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bcd176-6273-443d-8026-2e731dc44ce7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:27.047224 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bcd176-6273-443d-8026-2e731dc44ce7 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:27.064690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 262/509] 10.222.0.27 () {56 vars in 1137 bytes} [Fri Jul 15 17:24:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:27.065509 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bcd176-6273-443d-8026-2e731dc44ce7 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:27.085119 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893caee8-ec28-4950-a2c7-822ff68502ec None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:27.119246 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babe345-2997-4c82-8f02-405c72a19e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:27.119921 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babe345-2997-4c82-8f02-405c72a19e99 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:27.120203 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babe345-2997-4c82-8f02-405c72a19e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:27.120464 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babe345-2997-4c82-8f02-405c72a19e99 None admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:27.121178 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6babe345-2997-4c82-8f02-405c72a19e99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:27.121485 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6babe345-2997-4c82-8f02-405c72a19e99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:27.122913 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6babe345-2997-4c82-8f02-405c72a19e99 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:27.129663 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:27.135524 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 248/510] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:27.136306 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babe345-2997-4c82-8f02-405c72a19e99 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:27.163125 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bcd176-6273-443d-8026-2e731dc44ce7 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:27.196412 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac1b3d-1aed-4584-b66a-91481a1f6e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:27.197201 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac1b3d-1aed-4584-b66a-91481a1f6e1a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:27.197482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac1b3d-1aed-4584-b66a-91481a1f6e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:27.197761 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac1b3d-1aed-4584-b66a-91481a1f6e1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:27.208519 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac1b3d-1aed-4584-b66a-91481a1f6e1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:27.210020 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac1b3d-1aed-4584-b66a-91481a1f6e1a None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:27.227451 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-6dac1b3d-1aed-4584-b66a-91481a1f6e1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:27.227451 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:27.227451 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:27.227451 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:27.227451 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:27.227451 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:27.227451 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:27.227451 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:27.227451 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:27.227451 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:27.227451 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:27.227451 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:27.227451 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:27.227451 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:27.227451 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:27.228488 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:27.228488 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:27.228488 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:27.228488 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:27.228488 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:27.228488 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:27.228488 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:27.228488 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:27.228488 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:27.228488 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:27.228488 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:27.228488 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:27.228488 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:27.228488 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:27.228488 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:27.228488 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:27.228488 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:27.229588 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:27.229588 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:27.229588 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:27.229588 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:27.229588 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 263/511] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:27.229588 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac1b3d-1aed-4584-b66a-91481a1f6e1a None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:27.242978 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babe345-2997-4c82-8f02-405c72a19e99 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:27.263606 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:27.277685 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4284cad-a95f-4c36-a85b-ecb25cd031c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:27.278391 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4284cad-a95f-4c36-a85b-ecb25cd031c3 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:27.278677 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4284cad-a95f-4c36-a85b-ecb25cd031c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:27.278956 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4284cad-a95f-4c36-a85b-ecb25cd031c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:27.279707 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4284cad-a95f-4c36-a85b-ecb25cd031c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:27.280021 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4284cad-a95f-4c36-a85b-ecb25cd031c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:27.281399 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4284cad-a95f-4c36-a85b-ecb25cd031c3 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:27.293343 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 249/512] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:27.294315 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4284cad-a95f-4c36-a85b-ecb25cd031c3 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:27.335707 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac1b3d-1aed-4584-b66a-91481a1f6e1a None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:27.354432 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:27.369511 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcbbcc7-267f-4fcc-827c-f56e6db6f16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:27.370334 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbbcc7-267f-4fcc-827c-f56e6db6f16c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:27.370611 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbbcc7-267f-4fcc-827c-f56e6db6f16c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:27.370886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbbcc7-267f-4fcc-827c-f56e6db6f16c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:27.381238 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcbbcc7-267f-4fcc-827c-f56e6db6f16c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:27.382735 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcbbcc7-267f-4fcc-827c-f56e6db6f16c None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:27.395811 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4284cad-a95f-4c36-a85b-ecb25cd031c3 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:27.400935 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-cbcbbcc7-267f-4fcc-827c-f56e6db6f16c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:27.400935 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:27.400935 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:27.400935 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:27.400935 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:27.400935 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:27.400935 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:27.400935 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:27.400935 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:27.400935 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:27.400935 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:27.400935 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:27.400935 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:27.400935 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:27.400935 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:27.401834 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:27.401834 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:27.401834 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:27.401834 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:27.401834 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:27.401834 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:27.401834 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:27.401834 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:27.401834 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:27.401834 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:27.401834 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:27.401834 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:27.401834 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:27.401834 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:27.401834 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:27.401834 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:27.401834 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:27.402681 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:27.402681 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:27.402681 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:27.402681 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:27.402681 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 264/513] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:27.402938 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcbbcc7-267f-4fcc-827c-f56e6db6f16c None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:27.434366 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f8921-6f58-4da4-855b-3d5bc354f102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:27.435014 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f8921-6f58-4da4-855b-3d5bc354f102 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:27.435295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f8921-6f58-4da4-855b-3d5bc354f102 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:27.435571 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f8921-6f58-4da4-855b-3d5bc354f102 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:27.489068 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:27.502526 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f8921-6f58-4da4-855b-3d5bc354f102 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:27.503904 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f8921-6f58-4da4-855b-3d5bc354f102 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:27.504097 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcbbcc7-267f-4fcc-827c-f56e6db6f16c None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:27.538898 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a65881c-c859-4932-b258-3cdb8b39bfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:27.539696 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65881c-c859-4932-b258-3cdb8b39bfb4 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:27.539977 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65881c-c859-4932-b258-3cdb8b39bfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:27.540245 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65881c-c859-4932-b258-3cdb8b39bfb4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:27.547361 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a65881c-c859-4932-b258-3cdb8b39bfb4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:27.548802 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a65881c-c859-4932-b258-3cdb8b39bfb4 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:27.559762 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:27.563414 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-7a65881c-c859-4932-b258-3cdb8b39bfb4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 17:24:27.563414 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:27.563414 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:27.563414 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:27.563414 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:27.563414 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:27.563414 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:27.563414 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:27.563414 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:27.563414 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:27.563414 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:27.563414 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:27.563414 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 17:24:27.563414 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 17:24:27.563414 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 17:24:27.563414 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 17:24:27.564312 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:27.564312 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:27.564312 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 17:24:27.564312 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:24:27.564312 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 17:24:27.564312 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:24:27.564312 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:27.564312 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:27.564312 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:27.564312 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:27.564312 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:27.564312 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:27.564312 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:27.564312 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:27.564312 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:27.564312 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:27.564312 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:27.564312 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:27.565198 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:27.565198 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:27.565198 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 17:24:27.565198 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 17:24:27.565198 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 17:24:27.565198 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 17:24:27.565198 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 17:24:27.565198 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 17:24:27.565198 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 17:24:27.565198 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:27.565198 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 265/514] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:24:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:27.565761 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a65881c-c859-4932-b258-3cdb8b39bfb4 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:27.611352 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 250/515] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:24:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 17:24:27.612188 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f8921-6f58-4da4-855b-3d5bc354f102 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:27.663331 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a65881c-c859-4932-b258-3cdb8b39bfb4 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:27.697654 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79300096-e98e-4839-9d24-4309d59305f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:27.698344 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79300096-e98e-4839-9d24-4309d59305f4 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:27.698631 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79300096-e98e-4839-9d24-4309d59305f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:27.698910 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79300096-e98e-4839-9d24-4309d59305f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:27.699631 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79300096-e98e-4839-9d24-4309d59305f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:27.699938 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79300096-e98e-4839-9d24-4309d59305f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:27.701341 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79300096-e98e-4839-9d24-4309d59305f4 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:27.710709 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f8921-6f58-4da4-855b-3d5bc354f102 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:27.713383 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 266/516] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:27.714016 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79300096-e98e-4839-9d24-4309d59305f4 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:27.725366 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:27.745148 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1af94f-0c06-4c7a-836e-43668454ab29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:27.745967 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1af94f-0c06-4c7a-836e-43668454ab29 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:27.746280 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1af94f-0c06-4c7a-836e-43668454ab29 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:27.746558 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1af94f-0c06-4c7a-836e-43668454ab29 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:27.753280 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1af94f-0c06-4c7a-836e-43668454ab29 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:27.754715 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1af94f-0c06-4c7a-836e-43668454ab29 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:27.768873 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-6a1af94f-0c06-4c7a-836e-43668454ab29 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:24:27.768873 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:27.768873 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:27.768873 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:27.768873 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:27.768873 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:27.768873 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:27.768873 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:27.768873 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:27.768873 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:27.768873 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:27.768873 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:27.768873 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 17:24:27.768873 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 17:24:27.768873 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 17:24:27.769757 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 17:24:27.769757 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:27.769757 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:27.769757 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:27.769757 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:27.769757 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:27.769757 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:27.769757 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:27.769757 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:27.769757 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:27.769757 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:27.769757 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:27.769757 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:27.769757 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:27.769757 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:27.769757 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:27.769757 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:27.770666 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 17:24:27.770666 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 17:24:27.770666 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 17:24:27.770666 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 17:24:27.770666 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 17:24:27.770666 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 17:24:27.770666 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:24:27.770666 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:27.770666 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 251/517] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:24:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:27.771183 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1af94f-0c06-4c7a-836e-43668454ab29 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:27.790631 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:27.818668 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79300096-e98e-4839-9d24-4309d59305f4 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:27.853149 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bbb18e-301a-4c6d-80fb-1da7b0da22a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:27.853926 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbb18e-301a-4c6d-80fb-1da7b0da22a7 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:27.854210 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbb18e-301a-4c6d-80fb-1da7b0da22a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:27.854476 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbb18e-301a-4c6d-80fb-1da7b0da22a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:27.855208 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bbb18e-301a-4c6d-80fb-1da7b0da22a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:27.855503 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bbb18e-301a-4c6d-80fb-1da7b0da22a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:27.856900 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bbb18e-301a-4c6d-80fb-1da7b0da22a7 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:27.868470 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 267/518] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:27.869249 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bbb18e-301a-4c6d-80fb-1da7b0da22a7 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:27.880110 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1af94f-0c06-4c7a-836e-43668454ab29 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:27.915527 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946e08f-70e5-43fe-bf66-9a3582a46f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:27.916211 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946e08f-70e5-43fe-bf66-9a3582a46f78 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:27.916519 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946e08f-70e5-43fe-bf66-9a3582a46f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:27.916836 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946e08f-70e5-43fe-bf66-9a3582a46f78 None admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:27.917668 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f946e08f-70e5-43fe-bf66-9a3582a46f78 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:27.918000 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f946e08f-70e5-43fe-bf66-9a3582a46f78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:27.919441 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f946e08f-70e5-43fe-bf66-9a3582a46f78 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:27.931825 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:27.956141 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 252/519] 10.222.0.27 () {56 vars in 1137 bytes} [Fri Jul 15 17:24:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:27.956961 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946e08f-70e5-43fe-bf66-9a3582a46f78 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:27.969799 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bbb18e-301a-4c6d-80fb-1da7b0da22a7 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:28.007632 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e979f-0e9d-4a64-a1e8-d4d7c6b458e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:28.008363 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e979f-0e9d-4a64-a1e8-d4d7c6b458e8 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:28.008649 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e979f-0e9d-4a64-a1e8-d4d7c6b458e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:28.008926 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e979f-0e9d-4a64-a1e8-d4d7c6b458e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:28.018921 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e979f-0e9d-4a64-a1e8-d4d7c6b458e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:28.020374 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e979f-0e9d-4a64-a1e8-d4d7c6b458e8 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:28.037397 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-637e979f-0e9d-4a64-a1e8-d4d7c6b458e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:28.037397 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:28.037397 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:28.037397 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:28.037397 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:28.037397 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:28.037397 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:28.037397 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:28.037397 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:28.037397 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:28.037397 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:28.037397 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:28.037397 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:28.037397 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:28.037397 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:28.038317 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:28.038317 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:28.038317 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:28.038317 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:28.038317 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:28.038317 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:28.038317 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:28.038317 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:28.038317 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:28.038317 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:28.038317 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:28.038317 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:28.038317 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:28.038317 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:28.038317 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:28.038317 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:28.038317 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:28.039195 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:28.039195 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:28.039195 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:28.039195 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:28.039401 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:28.039471 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 268/520] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:28.039471 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e979f-0e9d-4a64-a1e8-d4d7c6b458e8 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:28.061827 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946e08f-70e5-43fe-bf66-9a3582a46f78 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:28.095616 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d5570d-29c3-40ca-82c4-4b7c88c4be47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:28.096418 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5570d-29c3-40ca-82c4-4b7c88c4be47 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:28.096718 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5570d-29c3-40ca-82c4-4b7c88c4be47 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:28.096988 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5570d-29c3-40ca-82c4-4b7c88c4be47 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:28.104063 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d5570d-29c3-40ca-82c4-4b7c88c4be47 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:28.105565 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d5570d-29c3-40ca-82c4-4b7c88c4be47 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:28.120445 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-91d5570d-29c3-40ca-82c4-4b7c88c4be47 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 17:24:28.120445 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:28.120445 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:28.120445 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:28.120445 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:28.120445 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:28.120445 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:28.120445 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:28.120445 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:28.120445 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:28.120445 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:28.120445 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:28.120445 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 17:24:28.120445 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 17:24:28.120445 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 17:24:28.120445 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 17:24:28.121527 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:28.121527 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:28.121527 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 17:24:28.121527 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:24:28.121527 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 17:24:28.121527 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:24:28.121527 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:28.121527 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:28.121527 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:28.121527 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:28.121527 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:28.121527 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:28.121527 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:28.121527 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:28.121527 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:28.121527 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:28.121527 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:28.121527 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:28.122447 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:28.122447 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:28.122447 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 17:24:28.122447 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 17:24:28.122447 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 17:24:28.122447 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 17:24:28.122447 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 17:24:28.122447 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 17:24:28.122447 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 17:24:28.122447 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:28.122447 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 253/521] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Jul 15 17:24:27 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:28.122447 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d5570d-29c3-40ca-82c4-4b7c88c4be47 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:28.143589 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e979f-0e9d-4a64-a1e8-d4d7c6b458e8 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:28.160289 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:28.178176 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f019d-7c5f-4e6a-b70a-5c0934a6ab98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:28.178840 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f019d-7c5f-4e6a-b70a-5c0934a6ab98 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:28.179120 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f019d-7c5f-4e6a-b70a-5c0934a6ab98 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:28.179389 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f019d-7c5f-4e6a-b70a-5c0934a6ab98 None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:28.180183 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f019d-7c5f-4e6a-b70a-5c0934a6ab98 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:28.180488 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f019d-7c5f-4e6a-b70a-5c0934a6ab98 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:28.181958 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f019d-7c5f-4e6a-b70a-5c0934a6ab98 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:28.199205 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 269/522] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jul 15 17:24:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:28.199979 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f019d-7c5f-4e6a-b70a-5c0934a6ab98 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:28.219912 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d5570d-29c3-40ca-82c4-4b7c88c4be47 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:28.253377 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9af92d-1c00-4082-a8c6-ae0814b26ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:28.254063 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9af92d-1c00-4082-a8c6-ae0814b26ef4 None admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:28.254358 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9af92d-1c00-4082-a8c6-ae0814b26ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:28.254632 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9af92d-1c00-4082-a8c6-ae0814b26ef4 None admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:28.255412 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9af92d-1c00-4082-a8c6-ae0814b26ef4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:28.256863 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9af92d-1c00-4082-a8c6-ae0814b26ef4 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:28.264586 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:28.277447 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 254/523] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Jul 15 17:24:28 2022] POST /identity/v3/users => generated 247 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:24:28.278585 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9af92d-1c00-4082-a8c6-ae0814b26ef4 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:28.300629 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f019d-7c5f-4e6a-b70a-5c0934a6ab98 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:28.342192 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef563d7-680c-4cd5-b78c-1432d98f2b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:28.342882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef563d7-680c-4cd5-b78c-1432d98f2b50 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:28.343247 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef563d7-680c-4cd5-b78c-1432d98f2b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:28.343522 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef563d7-680c-4cd5-b78c-1432d98f2b50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:28.394603 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:28.410029 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9af92d-1c00-4082-a8c6-ae0814b26ef4 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:28.419200 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef563d7-680c-4cd5-b78c-1432d98f2b50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:28.420948 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef563d7-680c-4cd5-b78c-1432d98f2b50 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:28.451297 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deefcff6-db82-452d-8a77-844670190e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:28.452482 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefcff6-db82-452d-8a77-844670190e06 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:28.452763 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefcff6-db82-452d-8a77-844670190e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:28.453042 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefcff6-db82-452d-8a77-844670190e06 None admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:28.453774 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deefcff6-db82-452d-8a77-844670190e06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:28.454152 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deefcff6-db82-452d-8a77-844670190e06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:28.455851 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deefcff6-db82-452d-8a77-844670190e06 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:28.469387 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 255/524] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:28.470706 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deefcff6-db82-452d-8a77-844670190e06 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:28.531007 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:28.536196 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 270/525] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:24:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 17:24:28.537198 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef563d7-680c-4cd5-b78c-1432d98f2b50 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:28.586118 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deefcff6-db82-452d-8a77-844670190e06 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:28.620425 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb090e2-fcd8-4d35-a8e4-58ac4bc62734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:28.621115 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb090e2-fcd8-4d35-a8e4-58ac4bc62734 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:28.621395 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb090e2-fcd8-4d35-a8e4-58ac4bc62734 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:28.621674 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb090e2-fcd8-4d35-a8e4-58ac4bc62734 None admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:28.622542 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb090e2-fcd8-4d35-a8e4-58ac4bc62734 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:28.622851 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb090e2-fcd8-4d35-a8e4-58ac4bc62734 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:28.624378 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb090e2-fcd8-4d35-a8e4-58ac4bc62734 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:28.626029 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:28.644317 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 256/526] 10.222.0.27 () {56 vars in 1139 bytes} [Fri Jul 15 17:24:28 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:28.645069 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb090e2-fcd8-4d35-a8e4-58ac4bc62734 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:28.655376 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef563d7-680c-4cd5-b78c-1432d98f2b50 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:28.692864 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02407cb9-c187-4818-ac91-7e775c89041e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:28.693551 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02407cb9-c187-4818-ac91-7e775c89041e None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:28.693861 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02407cb9-c187-4818-ac91-7e775c89041e None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:28.694143 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02407cb9-c187-4818-ac91-7e775c89041e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:28.694971 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02407cb9-c187-4818-ac91-7e775c89041e None admin] RBAC: Adding query filter params (role.id=1a453be279744db09ef4e2fcf580beac, scope.project.id=19cc5221b8074f48b5f73dc9c4289b03, user.id=f9d548c8199e4fdbbce7597bebd63421) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:28.695282 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02407cb9-c187-4818-ac91-7e775c89041e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:28.696737 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02407cb9-c187-4818-ac91-7e775c89041e None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:28.703215 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 271/527] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jul 15 17:24:28 2022] GET /identity/v3/role_assignments?user.id=f9d548c8199e4fdbbce7597bebd63421&scope.project.id=19cc5221b8074f48b5f73dc9c4289b03&role.id=1a453be279744db09ef4e2fcf580beac => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:28.703886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02407cb9-c187-4818-ac91-7e775c89041e None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:28.784716 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb090e2-fcd8-4d35-a8e4-58ac4bc62734 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:28.798692 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:28.819017 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02407cb9-c187-4818-ac91-7e775c89041e None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:28.828240 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1644dc5-a57a-4d07-a8c7-4cad8484c825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:28.829559 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1644dc5-a57a-4d07-a8c7-4cad8484c825 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:28.830129 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1644dc5-a57a-4d07-a8c7-4cad8484c825 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:28.830968 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1644dc5-a57a-4d07-a8c7-4cad8484c825 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:28.839385 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1644dc5-a57a-4d07-a8c7-4cad8484c825 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:28.841231 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1644dc5-a57a-4d07-a8c7-4cad8484c825 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:28.856483 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074434a1-8710-4b30-ba93-569425a86d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:28.857283 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074434a1-8710-4b30-ba93-569425a86d73 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:28.857630 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074434a1-8710-4b30-ba93-569425a86d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:28.857933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074434a1-8710-4b30-ba93-569425a86d73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:28.861381 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-e1644dc5-a57a-4d07-a8c7-4cad8484c825 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:24:28.861381 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:28.861381 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:28.861381 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:28.861381 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:28.861381 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:28.861381 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:28.861381 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:28.861381 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:28.861381 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:28.861381 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:28.861381 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:28.861381 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 17:24:28.861381 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 17:24:28.861381 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 17:24:28.862417 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 17:24:28.862417 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:28.862417 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:28.862417 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:28.862417 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:28.862417 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:28.862417 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:28.862417 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:28.862417 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:28.862417 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:28.862417 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:28.862417 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:28.862417 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:28.862417 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:28.862417 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:28.862417 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:28.862417 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:28.863247 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 17:24:28.863247 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 17:24:28.863247 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 17:24:28.863247 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 17:24:28.863247 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 17:24:28.863247 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 17:24:28.863247 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:24:28.863247 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:28.865307 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 257/528] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:24:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:28.866311 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1644dc5-a57a-4d07-a8c7-4cad8484c825 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:28.870901 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074434a1-8710-4b30-ba93-569425a86d73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:28.871756 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074434a1-8710-4b30-ba93-569425a86d73 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:28.874757 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:28.891353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-074434a1-8710-4b30-ba93-569425a86d73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:28.891353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:28.891353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:28.891353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:28.891353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:28.891353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:28.891353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:28.891353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:28.891353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:28.891353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:28.891353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:28.891353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:28.891353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:28.891353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:28.891353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:28.892277 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:28.892277 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:28.892277 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:28.892277 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:28.892277 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:28.892277 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:28.892277 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:28.892277 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:28.892277 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:28.892277 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:28.892277 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:28.892277 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:28.892277 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:28.892277 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:28.892277 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:28.892277 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:28.892277 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:28.893106 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:28.893106 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:28.893106 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:28.893106 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:28.893106 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 272/529] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:28.893844 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074434a1-8710-4b30-ba93-569425a86d73 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:28.975901 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1644dc5-a57a-4d07-a8c7-4cad8484c825 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:28.995284 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074434a1-8710-4b30-ba93-569425a86d73 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:29.020555 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8cc653-8862-416d-ba29-97212d568d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:29.021699 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cc653-8862-416d-ba29-97212d568d3b None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:29.022294 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cc653-8862-416d-ba29-97212d568d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:29.022760 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cc653-8862-416d-ba29-97212d568d3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:29.030429 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433066eb-e25c-409f-9b27-5e8c6013d751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:29.031100 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433066eb-e25c-409f-9b27-5e8c6013d751 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:29.031499 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433066eb-e25c-409f-9b27-5e8c6013d751 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:29.031716 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433066eb-e25c-409f-9b27-5e8c6013d751 None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:29.032591 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433066eb-e25c-409f-9b27-5e8c6013d751 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:29.032880 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433066eb-e25c-409f-9b27-5e8c6013d751 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:29.034789 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433066eb-e25c-409f-9b27-5e8c6013d751 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:29.048544 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 273/530] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jul 15 17:24:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:29.049603 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433066eb-e25c-409f-9b27-5e8c6013d751 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:29.082174 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:29.109328 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:29.110358 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8cc653-8862-416d-ba29-97212d568d3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:29.112091 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8cc653-8862-416d-ba29-97212d568d3b None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:29.170470 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433066eb-e25c-409f-9b27-5e8c6013d751 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:29.217342 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82386321-53a4-4026-bd11-88280bd88898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:29.219079 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82386321-53a4-4026-bd11-88280bd88898 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:29.219568 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82386321-53a4-4026-bd11-88280bd88898 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:29.220285 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82386321-53a4-4026-bd11-88280bd88898 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:29.221360 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82386321-53a4-4026-bd11-88280bd88898 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:29.222188 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82386321-53a4-4026-bd11-88280bd88898 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:29.224074 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82386321-53a4-4026-bd11-88280bd88898 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:29.229814 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 258/531] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:24:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 17:24:29.229814 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8cc653-8862-416d-ba29-97212d568d3b None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:29.249601 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 274/532] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:29.250576 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82386321-53a4-4026-bd11-88280bd88898 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:29.307795 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:29.349249 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8cc653-8862-416d-ba29-97212d568d3b None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:29.374909 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82386321-53a4-4026-bd11-88280bd88898 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:29.390545 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:29.399367 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81fe783-fa55-447e-94ea-19ecf2bc3614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:29.401079 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81fe783-fa55-447e-94ea-19ecf2bc3614 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:29.401661 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81fe783-fa55-447e-94ea-19ecf2bc3614 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:29.402146 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81fe783-fa55-447e-94ea-19ecf2bc3614 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:29.403168 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81fe783-fa55-447e-94ea-19ecf2bc3614 None admin] RBAC: Adding query filter params (role.id=1a453be279744db09ef4e2fcf580beac, scope.project.id=19cc5221b8074f48b5f73dc9c4289b03, user.id=14775984c9d4463a8e8848dcf189714b) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:29.403793 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81fe783-fa55-447e-94ea-19ecf2bc3614 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:29.405940 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81fe783-fa55-447e-94ea-19ecf2bc3614 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:29.412310 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 259/533] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jul 15 17:24:29 2022] GET /identity/v3/role_assignments?user.id=14775984c9d4463a8e8848dcf189714b&scope.project.id=19cc5221b8074f48b5f73dc9c4289b03&role.id=1a453be279744db09ef4e2fcf580beac => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:29.413636 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81fe783-fa55-447e-94ea-19ecf2bc3614 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:29.440079 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f7e0bd-e68e-43a7-b817-2fdf786194d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:29.440914 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7e0bd-e68e-43a7-b817-2fdf786194d1 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:29.441193 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7e0bd-e68e-43a7-b817-2fdf786194d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:29.441523 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7e0bd-e68e-43a7-b817-2fdf786194d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:29.461888 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f7e0bd-e68e-43a7-b817-2fdf786194d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:29.463783 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f7e0bd-e68e-43a7-b817-2fdf786194d1 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:29.488942 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-50f7e0bd-e68e-43a7-b817-2fdf786194d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:29.488942 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:29.488942 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:29.488942 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:29.488942 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:29.488942 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:29.488942 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:29.488942 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:29.488942 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:29.488942 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:29.488942 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:29.488942 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:29.488942 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:29.488942 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:29.488942 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:29.490302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:29.490302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:29.490302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:29.490302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:29.490302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:29.490302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:29.490302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:29.490302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:29.490302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:29.490302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:29.490302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:29.490302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:29.490302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:29.490302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:29.490302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:29.490302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:29.490302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:29.491143 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:29.491143 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:29.491143 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:29.491143 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:29.494806 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 275/534] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:29.516335 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f7e0bd-e68e-43a7-b817-2fdf786194d1 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:29.574112 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81fe783-fa55-447e-94ea-19ecf2bc3614 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:29.618025 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559d71f-99c2-41c5-b578-6bd97be31fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:29.619700 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559d71f-99c2-41c5-b578-6bd97be31fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:29.620198 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559d71f-99c2-41c5-b578-6bd97be31fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:29.620656 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559d71f-99c2-41c5-b578-6bd97be31fc7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:29.633122 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d559d71f-99c2-41c5-b578-6bd97be31fc7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:29.635352 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d559d71f-99c2-41c5-b578-6bd97be31fc7 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:29.659099 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:29.660935 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-d559d71f-99c2-41c5-b578-6bd97be31fc7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:24:29.660935 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:29.660935 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:29.660935 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:29.660935 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:29.660935 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:29.660935 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:29.660935 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:29.660935 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:29.660935 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:29.660935 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:29.660935 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:29.660935 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 17:24:29.660935 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 17:24:29.660935 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 17:24:29.662062 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 17:24:29.662062 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:29.662062 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:29.662062 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:29.662062 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:29.662062 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:29.662062 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:29.662062 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:29.662062 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:29.662062 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:29.662062 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:29.662062 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:29.662062 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:29.662062 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:29.662062 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:29.662062 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:29.662062 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:29.663655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 17:24:29.663655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 17:24:29.663655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 17:24:29.663655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 17:24:29.663655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 17:24:29.663655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 17:24:29.663655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:24:29.663655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:29.663655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 260/535] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:24:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:29.670839 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559d71f-99c2-41c5-b578-6bd97be31fc7 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:29.781003 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f7e0bd-e68e-43a7-b817-2fdf786194d1 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:29.866037 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626e2ff-0c67-4eee-bc26-b27c25c411a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:29.866629 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626e2ff-0c67-4eee-bc26-b27c25c411a5 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:29.866908 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626e2ff-0c67-4eee-bc26-b27c25c411a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:29.867188 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626e2ff-0c67-4eee-bc26-b27c25c411a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:29.868369 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4626e2ff-0c67-4eee-bc26-b27c25c411a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:29.868872 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4626e2ff-0c67-4eee-bc26-b27c25c411a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:29.870547 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4626e2ff-0c67-4eee-bc26-b27c25c411a5 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:29.889432 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559d71f-99c2-41c5-b578-6bd97be31fc7 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:29.906038 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 276/536] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:29.911661 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626e2ff-0c67-4eee-bc26-b27c25c411a5 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:29.971179 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:29.980663 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e2866-e417-4200-8664-48ac1d303662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:29.981337 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e2866-e417-4200-8664-48ac1d303662 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:29.981662 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e2866-e417-4200-8664-48ac1d303662 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:29.981970 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e2866-e417-4200-8664-48ac1d303662 None admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:29.982805 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478e2866-e417-4200-8664-48ac1d303662 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:29.983177 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478e2866-e417-4200-8664-48ac1d303662 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:29.985272 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478e2866-e417-4200-8664-48ac1d303662 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:30.041922 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 261/537] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jul 15 17:24:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:30.045568 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e2866-e417-4200-8664-48ac1d303662 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:30.148067 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626e2ff-0c67-4eee-bc26-b27c25c411a5 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:30.182148 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:30.188962 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2920177-615f-422b-a806-8693bea08e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:30.189767 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2920177-615f-422b-a806-8693bea08e48 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:30.190075 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2920177-615f-422b-a806-8693bea08e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:30.190350 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2920177-615f-422b-a806-8693bea08e48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:30.199878 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2920177-615f-422b-a806-8693bea08e48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:30.201630 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2920177-615f-422b-a806-8693bea08e48 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:30.217953 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-e2920177-615f-422b-a806-8693bea08e48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:24:30.217953 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:30.217953 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:30.217953 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:30.217953 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:30.217953 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:30.217953 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:30.217953 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:30.217953 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:30.217953 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:30.217953 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:30.217953 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:30.217953 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 17:24:30.217953 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 17:24:30.217953 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 17:24:30.218834 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 17:24:30.218834 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:30.218834 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:30.218834 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:30.218834 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:30.218834 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:30.218834 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:30.218834 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:30.218834 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:30.218834 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:30.218834 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:30.218834 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:30.218834 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:30.218834 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:30.218834 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:30.218834 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:30.218834 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:30.219738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 17:24:30.219738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 17:24:30.219738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 17:24:30.219738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 17:24:30.219738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 17:24:30.219738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 17:24:30.219738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:24:30.219738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:30.219738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 277/538] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:24:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 17:24:30.224999 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2920177-615f-422b-a806-8693bea08e48 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:30.258868 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e2866-e417-4200-8664-48ac1d303662 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:30.311952 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9de6c-dafc-4853-aaf2-04b896ad97e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:30.311952 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9de6c-dafc-4853-aaf2-04b896ad97e3 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:30.311952 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9de6c-dafc-4853-aaf2-04b896ad97e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:30.312308 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9de6c-dafc-4853-aaf2-04b896ad97e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:30.312923 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9de6c-dafc-4853-aaf2-04b896ad97e3 None admin] RBAC: Adding query filter params (role.id=1a453be279744db09ef4e2fcf580beac, scope.project.id=19cc5221b8074f48b5f73dc9c4289b03, user.id=94b8121d0b0d4eef818b2a8b3508df18) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:30.313229 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9de6c-dafc-4853-aaf2-04b896ad97e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:30.314848 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9de6c-dafc-4853-aaf2-04b896ad97e3 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:30.326093 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 262/539] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jul 15 17:24:30 2022] GET /identity/v3/role_assignments?user.id=94b8121d0b0d4eef818b2a8b3508df18&scope.project.id=19cc5221b8074f48b5f73dc9c4289b03&role.id=1a453be279744db09ef4e2fcf580beac => generated 259 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:24:30.417187 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:30.439908 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2920177-615f-422b-a806-8693bea08e48 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:30.495038 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e184d56-e70a-433a-a92b-d7f160320412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:30.495724 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e184d56-e70a-433a-a92b-d7f160320412 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:30.496008 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e184d56-e70a-433a-a92b-d7f160320412 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:30.496285 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e184d56-e70a-433a-a92b-d7f160320412 None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:30.497095 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e184d56-e70a-433a-a92b-d7f160320412 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:30.497411 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e184d56-e70a-433a-a92b-d7f160320412 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:30.498970 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e184d56-e70a-433a-a92b-d7f160320412 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:30.517348 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 278/540] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jul 15 17:24:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:30.522864 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9de6c-dafc-4853-aaf2-04b896ad97e3 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:30.583017 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b1898-9c5a-4bee-837d-02fe886a03e7 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:30.583354 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b1898-9c5a-4bee-837d-02fe886a03e7 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:30.583580 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b1898-9c5a-4bee-837d-02fe886a03e7 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:30.585851 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 279/541] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 17:24:30.595253 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5ccd9-7c37-4b50-a911-b5894a4468d8 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:30.595684 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5ccd9-7c37-4b50-a911-b5894a4468d8 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:30.596065 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5ccd9-7c37-4b50-a911-b5894a4468d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:30.627886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-21d5ccd9-7c37-4b50-a911-b5894a4468d8 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:30.627886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-21d5ccd9-7c37-4b50-a911-b5894a4468d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:30.646772 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9de6c-dafc-4853-aaf2-04b896ad97e3 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:30.666040 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:30.690709 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbfb648-b671-4b55-af02-175240331ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:30.691289 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbfb648-b671-4b55-af02-175240331ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:30.691574 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbfb648-b671-4b55-af02-175240331ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:30.691849 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbfb648-b671-4b55-af02-175240331ff3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:30.692684 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbfb648-b671-4b55-af02-175240331ff3 None admin] RBAC: Adding query filter params (role.id=1a453be279744db09ef4e2fcf580beac, scope.project.id=19cc5221b8074f48b5f73dc9c4289b03, user.id=989272e5e803405d87d0833d503bb572) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:30.692990 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbfb648-b671-4b55-af02-175240331ff3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:30.697893 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbfb648-b671-4b55-af02-175240331ff3 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:30.715288 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 263/542] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jul 15 17:24:30 2022] GET /identity/v3/role_assignments?user.id=989272e5e803405d87d0833d503bb572&scope.project.id=19cc5221b8074f48b5f73dc9c4289b03&role.id=1a453be279744db09ef4e2fcf580beac => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:30.743613 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 280/543] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:24:30.777970 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbfb648-b671-4b55-af02-175240331ff3 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:30.910747 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbfb648-b671-4b55-af02-175240331ff3 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:30.965137 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8e25d-288f-4966-96f0-6b0afe78987f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:30.966368 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8e25d-288f-4966-96f0-6b0afe78987f None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:30.966901 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8e25d-288f-4966-96f0-6b0afe78987f None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:30.967394 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8e25d-288f-4966-96f0-6b0afe78987f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:30.988721 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8e25d-288f-4966-96f0-6b0afe78987f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:24:30.997025 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-eae8e25d-288f-4966-96f0-6b0afe78987f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 17:24:30.997025 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:30.997025 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:30.997025 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:30.997025 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:30.997025 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:30.997025 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:30.997025 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:30.997025 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:30.997025 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:30.997025 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:30.997025 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:30.997025 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:24:30.997025 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:24:30.997025 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:24:30.997025 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:24:30.997967 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:24:30.997967 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:24:30.997967 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:24:30.997967 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:24:30.997967 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:30.997967 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:30.997967 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:30.997967 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:30.997967 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:30.997967 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:30.997967 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:30.997967 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:30.997967 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:30.997967 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:30.997967 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:30.997967 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:30.998775 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:30.998775 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:30.998775 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:30.998775 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:30.998775 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:24:30.998775 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:24:30.998775 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:24:30.998775 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:24:30.998775 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:24:30.998775 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:24:30.998775 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 17:24:30.998775 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:31.001178 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 264/544] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Jul 15 17:24:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:31.009034 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5ccd9-7c37-4b50-a911-b5894a4468d8 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:31.043631 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66599cad-fab4-4dcf-b190-2155c0e27022 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:31.044294 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66599cad-fab4-4dcf-b190-2155c0e27022 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:31.044766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66599cad-fab4-4dcf-b190-2155c0e27022 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:31.046754 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 265/545] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 17:24:31.052129 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f6fbb-6a01-4666-be91-811249357556 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:31.052665 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f6fbb-6a01-4666-be91-811249357556 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:31.054417 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f6fbb-6a01-4666-be91-811249357556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:31.090809 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-310f6fbb-6a01-4666-be91-811249357556 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:31.091002 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:31.092072 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-310f6fbb-6a01-4666-be91-811249357556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:31.114851 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5ccd9-7c37-4b50-a911-b5894a4468d8 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:31.149690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e35e2-caea-44a9-b118-9163ecff2548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:31.150465 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e35e2-caea-44a9-b118-9163ecff2548 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:31.150751 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e35e2-caea-44a9-b118-9163ecff2548 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:31.151139 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e35e2-caea-44a9-b118-9163ecff2548 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:31.151989 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79e35e2-caea-44a9-b118-9163ecff2548 None admin] RBAC: Adding query filter params (name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:31.152295 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79e35e2-caea-44a9-b118-9163ecff2548 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:31.153660 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79e35e2-caea-44a9-b118-9163ecff2548 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:31.162478 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 281/546] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Jul 15 17:24:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:31.168333 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e35e2-caea-44a9-b118-9163ecff2548 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:31.183190 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:31.242558 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 266/547] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:24:31.288585 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f6fbb-6a01-4666-be91-811249357556 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:31.353553 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e35e2-caea-44a9-b118-9163ecff2548 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:31.400714 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e924c5-c2f6-4e11-ab99-b0157913f483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:31.401516 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e924c5-c2f6-4e11-ab99-b0157913f483 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:31.401813 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e924c5-c2f6-4e11-ab99-b0157913f483 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:31.402093 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e924c5-c2f6-4e11-ab99-b0157913f483 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:31.415110 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:31.423129 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e924c5-c2f6-4e11-ab99-b0157913f483 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:31.424631 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e924c5-c2f6-4e11-ab99-b0157913f483 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:31.445105 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-b3e924c5-c2f6-4e11-ab99-b0157913f483 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:31.445105 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:31.445105 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:31.445105 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:31.445105 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:31.445105 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:31.445105 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:31.445105 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:31.445105 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:31.445105 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:31.445105 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:31.445105 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:31.445105 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:31.445105 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:31.445105 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:31.446048 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:31.446048 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:31.446048 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:31.446048 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:31.446048 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:31.446048 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:31.446048 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:31.446048 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:31.446048 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:31.446048 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:31.446048 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:31.446048 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:31.446048 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:31.446048 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:31.446048 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:31.446048 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:31.446048 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:31.446899 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:31.446899 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:31.446899 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:31.446899 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:31.446899 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 282/548] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:31.453081 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e924c5-c2f6-4e11-ab99-b0157913f483 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:31.483721 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f6fbb-6a01-4666-be91-811249357556 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:31.571063 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e924c5-c2f6-4e11-ab99-b0157913f483 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:31.607550 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752df6a-cda9-4226-a133-72e554c4d9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:31.608381 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752df6a-cda9-4226-a133-72e554c4d9e0 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:31.608659 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752df6a-cda9-4226-a133-72e554c4d9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:31.608926 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752df6a-cda9-4226-a133-72e554c4d9e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:31.626827 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669e3c4-650c-49ea-8664-a4da82c406d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:31.627505 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669e3c4-650c-49ea-8664-a4da82c406d8 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:31.627786 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669e3c4-650c-49ea-8664-a4da82c406d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:31.628061 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669e3c4-650c-49ea-8664-a4da82c406d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:31.628790 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4669e3c4-650c-49ea-8664-a4da82c406d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:31.629094 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4669e3c4-650c-49ea-8664-a4da82c406d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:31.630491 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4669e3c4-650c-49ea-8664-a4da82c406d8 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:31.653610 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 283/549] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:24:31.659382 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3752df6a-cda9-4226-a133-72e554c4d9e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:24:31.659878 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669e3c4-650c-49ea-8664-a4da82c406d8 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:31.675953 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-3752df6a-cda9-4226-a133-72e554c4d9e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 17:24:31.675953 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:31.675953 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:31.675953 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:31.675953 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:31.675953 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:31.675953 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:31.675953 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:31.675953 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:31.675953 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:31.675953 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:31.675953 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:31.675953 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:24:31.675953 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:24:31.675953 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:24:31.675953 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:24:31.677312 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:24:31.677312 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:24:31.677312 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:24:31.677312 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:24:31.677312 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:31.677312 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:31.677312 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:31.677312 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:31.677312 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:31.677312 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:31.677312 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:31.677312 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:31.677312 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:31.677312 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:31.677312 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:31.677312 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:31.678399 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:31.678399 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:31.678399 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:31.678399 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:31.678399 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:24:31.678399 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:24:31.678399 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:24:31.678399 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:24:31.678399 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:24:31.678399 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:24:31.678399 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 17:24:31.678399 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:31.678399 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 267/550] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Jul 15 17:24:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 17:24:31.687163 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752df6a-cda9-4226-a133-72e554c4d9e0 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:31.731105 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:31.775101 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:31.879419 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669e3c4-650c-49ea-8664-a4da82c406d8 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:31.927936 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccdf1a7-c7ba-471a-a0b8-f00940905df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:31.933810 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccdf1a7-c7ba-471a-a0b8-f00940905df8 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:31.933810 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccdf1a7-c7ba-471a-a0b8-f00940905df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:31.933810 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccdf1a7-c7ba-471a-a0b8-f00940905df8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:31.941801 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccdf1a7-c7ba-471a-a0b8-f00940905df8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:31.942731 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccdf1a7-c7ba-471a-a0b8-f00940905df8 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:31.959969 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-dccdf1a7-c7ba-471a-a0b8-f00940905df8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 15 17:24:31.959969 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:31.959969 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:31.959969 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:31.959969 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:31.959969 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:31.959969 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:31.959969 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:31.959969 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:31.959969 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:31.959969 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:31.959969 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:31.959969 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 17:24:31.959969 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 17:24:31.959969 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 17:24:31.959969 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 17:24:31.960886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:31.960886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:31.960886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 17:24:31.960886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:24:31.960886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 17:24:31.960886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:24:31.960886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:31.960886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:31.960886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:31.960886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:31.960886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:31.960886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:31.960886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:31.960886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:31.960886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:31.960886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:31.960886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:31.960886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:31.961848 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:31.961848 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:31.961848 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 17:24:31.961848 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 17:24:31.961848 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 17:24:31.961848 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 17:24:31.961848 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 17:24:31.961848 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 17:24:31.961848 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 15 17:24:31.961848 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:31.961848 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 284/551] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jul 15 17:24:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:31.967275 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccdf1a7-c7ba-471a-a0b8-f00940905df8 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:32.019884 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752df6a-cda9-4226-a133-72e554c4d9e0 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:32.098069 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77aebee-d3ba-4d9a-aaf8-7f3159f28b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:32.098597 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccdf1a7-c7ba-471a-a0b8-f00940905df8 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:32.099064 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77aebee-d3ba-4d9a-aaf8-7f3159f28b24 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:32.099064 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77aebee-d3ba-4d9a-aaf8-7f3159f28b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:32.101803 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77aebee-d3ba-4d9a-aaf8-7f3159f28b24 None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:32.104282 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77aebee-d3ba-4d9a-aaf8-7f3159f28b24 None admin] RBAC: Adding query filter params (name=service) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:32.105213 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77aebee-d3ba-4d9a-aaf8-7f3159f28b24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:32.106662 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77aebee-d3ba-4d9a-aaf8-7f3159f28b24 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:32.130147 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:32.132569 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 268/552] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Jul 15 17:24:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 446 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:32.134078 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74877223-3b6f-4621-8329-107670796d0d None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:32.134420 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74877223-3b6f-4621-8329-107670796d0d None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:32.134699 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74877223-3b6f-4621-8329-107670796d0d None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:32.136230 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 269/553] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:32.141401 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74877223-3b6f-4621-8329-107670796d0d None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:32.173138 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15fb91-059b-416a-87ed-fdc16f59f8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:32.174235 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15fb91-059b-416a-87ed-fdc16f59f8fa None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:32.174626 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15fb91-059b-416a-87ed-fdc16f59f8fa None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:32.175017 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15fb91-059b-416a-87ed-fdc16f59f8fa None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:32.175979 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a15fb91-059b-416a-87ed-fdc16f59f8fa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:32.176388 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a15fb91-059b-416a-87ed-fdc16f59f8fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:32.178327 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a15fb91-059b-416a-87ed-fdc16f59f8fa None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:32.205070 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 285/554] 10.222.0.27 () {56 vars in 1135 bytes} [Fri Jul 15 17:24:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:32.208502 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d264a-d2ae-4ff3-839c-98f261241485 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:32.208904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d264a-d2ae-4ff3-839c-98f261241485 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:32.209640 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d264a-d2ae-4ff3-839c-98f261241485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:32.229427 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-b51d264a-d2ae-4ff3-839c-98f261241485 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:32.230946 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b51d264a-d2ae-4ff3-839c-98f261241485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:32.324750 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:32.332424 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 286/555] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:24:32.333414 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d264a-d2ae-4ff3-839c-98f261241485 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:32.335564 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74877223-3b6f-4621-8329-107670796d0d None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:32.370833 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f8aa1-50b4-48e7-b830-25c02ee9e949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:32.371979 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f8aa1-50b4-48e7-b830-25c02ee9e949 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:32.372488 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f8aa1-50b4-48e7-b830-25c02ee9e949 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:32.373014 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f8aa1-50b4-48e7-b830-25c02ee9e949 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:32.384740 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f8aa1-50b4-48e7-b830-25c02ee9e949 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:32.386759 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f8aa1-50b4-48e7-b830-25c02ee9e949 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:32.406675 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-835f8aa1-50b4-48e7-b830-25c02ee9e949 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:32.406675 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:32.406675 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:32.406675 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:32.406675 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:32.406675 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:32.406675 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:32.406675 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:32.406675 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:32.406675 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:32.406675 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:32.406675 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:32.406675 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:32.406675 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:32.406675 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:32.407613 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:32.407613 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:32.407613 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:32.407613 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:32.407613 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:32.407613 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:32.407613 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:32.407613 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:32.407613 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:32.407613 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:32.407613 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:32.407613 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:32.407613 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:32.407613 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:32.407613 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:32.407613 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:32.407613 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:32.408562 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:32.408562 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:32.408562 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:32.408562 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:32.410819 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 270/556] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:32.416245 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f8aa1-50b4-48e7-b830-25c02ee9e949 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:32.450140 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:32.456177 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d264a-d2ae-4ff3-839c-98f261241485 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:32.498804 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23cd712-05ae-4071-bedb-8697e0a624f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:32.499466 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23cd712-05ae-4071-bedb-8697e0a624f6 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:32.499748 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23cd712-05ae-4071-bedb-8697e0a624f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:32.500026 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23cd712-05ae-4071-bedb-8697e0a624f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:32.524071 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f8aa1-50b4-48e7-b830-25c02ee9e949 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:32.561401 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19424c-a13c-4d86-83c0-0b3edfa178e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:32.562652 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19424c-a13c-4d86-83c0-0b3edfa178e0 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:32.563186 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19424c-a13c-4d86-83c0-0b3edfa178e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:32.563710 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19424c-a13c-4d86-83c0-0b3edfa178e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:32.575504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19424c-a13c-4d86-83c0-0b3edfa178e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:24:32.581113 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23cd712-05ae-4071-bedb-8697e0a624f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:32.582608 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23cd712-05ae-4071-bedb-8697e0a624f6 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:32.585266 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-ce19424c-a13c-4d86-83c0-0b3edfa178e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 17:24:32.585266 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:32.585266 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:32.585266 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:32.585266 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:32.585266 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:32.585266 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:32.585266 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:32.585266 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:32.585266 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:32.585266 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:32.585266 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:32.585266 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:24:32.585266 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:24:32.585266 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:24:32.585266 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:24:32.586787 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:24:32.586787 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:24:32.586787 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:24:32.586787 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:24:32.586787 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:32.586787 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:32.586787 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:32.586787 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:32.586787 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:32.586787 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:32.586787 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:32.586787 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:32.586787 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:32.586787 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:32.586787 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:32.586787 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:32.587735 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:32.587735 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:32.587735 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:32.587735 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:32.587735 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:24:32.587735 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:24:32.587735 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:24:32.587735 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:24:32.587735 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:24:32.587735 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:24:32.587735 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 17:24:32.587735 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:32.590507 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 271/557] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Jul 15 17:24:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:32.591600 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19424c-a13c-4d86-83c0-0b3edfa178e0 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:32.602287 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:32.700556 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:32.704980 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19424c-a13c-4d86-83c0-0b3edfa178e0 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:32.710831 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 287/558] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:24:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 17:24:32.710831 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23cd712-05ae-4071-bedb-8697e0a624f6 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:32.747427 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec4c86-8717-4b0f-b2f6-9b778159c100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:32.748128 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec4c86-8717-4b0f-b2f6-9b778159c100 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:32.748412 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec4c86-8717-4b0f-b2f6-9b778159c100 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:32.748684 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec4c86-8717-4b0f-b2f6-9b778159c100 None admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:32.749411 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec4c86-8717-4b0f-b2f6-9b778159c100 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:32.749713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec4c86-8717-4b0f-b2f6-9b778159c100 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:32.751126 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec4c86-8717-4b0f-b2f6-9b778159c100 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:32.762919 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 272/559] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:32.763859 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec4c86-8717-4b0f-b2f6-9b778159c100 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:32.815155 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23cd712-05ae-4071-bedb-8697e0a624f6 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:32.833515 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:32.851807 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303164ce-78f9-4ec0-91c6-b25f7578d746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:32.852485 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303164ce-78f9-4ec0-91c6-b25f7578d746 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:32.852854 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303164ce-78f9-4ec0-91c6-b25f7578d746 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:32.853091 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303164ce-78f9-4ec0-91c6-b25f7578d746 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:32.853806 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303164ce-78f9-4ec0-91c6-b25f7578d746 None admin] RBAC: Adding query filter params (name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:32.854120 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303164ce-78f9-4ec0-91c6-b25f7578d746 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:32.855491 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303164ce-78f9-4ec0-91c6-b25f7578d746 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:32.864046 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 288/560] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Jul 15 17:24:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:32.865760 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa3f84-a4eb-48c7-b4bb-602b99aee922 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:32.866338 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa3f84-a4eb-48c7-b4bb-602b99aee922 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:32.866812 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa3f84-a4eb-48c7-b4bb-602b99aee922 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:32.868282 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 289/561] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:32.869474 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa3f84-a4eb-48c7-b4bb-602b99aee922 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:32.879133 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec4c86-8717-4b0f-b2f6-9b778159c100 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:32.916565 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7393c0-a718-42f5-a422-5231770d27ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:32.917369 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7393c0-a718-42f5-a422-5231770d27ff None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:32.917651 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7393c0-a718-42f5-a422-5231770d27ff None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:32.917962 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7393c0-a718-42f5-a422-5231770d27ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:32.929260 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7393c0-a718-42f5-a422-5231770d27ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:32.930761 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7393c0-a718-42f5-a422-5231770d27ff None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:32.931912 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:32.952290 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-8a7393c0-a718-42f5-a422-5231770d27ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:32.952290 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:32.952290 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:32.952290 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:32.952290 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:32.952290 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:32.952290 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:32.952290 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:32.952290 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:32.952290 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:32.952290 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:32.952290 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:32.952290 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:32.952290 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:32.952290 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:32.953240 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:32.953240 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:32.953240 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:32.953240 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:32.953240 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:32.953240 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:32.953240 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:32.953240 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:32.953240 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:32.953240 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:32.953240 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:32.953240 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:32.953240 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:32.953240 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:32.953240 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:32.953240 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:32.953240 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:32.954231 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:32.954231 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:32.954231 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:32.954231 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:32.954231 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 273/562] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:32.954519 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7393c0-a718-42f5-a422-5231770d27ff None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:32.977814 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa3f84-a4eb-48c7-b4bb-602b99aee922 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:33.010904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a160fbf0-6d33-48ed-84f4-2053a0b8d4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:33.011694 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160fbf0-6d33-48ed-84f4-2053a0b8d4a3 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:33.011973 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160fbf0-6d33-48ed-84f4-2053a0b8d4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:33.012242 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160fbf0-6d33-48ed-84f4-2053a0b8d4a3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:33.019794 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a160fbf0-6d33-48ed-84f4-2053a0b8d4a3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:33.021233 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a160fbf0-6d33-48ed-84f4-2053a0b8d4a3 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:33.035677 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-a160fbf0-6d33-48ed-84f4-2053a0b8d4a3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 17:24:33.035677 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:33.035677 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:33.035677 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:33.035677 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:33.035677 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:33.035677 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:33.035677 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:33.035677 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:33.035677 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:33.035677 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:33.035677 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:33.035677 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 17:24:33.035677 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 17:24:33.035677 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 17:24:33.035677 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 17:24:33.036812 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:33.036812 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:33.036812 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 17:24:33.036812 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:24:33.036812 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 17:24:33.036812 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:24:33.036812 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:33.036812 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:33.036812 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:33.036812 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:33.036812 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:33.036812 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:33.036812 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:33.036812 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:33.036812 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:33.036812 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:33.036812 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:33.036812 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:33.038171 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:33.038171 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:33.038171 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 17:24:33.038171 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 17:24:33.038171 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 17:24:33.038171 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 17:24:33.038171 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 17:24:33.038171 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 17:24:33.038171 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 17:24:33.038171 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:33.038171 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 290/563] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Jul 15 17:24:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:33.038916 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba908b65-909b-4cee-9646-19ff3cde3df5 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:33.038916 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba908b65-909b-4cee-9646-19ff3cde3df5 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:33.038916 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba908b65-909b-4cee-9646-19ff3cde3df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:33.055721 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-ba908b65-909b-4cee-9646-19ff3cde3df5 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:33.057043 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ba908b65-909b-4cee-9646-19ff3cde3df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:33.060036 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7393c0-a718-42f5-a422-5231770d27ff None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:33.078043 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:33.096108 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07758739-077c-4ff2-88f6-481979134eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:33.096901 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07758739-077c-4ff2-88f6-481979134eda None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:33.097187 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07758739-077c-4ff2-88f6-481979134eda None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:33.097464 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07758739-077c-4ff2-88f6-481979134eda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:33.107504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07758739-077c-4ff2-88f6-481979134eda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:33.108958 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07758739-077c-4ff2-88f6-481979134eda None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:33.127956 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-07758739-077c-4ff2-88f6-481979134eda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:33.127956 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:33.127956 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:33.127956 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:33.127956 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:33.127956 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:33.127956 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:33.127956 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:33.127956 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:33.127956 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:33.127956 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:33.127956 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:33.127956 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:33.127956 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:33.127956 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:33.128843 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:33.128843 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:33.128843 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:33.128843 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:33.128843 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:33.128843 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:33.128843 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:33.128843 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:33.128843 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:33.128843 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:33.128843 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:33.128843 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:33.128843 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:33.128843 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:33.128843 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:33.128843 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:33.128843 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:33.129729 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:33.129729 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:33.129729 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:33.129729 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:33.129983 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 291/564] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:24:33.130399 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 274/565] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:33.130399 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07758739-077c-4ff2-88f6-481979134eda None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:33.133641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49f3dc-ecb1-4c57-9798-030b26047d41 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:33.134040 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49f3dc-ecb1-4c57-9798-030b26047d41 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:33.134250 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49f3dc-ecb1-4c57-9798-030b26047d41 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:33.135704 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 292/566] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:33.136237 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49f3dc-ecb1-4c57-9798-030b26047d41 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:33.193698 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:33.239440 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07758739-077c-4ff2-88f6-481979134eda None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:33.246906 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49f3dc-ecb1-4c57-9798-030b26047d41 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:33.272201 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e4d8d-a711-409f-88b1-01862e6b739d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:33.272876 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e4d8d-a711-409f-88b1-01862e6b739d None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:33.273148 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e4d8d-a711-409f-88b1-01862e6b739d None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:33.273423 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e4d8d-a711-409f-88b1-01862e6b739d None admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:33.274174 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1e4d8d-a711-409f-88b1-01862e6b739d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:33.274477 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1e4d8d-a711-409f-88b1-01862e6b739d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:33.275861 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1e4d8d-a711-409f-88b1-01862e6b739d None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:33.281284 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e19a0-9035-4a27-b240-184e8ff0451c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:33.281987 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e19a0-9035-4a27-b240-184e8ff0451c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:33.282262 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e19a0-9035-4a27-b240-184e8ff0451c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:33.282530 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e19a0-9035-4a27-b240-184e8ff0451c None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:33.283354 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e19a0-9035-4a27-b240-184e8ff0451c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:33.283655 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e19a0-9035-4a27-b240-184e8ff0451c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:33.285097 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e19a0-9035-4a27-b240-184e8ff0451c None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:33.287148 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 275/567] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:33.287925 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e4d8d-a711-409f-88b1-01862e6b739d None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:33.307996 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 293/568] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Jul 15 17:24:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:33.309506 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4af6c9-cd70-41d5-bb5e-254cf976969d None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:33.309817 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4af6c9-cd70-41d5-bb5e-254cf976969d None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:33.310106 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4af6c9-cd70-41d5-bb5e-254cf976969d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:33.324837 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:33.327291 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-5a4af6c9-cd70-41d5-bb5e-254cf976969d None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:33.328497 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5a4af6c9-cd70-41d5-bb5e-254cf976969d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:33.395847 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e4d8d-a711-409f-88b1-01862e6b739d None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:33.396963 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 294/569] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:24:33.397820 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4af6c9-cd70-41d5-bb5e-254cf976969d None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:33.431934 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b447a-1773-4294-b3ca-df0010c3e53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:33.431934 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b447a-1773-4294-b3ca-df0010c3e53f None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:33.432234 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b447a-1773-4294-b3ca-df0010c3e53f None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:33.432468 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b447a-1773-4294-b3ca-df0010c3e53f None admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:33.433191 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b447a-1773-4294-b3ca-df0010c3e53f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:33.433492 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b447a-1773-4294-b3ca-df0010c3e53f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:33.434915 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b447a-1773-4294-b3ca-df0010c3e53f None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:33.436633 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:33.446724 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 276/570] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:33.447509 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b447a-1773-4294-b3ca-df0010c3e53f None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:33.497809 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4af6c9-cd70-41d5-bb5e-254cf976969d None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:33.533151 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457f2a9-0a1a-4c57-a336-355fac346c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:33.534000 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457f2a9-0a1a-4c57-a336-355fac346c68 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:33.534285 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457f2a9-0a1a-4c57-a336-355fac346c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:33.534564 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457f2a9-0a1a-4c57-a336-355fac346c68 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:33.536596 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:33.546356 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f457f2a9-0a1a-4c57-a336-355fac346c68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:24:33.546713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b447a-1773-4294-b3ca-df0010c3e53f None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:33.554385 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-f457f2a9-0a1a-4c57-a336-355fac346c68 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 17:24:33.554385 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:33.554385 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:33.554385 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:33.554385 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:33.554385 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:33.554385 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:33.554385 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:33.554385 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:33.554385 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:33.554385 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:33.554385 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:33.554385 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:24:33.554385 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:24:33.554385 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:24:33.554385 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:24:33.555309 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:24:33.555309 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:24:33.555309 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:24:33.555309 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:24:33.555309 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:33.555309 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:33.555309 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:33.555309 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:33.555309 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:33.555309 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:33.555309 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:33.555309 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:33.555309 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:33.555309 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:33.555309 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:33.555309 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:33.556150 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:33.556150 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:33.556150 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:33.556150 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:33.556150 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:24:33.556150 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:24:33.556150 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:24:33.556150 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:24:33.556150 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:24:33.556150 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:24:33.556150 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 17:24:33.556150 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:33.556150 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 295/571] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Jul 15 17:24:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:33.556858 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457f2a9-0a1a-4c57-a336-355fac346c68 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:33.581421 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d39bf4-cbfb-4e70-8a9f-ff33139ae397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:33.582259 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d39bf4-cbfb-4e70-8a9f-ff33139ae397 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:33.582543 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d39bf4-cbfb-4e70-8a9f-ff33139ae397 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:33.582821 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d39bf4-cbfb-4e70-8a9f-ff33139ae397 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:33.589611 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d39bf4-cbfb-4e70-8a9f-ff33139ae397 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:33.591090 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d39bf4-cbfb-4e70-8a9f-ff33139ae397 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:33.604797 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-e5d39bf4-cbfb-4e70-8a9f-ff33139ae397 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:24:33.604797 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:33.604797 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:33.604797 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:33.604797 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:33.604797 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:33.604797 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:33.604797 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:33.604797 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:33.604797 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:33.604797 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:33.604797 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:33.604797 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 17:24:33.604797 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 17:24:33.604797 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 17:24:33.605911 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 17:24:33.605911 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:33.605911 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:33.605911 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:33.605911 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:33.605911 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:33.605911 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:33.605911 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:33.605911 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:33.605911 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:33.605911 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:33.605911 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:33.605911 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:33.605911 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:33.605911 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:33.605911 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:33.605911 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:33.607088 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 17:24:33.607088 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 17:24:33.607088 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 17:24:33.607088 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 17:24:33.607088 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 17:24:33.607088 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 17:24:33.607088 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:24:33.607088 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:33.607088 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 277/572] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:24:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:33.607088 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d39bf4-cbfb-4e70-8a9f-ff33139ae397 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:33.661052 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:33.665162 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457f2a9-0a1a-4c57-a336-355fac346c68 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:33.700254 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38b4a9-78c3-4d5e-9a2b-5d7f8e85b224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:33.701158 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38b4a9-78c3-4d5e-9a2b-5d7f8e85b224 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:33.701995 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38b4a9-78c3-4d5e-9a2b-5d7f8e85b224 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:33.702282 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38b4a9-78c3-4d5e-9a2b-5d7f8e85b224 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:33.706810 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d39bf4-cbfb-4e70-8a9f-ff33139ae397 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:33.713109 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d38b4a9-78c3-4d5e-9a2b-5d7f8e85b224 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:33.714588 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d38b4a9-78c3-4d5e-9a2b-5d7f8e85b224 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:33.731846 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-3d38b4a9-78c3-4d5e-9a2b-5d7f8e85b224 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:33.731846 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:33.731846 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:33.731846 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:33.731846 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:33.731846 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:33.731846 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:33.731846 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:33.731846 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:33.731846 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:33.731846 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:33.731846 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:33.731846 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:33.731846 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:33.731846 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:33.732947 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:33.732947 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:33.732947 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:33.732947 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:33.732947 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:33.732947 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:33.732947 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:33.732947 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:33.732947 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:33.732947 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:33.732947 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:33.732947 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:33.732947 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:33.732947 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:33.732947 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:33.732947 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:33.732947 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:33.734176 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:33.734176 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:33.734176 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:33.734176 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:33.734176 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 296/573] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:33.734475 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38b4a9-78c3-4d5e-9a2b-5d7f8e85b224 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:33.743839 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae758c-8068-4349-ad5f-6a37c6f8d0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:33.744652 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae758c-8068-4349-ad5f-6a37c6f8d0b7 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:33.744939 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae758c-8068-4349-ad5f-6a37c6f8d0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:33.745212 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae758c-8068-4349-ad5f-6a37c6f8d0b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:33.755977 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ae758c-8068-4349-ad5f-6a37c6f8d0b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:24:33.763798 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-97ae758c-8068-4349-ad5f-6a37c6f8d0b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 17:24:33.763798 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:33.763798 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:33.763798 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:33.763798 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:33.763798 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:33.763798 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:33.763798 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:33.763798 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:33.763798 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:33.763798 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:33.763798 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:33.763798 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:24:33.763798 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:24:33.763798 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:24:33.763798 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:24:33.764812 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:24:33.764812 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:24:33.764812 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:24:33.764812 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:24:33.764812 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:33.764812 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:33.764812 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:33.764812 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:33.764812 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:33.764812 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:33.764812 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:33.764812 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:33.764812 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:33.764812 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:33.764812 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:33.764812 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:33.765654 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:33.765654 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:33.765654 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:33.765654 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:33.765654 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:24:33.765654 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:24:33.765654 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:24:33.765654 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:24:33.765654 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:24:33.765654 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:24:33.765654 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 17:24:33.765654 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:33.766335 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 278/574] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Jul 15 17:24:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:33.767214 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae758c-8068-4349-ad5f-6a37c6f8d0b7 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:33.780796 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:33.835208 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38b4a9-78c3-4d5e-9a2b-5d7f8e85b224 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:33.868152 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89c20a-7cb3-4743-910c-b9b9c5da433f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:33.868932 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89c20a-7cb3-4743-910c-b9b9c5da433f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:33.869211 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89c20a-7cb3-4743-910c-b9b9c5da433f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:33.869477 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89c20a-7cb3-4743-910c-b9b9c5da433f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:33.870754 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae758c-8068-4349-ad5f-6a37c6f8d0b7 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:33.876795 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d89c20a-7cb3-4743-910c-b9b9c5da433f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:33.878270 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d89c20a-7cb3-4743-910c-b9b9c5da433f None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:33.892370 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-5d89c20a-7cb3-4743-910c-b9b9c5da433f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 15 17:24:33.892370 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:33.892370 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:33.892370 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:33.892370 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:33.892370 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:33.892370 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:33.892370 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:33.892370 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:33.892370 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:33.892370 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:33.892370 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:33.892370 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 17:24:33.892370 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 17:24:33.892370 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 17:24:33.892370 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 17:24:33.893454 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:33.893454 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:33.893454 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 17:24:33.893454 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:24:33.893454 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 17:24:33.893454 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:24:33.893454 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:33.893454 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:33.893454 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:33.893454 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:33.893454 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:33.893454 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:33.893454 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:33.893454 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:33.893454 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:33.893454 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:33.893454 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:33.893454 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:33.899281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:33.899281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:33.899281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 17:24:33.899281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 17:24:33.899281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 17:24:33.899281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 17:24:33.899281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 17:24:33.899281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 17:24:33.899281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 15 17:24:33.899281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:33.899281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 297/575] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:24:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:33.899281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89c20a-7cb3-4743-910c-b9b9c5da433f None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:33.904898 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56434ef-e08b-4596-a57b-532c64ff582e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:33.905572 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56434ef-e08b-4596-a57b-532c64ff582e None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:33.905875 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56434ef-e08b-4596-a57b-532c64ff582e None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:33.906150 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56434ef-e08b-4596-a57b-532c64ff582e None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:33.906894 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56434ef-e08b-4596-a57b-532c64ff582e None admin] RBAC: Adding query filter params (name=service) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:33.907198 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56434ef-e08b-4596-a57b-532c64ff582e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:33.908571 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56434ef-e08b-4596-a57b-532c64ff582e None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:33.911036 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:33.917012 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 279/576] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Jul 15 17:24:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:33.917830 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56434ef-e08b-4596-a57b-532c64ff582e None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:33.990572 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:34.001374 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89c20a-7cb3-4743-910c-b9b9c5da433f None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:34.020174 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56434ef-e08b-4596-a57b-532c64ff582e None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:34.036459 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7a6bfb-38d9-4124-a651-c25b64d86054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:34.037119 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a6bfb-38d9-4124-a651-c25b64d86054 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:34.037401 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a6bfb-38d9-4124-a651-c25b64d86054 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:34.037678 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a6bfb-38d9-4124-a651-c25b64d86054 None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:34.038513 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7a6bfb-38d9-4124-a651-c25b64d86054 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:34.038820 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7a6bfb-38d9-4124-a651-c25b64d86054 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:34.040252 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7a6bfb-38d9-4124-a651-c25b64d86054 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:34.052786 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 298/577] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jul 15 17:24:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:34.053611 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7a6bfb-38d9-4124-a651-c25b64d86054 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:34.054381 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93157e1a-0078-45bc-b48c-fab18a801bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:34.055077 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93157e1a-0078-45bc-b48c-fab18a801bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:34.055356 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93157e1a-0078-45bc-b48c-fab18a801bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:34.055625 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93157e1a-0078-45bc-b48c-fab18a801bc3 None admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:34.056366 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93157e1a-0078-45bc-b48c-fab18a801bc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:34.056667 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93157e1a-0078-45bc-b48c-fab18a801bc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:34.058127 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93157e1a-0078-45bc-b48c-fab18a801bc3 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:34.070329 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 280/578] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:34.071112 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93157e1a-0078-45bc-b48c-fab18a801bc3 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:34.122054 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:34.151876 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7a6bfb-38d9-4124-a651-c25b64d86054 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:34.170395 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93157e1a-0078-45bc-b48c-fab18a801bc3 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:34.186847 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c573b8-c1af-4b4f-bd23-467a0e82e92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:34.187467 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c573b8-c1af-4b4f-bd23-467a0e82e92c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:34.187748 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c573b8-c1af-4b4f-bd23-467a0e82e92c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:34.188004 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c573b8-c1af-4b4f-bd23-467a0e82e92c None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:34.188743 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c573b8-c1af-4b4f-bd23-467a0e82e92c None admin] RBAC: Adding query filter params (name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:34.189043 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c573b8-c1af-4b4f-bd23-467a0e82e92c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:34.190440 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c573b8-c1af-4b4f-bd23-467a0e82e92c None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:34.198286 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 299/579] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Jul 15 17:24:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:34.198475 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:34.199135 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c573b8-c1af-4b4f-bd23-467a0e82e92c None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:34.207251 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba009d-08c0-4d5a-ab0c-dba3014997b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:34.207929 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba009d-08c0-4d5a-ab0c-dba3014997b8 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:34.208208 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba009d-08c0-4d5a-ab0c-dba3014997b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:34.208478 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba009d-08c0-4d5a-ab0c-dba3014997b8 None admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:34.209311 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ba009d-08c0-4d5a-ab0c-dba3014997b8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:34.209614 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ba009d-08c0-4d5a-ab0c-dba3014997b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:34.211045 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ba009d-08c0-4d5a-ab0c-dba3014997b8 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:34.227970 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 281/580] 10.222.0.27 () {56 vars in 1137 bytes} [Fri Jul 15 17:24:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:34.228744 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba009d-08c0-4d5a-ab0c-dba3014997b8 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:34.300558 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c573b8-c1af-4b4f-bd23-467a0e82e92c None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:34.332541 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:34.333820 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba009d-08c0-4d5a-ab0c-dba3014997b8 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:34.338307 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5672c-5256-4c71-8158-e38d5b87eac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:34.339110 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5672c-5256-4c71-8158-e38d5b87eac3 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:34.339393 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5672c-5256-4c71-8158-e38d5b87eac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:34.339667 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5672c-5256-4c71-8158-e38d5b87eac3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:34.350576 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5672c-5256-4c71-8158-e38d5b87eac3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:34.352045 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5672c-5256-4c71-8158-e38d5b87eac3 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:34.367596 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac90ab8-5fa5-448b-9edf-9b3359e24d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:34.368245 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac90ab8-5fa5-448b-9edf-9b3359e24d23 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:34.368523 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac90ab8-5fa5-448b-9edf-9b3359e24d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:34.368794 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac90ab8-5fa5-448b-9edf-9b3359e24d23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:34.369094 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-1ad5672c-5256-4c71-8158-e38d5b87eac3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:34.369094 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:34.369094 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:34.369094 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:34.369094 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:34.369094 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:34.369094 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:34.369094 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:34.369094 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:34.369094 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:34.369094 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:34.369094 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:34.369094 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:34.369094 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:34.369094 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:34.370227 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:34.370227 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:34.370227 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:34.370227 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:34.370227 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:34.370227 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:34.370227 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:34.370227 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:34.370227 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:34.370227 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:34.370227 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:34.370227 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:34.370227 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:34.370227 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:34.370227 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:34.370227 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:34.370227 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:34.371337 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:34.371337 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:34.371337 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:34.371337 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:34.371602 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac90ab8-5fa5-448b-9edf-9b3359e24d23 None admin] RBAC: Adding query filter params (role.id=1a453be279744db09ef4e2fcf580beac, scope.project.id=19cc5221b8074f48b5f73dc9c4289b03, user.id=9dea565b75784465a8ea073883261d7b) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:34.371602 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac90ab8-5fa5-448b-9edf-9b3359e24d23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:34.371602 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac90ab8-5fa5-448b-9edf-9b3359e24d23 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:34.374890 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 300/581] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:34.375752 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5672c-5256-4c71-8158-e38d5b87eac3 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:34.378208 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 282/582] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jul 15 17:24:34 2022] GET /identity/v3/role_assignments?user.id=9dea565b75784465a8ea073883261d7b&scope.project.id=19cc5221b8074f48b5f73dc9c4289b03&role.id=1a453be279744db09ef4e2fcf580beac => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:34.378904 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac90ab8-5fa5-448b-9edf-9b3359e24d23 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:34.440542 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:34.491095 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac90ab8-5fa5-448b-9edf-9b3359e24d23 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:34.494297 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5672c-5256-4c71-8158-e38d5b87eac3 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:34.528596 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e02009-9319-403c-b435-b12f04cb61f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:34.530211 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e02009-9319-403c-b435-b12f04cb61f7 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:34.530523 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e02009-9319-403c-b435-b12f04cb61f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:34.530798 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e02009-9319-403c-b435-b12f04cb61f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:34.535918 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84543b23-3920-4be3-8ece-c347e00fccb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:34.536943 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84543b23-3920-4be3-8ece-c347e00fccb6 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:34.537230 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84543b23-3920-4be3-8ece-c347e00fccb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:34.537507 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84543b23-3920-4be3-8ece-c347e00fccb6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:34.541828 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e02009-9319-403c-b435-b12f04cb61f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:34.543277 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e02009-9319-403c-b435-b12f04cb61f7 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:34.545600 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84543b23-3920-4be3-8ece-c347e00fccb6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:34.547419 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84543b23-3920-4be3-8ece-c347e00fccb6 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:34.562277 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-10e02009-9319-403c-b435-b12f04cb61f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:34.562277 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:34.562277 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:34.562277 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:34.562277 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:34.562277 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:34.562277 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:34.562277 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:34.562277 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:34.562277 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:34.562277 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:34.562277 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:34.562277 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:34.562277 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:34.562277 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:34.563145 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:34.563145 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:34.563145 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:34.563145 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:34.563145 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:34.563145 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:34.563145 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:34.563145 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:34.563145 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:34.563145 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:34.563145 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:34.563145 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:34.563145 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:34.563145 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:34.563145 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:34.563145 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:34.563145 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:34.564022 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:34.564022 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:34.564022 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:34.564022 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:34.564022 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 283/583] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:34.564709 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e02009-9319-403c-b435-b12f04cb61f7 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:34.566197 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-84543b23-3920-4be3-8ece-c347e00fccb6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:24:34.566197 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:34.566197 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:34.566197 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:34.566197 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:34.566197 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:34.566197 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:34.566197 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:34.566197 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:34.566197 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:34.566197 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:34.566197 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:34.566197 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 17:24:34.566197 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 17:24:34.566197 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 17:24:34.567036 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 17:24:34.567036 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:34.567036 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:34.567036 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:34.567036 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:34.567036 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:34.567036 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:34.567036 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:34.567036 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:34.567036 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:34.567036 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:34.567036 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:34.567036 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:34.567036 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:34.567036 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:34.567036 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:34.567036 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:34.567904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 17:24:34.567904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 17:24:34.567904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 17:24:34.567904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 17:24:34.567904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 17:24:34.567904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 17:24:34.567904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:24:34.567904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:34.570037 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 301/584] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:24:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:34.571022 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84543b23-3920-4be3-8ece-c347e00fccb6 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:34.627701 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:34.669645 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e02009-9319-403c-b435-b12f04cb61f7 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:34.678437 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:34.686413 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84543b23-3920-4be3-8ece-c347e00fccb6 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:34.714423 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f89dc-bb73-4817-b345-d510105c436d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:34.715534 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f89dc-bb73-4817-b345-d510105c436d None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:34.715818 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f89dc-bb73-4817-b345-d510105c436d None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:34.716087 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f89dc-bb73-4817-b345-d510105c436d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:34.722808 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678b556-f3ea-4111-a09a-df040a3a2182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:34.723882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678b556-f3ea-4111-a09a-df040a3a2182 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:34.724164 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678b556-f3ea-4111-a09a-df040a3a2182 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:34.724434 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678b556-f3ea-4111-a09a-df040a3a2182 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:34.725536 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0678b556-f3ea-4111-a09a-df040a3a2182 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:34.725866 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0678b556-f3ea-4111-a09a-df040a3a2182 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:34.726926 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f89dc-bb73-4817-b345-d510105c436d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:34.727375 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0678b556-f3ea-4111-a09a-df040a3a2182 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:34.728352 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f89dc-bb73-4817-b345-d510105c436d None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:34.743754 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 302/585] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:34.743754 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678b556-f3ea-4111-a09a-df040a3a2182 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:34.746236 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-9d6f89dc-bb73-4817-b345-d510105c436d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:34.746236 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:34.746236 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:34.746236 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:34.746236 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:34.746236 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:34.746236 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:34.746236 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:34.746236 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:34.746236 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:34.746236 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:34.746236 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:34.746236 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:34.746236 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:34.746236 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:34.747137 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:34.747137 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:34.747137 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:34.747137 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:34.747137 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:34.747137 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:34.747137 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:34.747137 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:34.747137 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:34.747137 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:34.747137 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:34.747137 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:34.747137 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:34.747137 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:34.747137 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:34.747137 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:34.747137 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:34.748722 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:34.748722 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:34.748722 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:34.748722 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:34.748722 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 284/586] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:34.748722 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f89dc-bb73-4817-b345-d510105c436d None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:34.853370 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f89dc-bb73-4817-b345-d510105c436d None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:34.854352 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678b556-f3ea-4111-a09a-df040a3a2182 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:34.857584 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:34.888395 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c717267-d031-49a2-b2e5-cc4bac590b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:34.889270 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c717267-d031-49a2-b2e5-cc4bac590b6f None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:34.889594 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c717267-d031-49a2-b2e5-cc4bac590b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:34.889837 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c717267-d031-49a2-b2e5-cc4bac590b6f None admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:34.890724 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c717267-d031-49a2-b2e5-cc4bac590b6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:34.891176 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c717267-d031-49a2-b2e5-cc4bac590b6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:34.891982 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bf18b-2fdc-4fb2-920b-27d3814618c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:34.892646 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bf18b-2fdc-4fb2-920b-27d3814618c9 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:34.892739 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c717267-d031-49a2-b2e5-cc4bac590b6f None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:34.892918 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bf18b-2fdc-4fb2-920b-27d3814618c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:34.893187 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bf18b-2fdc-4fb2-920b-27d3814618c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:34.893961 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37bf18b-2fdc-4fb2-920b-27d3814618c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:34.894262 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37bf18b-2fdc-4fb2-920b-27d3814618c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:34.895600 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37bf18b-2fdc-4fb2-920b-27d3814618c9 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:34.911357 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 303/587] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:34.911357 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bf18b-2fdc-4fb2-920b-27d3814618c9 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:34.911641 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 285/588] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jul 15 17:24:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:34.911641 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c717267-d031-49a2-b2e5-cc4bac590b6f None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:34.931298 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:35.010199 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bf18b-2fdc-4fb2-920b-27d3814618c9 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:35.016708 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c717267-d031-49a2-b2e5-cc4bac590b6f None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:35.044117 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c5808-b369-4472-acbb-d4012c5aec07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:35.045027 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c5808-b369-4472-acbb-d4012c5aec07 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:35.045354 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c5808-b369-4472-acbb-d4012c5aec07 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:35.045737 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c5808-b369-4472-acbb-d4012c5aec07 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:35.053295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5c1e8-5c12-4c95-a0c6-2ad80f045096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:35.054095 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5c1e8-5c12-4c95-a0c6-2ad80f045096 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:35.054340 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207c5808-b369-4472-acbb-d4012c5aec07 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:35.054445 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5c1e8-5c12-4c95-a0c6-2ad80f045096 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:35.054612 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5c1e8-5c12-4c95-a0c6-2ad80f045096 None admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:35.055347 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec5c1e8-5c12-4c95-a0c6-2ad80f045096 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:35.055642 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec5c1e8-5c12-4c95-a0c6-2ad80f045096 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:35.055831 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207c5808-b369-4472-acbb-d4012c5aec07 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:35.056983 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec5c1e8-5c12-4c95-a0c6-2ad80f045096 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:35.069498 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 286/589] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:35.070643 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-207c5808-b369-4472-acbb-d4012c5aec07 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 17:24:35.070643 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:35.070643 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:35.070643 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:35.070643 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:35.070643 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:35.070643 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:35.070643 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:35.070643 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:35.070643 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:35.070643 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:35.070643 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:35.070643 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 17:24:35.070643 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 17:24:35.070643 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 17:24:35.070643 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 17:24:35.071850 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:35.071850 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:35.071850 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 17:24:35.071850 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:24:35.071850 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 17:24:35.071850 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:24:35.071850 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:35.071850 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:35.071850 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:35.071850 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:35.071850 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:35.071850 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:35.071850 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:35.071850 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:35.071850 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:35.071850 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:35.071850 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:35.071850 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:35.072784 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:35.072784 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:35.072784 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 17:24:35.072784 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 17:24:35.072784 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 17:24:35.072784 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 17:24:35.072784 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 17:24:35.072784 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 17:24:35.072784 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 17:24:35.072784 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:35.074725 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5c1e8-5c12-4c95-a0c6-2ad80f045096 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:35.076514 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 304/590] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:24:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:35.077257 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c5808-b369-4472-acbb-d4012c5aec07 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:35.102593 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:35.158820 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:35.180169 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c5808-b369-4472-acbb-d4012c5aec07 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:35.181294 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5c1e8-5c12-4c95-a0c6-2ad80f045096 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:35.214249 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a418c-e709-4ba5-9ba2-089c7a3f84a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:35.215043 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a418c-e709-4ba5-9ba2-089c7a3f84a5 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:35.215322 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a418c-e709-4ba5-9ba2-089c7a3f84a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:35.215589 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a418c-e709-4ba5-9ba2-089c7a3f84a5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:35.218312 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf142f-d4f9-47e2-ace3-1131a26676a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:35.219205 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf142f-d4f9-47e2-ace3-1131a26676a6 None admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:35.219487 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf142f-d4f9-47e2-ace3-1131a26676a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:35.219754 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf142f-d4f9-47e2-ace3-1131a26676a6 None admin] PATH_INFO: `/v3/projects/19cc5221b8074f48b5f73dc9c4289b03/users/f9d548c8199e4fdbbce7597bebd63421/roles/1a453be279744db09ef4e2fcf580beac` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:35.223073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a418c-e709-4ba5-9ba2-089c7a3f84a5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:35.224498 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a418c-e709-4ba5-9ba2-089c7a3f84a5 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:35.235058 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaf142f-d4f9-47e2-ace3-1131a26676a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=19cc5221b8074f48b5f73dc9c4289b03, user_id=f9d548c8199e4fdbbce7597bebd63421, role_id=1a453be279744db09ef4e2fcf580beac)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:35.236786 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaf142f-d4f9-47e2-ace3-1131a26676a6 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:35.239348 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-d50a418c-e709-4ba5-9ba2-089c7a3f84a5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 17:24:35.239348 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:35.239348 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:35.239348 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:35.239348 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:35.239348 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:35.239348 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:35.239348 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:35.239348 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:35.239348 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:35.239348 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:35.239348 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:35.239348 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 17:24:35.239348 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 17:24:35.239348 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 17:24:35.239348 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 17:24:35.240274 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:35.240274 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:35.240274 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 17:24:35.240274 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:24:35.240274 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 17:24:35.240274 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:24:35.240274 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:35.240274 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:35.240274 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:35.240274 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:35.240274 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:35.240274 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:35.240274 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:35.240274 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:35.240274 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:35.240274 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:35.240274 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:35.240274 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:35.241195 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:35.241195 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:35.241195 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 17:24:35.241195 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 17:24:35.241195 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 17:24:35.241195 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 17:24:35.241195 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 17:24:35.241195 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 17:24:35.241195 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 17:24:35.241195 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:35.241195 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 305/591] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Jul 15 17:24:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:35.241769 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a418c-e709-4ba5-9ba2-089c7a3f84a5 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:35.255929 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 287/592] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Jul 15 17:24:35 2022] PUT /identity/v3/projects/19cc5221b8074f48b5f73dc9c4289b03/users/f9d548c8199e4fdbbce7597bebd63421/roles/1a453be279744db09ef4e2fcf580beac => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:24:35.257204 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf142f-d4f9-47e2-ace3-1131a26676a6 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:35.371164 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:35.387764 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf142f-d4f9-47e2-ace3-1131a26676a6 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:35.396092 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a418c-e709-4ba5-9ba2-089c7a3f84a5 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:35.420509 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:35.434201 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397207d9-5d6c-480d-80e0-08b9b39193cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:35.434892 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397207d9-5d6c-480d-80e0-08b9b39193cf None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:35.435172 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397207d9-5d6c-480d-80e0-08b9b39193cf None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:35.435582 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397207d9-5d6c-480d-80e0-08b9b39193cf None admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:35.436637 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397207d9-5d6c-480d-80e0-08b9b39193cf None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:35.436947 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397207d9-5d6c-480d-80e0-08b9b39193cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:35.438889 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397207d9-5d6c-480d-80e0-08b9b39193cf None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:35.450490 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac035da-a165-4e0b-8b06-094e8fdcf47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:35.452820 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac035da-a165-4e0b-8b06-094e8fdcf47f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:35.452820 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac035da-a165-4e0b-8b06-094e8fdcf47f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:35.452820 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac035da-a165-4e0b-8b06-094e8fdcf47f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:35.462190 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac035da-a165-4e0b-8b06-094e8fdcf47f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:35.463394 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 288/593] 10.222.0.27 () {56 vars in 1137 bytes} [Fri Jul 15 17:24:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:35.463760 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac035da-a165-4e0b-8b06-094e8fdcf47f None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:35.464058 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397207d9-5d6c-480d-80e0-08b9b39193cf None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:35.479855 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-0ac035da-a165-4e0b-8b06-094e8fdcf47f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:24:35.479855 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:35.479855 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:35.479855 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:35.479855 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:35.479855 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:35.479855 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:35.479855 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:35.479855 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:35.479855 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:35.479855 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:35.479855 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:35.479855 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 17:24:35.479855 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 17:24:35.479855 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 17:24:35.480790 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 17:24:35.480790 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:35.480790 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:35.480790 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:35.480790 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:35.480790 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:35.480790 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:35.480790 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:35.480790 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:35.480790 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:35.480790 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:35.480790 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:35.480790 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:35.480790 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:35.480790 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:35.480790 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:35.480790 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:35.481676 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 17:24:35.481676 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 17:24:35.481676 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 17:24:35.481676 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 17:24:35.481676 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 17:24:35.481676 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 17:24:35.481676 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:24:35.481676 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:35.481676 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 306/594] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:24:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:35.482255 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac035da-a165-4e0b-8b06-094e8fdcf47f None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:35.588692 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397207d9-5d6c-480d-80e0-08b9b39193cf None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:35.621372 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac035da-a165-4e0b-8b06-094e8fdcf47f None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:35.624306 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f6764-fd8b-4424-b9c2-c0ed10ce369b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:35.625407 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f6764-fd8b-4424-b9c2-c0ed10ce369b None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:35.625407 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f6764-fd8b-4424-b9c2-c0ed10ce369b None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:35.625578 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f6764-fd8b-4424-b9c2-c0ed10ce369b None admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:35.626410 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6f6764-fd8b-4424-b9c2-c0ed10ce369b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:35.626719 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6f6764-fd8b-4424-b9c2-c0ed10ce369b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:35.628140 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6f6764-fd8b-4424-b9c2-c0ed10ce369b None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:35.650976 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 289/595] 10.222.0.27 () {56 vars in 1139 bytes} [Fri Jul 15 17:24:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:35.652355 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f6764-fd8b-4424-b9c2-c0ed10ce369b None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:35.661867 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170fe24-eea1-452f-823f-fb3be64c3431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:35.662755 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170fe24-eea1-452f-823f-fb3be64c3431 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:35.663098 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170fe24-eea1-452f-823f-fb3be64c3431 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:35.663437 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170fe24-eea1-452f-823f-fb3be64c3431 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:35.674511 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9170fe24-eea1-452f-823f-fb3be64c3431 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:35.675976 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9170fe24-eea1-452f-823f-fb3be64c3431 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:35.679006 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:35.699693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-9170fe24-eea1-452f-823f-fb3be64c3431 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:35.699693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:35.699693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:35.699693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:35.699693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:35.699693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:35.699693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:35.699693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:35.699693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:35.699693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:35.699693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:35.699693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:35.699693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:35.699693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:35.699693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:35.700632 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:35.700632 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:35.700632 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:35.700632 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:35.700632 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:35.700632 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:35.700632 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:35.700632 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:35.700632 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:35.700632 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:35.700632 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:35.700632 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:35.700632 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:35.700632 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:35.700632 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:35.700632 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:35.700632 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:35.701658 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:35.701658 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:35.701658 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:35.701658 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:35.710456 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 307/596] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:35.711605 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170fe24-eea1-452f-823f-fb3be64c3431 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:35.713416 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:35.783667 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f6764-fd8b-4424-b9c2-c0ed10ce369b None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:35.824937 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba4f78-55c1-499f-9007-ec74263a9dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:35.825701 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba4f78-55c1-499f-9007-ec74263a9dcf None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:35.826147 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba4f78-55c1-499f-9007-ec74263a9dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:35.826489 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba4f78-55c1-499f-9007-ec74263a9dcf None admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:35.827938 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba4f78-55c1-499f-9007-ec74263a9dcf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:35.828528 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba4f78-55c1-499f-9007-ec74263a9dcf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:35.830963 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba4f78-55c1-499f-9007-ec74263a9dcf None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:35.840721 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170fe24-eea1-452f-823f-fb3be64c3431 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:35.849940 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 290/597] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jul 15 17:24:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:35.850802 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba4f78-55c1-499f-9007-ec74263a9dcf None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:35.885713 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff3e64-6e9e-4282-80ed-d97fed1d4891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:35.886561 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff3e64-6e9e-4282-80ed-d97fed1d4891 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:35.886987 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff3e64-6e9e-4282-80ed-d97fed1d4891 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:35.887263 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff3e64-6e9e-4282-80ed-d97fed1d4891 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:35.900809 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff3e64-6e9e-4282-80ed-d97fed1d4891 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:35.902695 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff3e64-6e9e-4282-80ed-d97fed1d4891 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:35.924966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-4dff3e64-6e9e-4282-80ed-d97fed1d4891 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:35.924966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:35.924966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:35.924966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:35.924966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:35.924966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:35.924966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:35.924966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:35.924966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:35.924966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:35.924966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:35.924966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:35.924966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:35.924966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:35.924966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:35.926129 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:35.926129 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:35.926129 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:35.926129 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:35.926129 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:35.926129 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:35.926129 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:35.926129 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:35.926129 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:35.926129 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:35.926129 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:35.926129 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:35.926129 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:35.926129 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:35.926129 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:35.926129 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:35.926129 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:35.927646 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:35.927646 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:35.927646 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:35.927646 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:35.930367 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 308/598] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:35.931483 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff3e64-6e9e-4282-80ed-d97fed1d4891 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:35.978130 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba4f78-55c1-499f-9007-ec74263a9dcf None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:35.980621 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:35.992890 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:36.023057 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8a772-75de-4440-bb75-930b09a90ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:36.024153 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8a772-75de-4440-bb75-930b09a90ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:36.024676 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8a772-75de-4440-bb75-930b09a90ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:36.025539 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8a772-75de-4440-bb75-930b09a90ed6 None admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:36.026502 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f8a772-75de-4440-bb75-930b09a90ed6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:36.027325 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f8a772-75de-4440-bb75-930b09a90ed6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:36.029676 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f8a772-75de-4440-bb75-930b09a90ed6 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:36.050498 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 291/599] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:36.052110 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8a772-75de-4440-bb75-930b09a90ed6 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:36.056465 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff3e64-6e9e-4282-80ed-d97fed1d4891 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:36.099557 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0aed6-d75d-416b-b2c6-c58b849856eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:36.101044 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0aed6-d75d-416b-b2c6-c58b849856eb None admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:36.101569 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0aed6-d75d-416b-b2c6-c58b849856eb None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:36.102061 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0aed6-d75d-416b-b2c6-c58b849856eb None admin] PATH_INFO: `/v3/projects/19cc5221b8074f48b5f73dc9c4289b03/users/14775984c9d4463a8e8848dcf189714b/roles/1a453be279744db09ef4e2fcf580beac` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:36.118269 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc0aed6-d75d-416b-b2c6-c58b849856eb None admin] RBAC: Authorizing `identity:create_grant(project_id=19cc5221b8074f48b5f73dc9c4289b03, user_id=14775984c9d4463a8e8848dcf189714b, role_id=1a453be279744db09ef4e2fcf580beac)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:36.120195 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc0aed6-d75d-416b-b2c6-c58b849856eb None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:36.145942 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 309/600] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Jul 15 17:24:35 2022] PUT /identity/v3/projects/19cc5221b8074f48b5f73dc9c4289b03/users/14775984c9d4463a8e8848dcf189714b/roles/1a453be279744db09ef4e2fcf580beac => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:24:36.145942 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0aed6-d75d-416b-b2c6-c58b849856eb None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:36.206848 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8a772-75de-4440-bb75-930b09a90ed6 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:36.282497 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e72b82-243f-4fb8-8a44-fc0b80a5d81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:36.283178 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e72b82-243f-4fb8-8a44-fc0b80a5d81e None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:36.283454 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e72b82-243f-4fb8-8a44-fc0b80a5d81e None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:36.283723 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e72b82-243f-4fb8-8a44-fc0b80a5d81e None admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:36.284466 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e72b82-243f-4fb8-8a44-fc0b80a5d81e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:36.284752 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e72b82-243f-4fb8-8a44-fc0b80a5d81e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:36.291083 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e72b82-243f-4fb8-8a44-fc0b80a5d81e None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:36.321743 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 292/601] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:36.323126 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e72b82-243f-4fb8-8a44-fc0b80a5d81e None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:36.351677 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:36.364878 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:36.370987 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0aed6-d75d-416b-b2c6-c58b849856eb None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:36.426653 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6e940-224a-4858-8e99-dc1ffc7e1b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:36.427466 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6e940-224a-4858-8e99-dc1ffc7e1b33 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:36.428270 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6e940-224a-4858-8e99-dc1ffc7e1b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:36.428565 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6e940-224a-4858-8e99-dc1ffc7e1b33 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:36.435874 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a6e940-224a-4858-8e99-dc1ffc7e1b33 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:36.437444 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a6e940-224a-4858-8e99-dc1ffc7e1b33 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:36.449153 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e72b82-243f-4fb8-8a44-fc0b80a5d81e None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:36.451678 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-82a6e940-224a-4858-8e99-dc1ffc7e1b33 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:24:36.451678 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:36.451678 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:36.451678 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:36.451678 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:36.451678 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:36.451678 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:36.451678 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:36.451678 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:36.451678 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:36.451678 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:36.451678 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:36.451678 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 17:24:36.451678 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 17:24:36.451678 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 17:24:36.452539 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 17:24:36.452539 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:36.452539 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:36.452539 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:36.452539 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:36.452539 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:36.452539 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:36.452539 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:36.452539 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:36.452539 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:36.452539 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:36.452539 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:36.452539 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:36.452539 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:36.452539 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:36.452539 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:36.452539 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:36.453392 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 17:24:36.453392 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 17:24:36.453392 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 17:24:36.453392 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 17:24:36.453392 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 17:24:36.453392 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 17:24:36.453392 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:24:36.453392 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:36.453392 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 310/602] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:24:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:36.455217 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd37b67-802a-4fb4-b50f-17e505ca1e45 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:36.455217 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd37b67-802a-4fb4-b50f-17e505ca1e45 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:36.455217 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd37b67-802a-4fb4-b50f-17e505ca1e45 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:36.457035 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 311/603] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:36.462498 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93284bd9-c466-4dc8-9f65-9d9b68bd43fa None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:36.462777 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93284bd9-c466-4dc8-9f65-9d9b68bd43fa None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:36.463059 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93284bd9-c466-4dc8-9f65-9d9b68bd43fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:36.481422 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-93284bd9-c466-4dc8-9f65-9d9b68bd43fa None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:36.482781 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-93284bd9-c466-4dc8-9f65-9d9b68bd43fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:36.500020 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1320859-ef0d-444d-a035-62e3e8f25248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:36.501731 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1320859-ef0d-444d-a035-62e3e8f25248 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:36.502218 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1320859-ef0d-444d-a035-62e3e8f25248 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:36.502699 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1320859-ef0d-444d-a035-62e3e8f25248 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:36.512866 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1320859-ef0d-444d-a035-62e3e8f25248 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:36.515461 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1320859-ef0d-444d-a035-62e3e8f25248 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:36.534305 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-d1320859-ef0d-444d-a035-62e3e8f25248 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:24:36.534305 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:36.534305 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:36.534305 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:36.534305 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:36.534305 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:36.534305 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:36.534305 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:36.534305 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:36.534305 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:36.534305 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:36.534305 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:36.534305 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 17:24:36.534305 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 17:24:36.534305 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 17:24:36.535225 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 17:24:36.535225 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:36.535225 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:36.535225 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:36.535225 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:36.535225 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:36.535225 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:36.535225 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:36.535225 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:36.535225 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:36.535225 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:36.535225 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:36.535225 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:36.535225 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:36.535225 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:36.535225 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:36.535225 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:36.536080 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 17:24:36.536080 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 17:24:36.536080 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 17:24:36.536080 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 17:24:36.536080 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 17:24:36.536080 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 17:24:36.536080 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:24:36.536080 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:36.538357 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 293/604] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:24:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 17:24:36.541960 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1320859-ef0d-444d-a035-62e3e8f25248 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:36.564606 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 312/605] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:24:36.565910 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93284bd9-c466-4dc8-9f65-9d9b68bd43fa None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:36.649739 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:36.666999 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1320859-ef0d-444d-a035-62e3e8f25248 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:36.684251 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:36.702074 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93284bd9-c466-4dc8-9f65-9d9b68bd43fa None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:36.709180 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe6640-df75-4e5d-a585-d1ce3a32d0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:36.710145 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe6640-df75-4e5d-a585-d1ce3a32d0cf None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:36.710621 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe6640-df75-4e5d-a585-d1ce3a32d0cf None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:36.711085 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe6640-df75-4e5d-a585-d1ce3a32d0cf None admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:36.712479 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe6640-df75-4e5d-a585-d1ce3a32d0cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:36.712999 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe6640-df75-4e5d-a585-d1ce3a32d0cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:36.715335 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe6640-df75-4e5d-a585-d1ce3a32d0cf None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:36.731070 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 294/606] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jul 15 17:24:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:36.732706 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe6640-df75-4e5d-a585-d1ce3a32d0cf None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:36.743322 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a21c4-c2fb-41e8-8dd8-7fe380166995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:36.744720 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a21c4-c2fb-41e8-8dd8-7fe380166995 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:36.745196 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a21c4-c2fb-41e8-8dd8-7fe380166995 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:36.746019 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a21c4-c2fb-41e8-8dd8-7fe380166995 None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:36.747078 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a21c4-c2fb-41e8-8dd8-7fe380166995 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:36.747900 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a21c4-c2fb-41e8-8dd8-7fe380166995 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:36.749840 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a21c4-c2fb-41e8-8dd8-7fe380166995 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:36.769804 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 313/607] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jul 15 17:24:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:36.769804 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a21c4-c2fb-41e8-8dd8-7fe380166995 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:36.851919 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe6640-df75-4e5d-a585-d1ce3a32d0cf None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:36.884410 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a21c4-c2fb-41e8-8dd8-7fe380166995 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:36.894014 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771cfbd-9aeb-47ec-a4c2-9725a5ca8be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:36.895397 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771cfbd-9aeb-47ec-a4c2-9725a5ca8be8 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:36.896155 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771cfbd-9aeb-47ec-a4c2-9725a5ca8be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:36.896606 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771cfbd-9aeb-47ec-a4c2-9725a5ca8be8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:36.910058 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9771cfbd-9aeb-47ec-a4c2-9725a5ca8be8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:24:36.920291 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c23ec-88b0-44d7-892b-153e1e85219a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:36.920669 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-9771cfbd-9aeb-47ec-a4c2-9725a5ca8be8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 17:24:36.920669 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:36.920669 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:36.920669 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:36.920669 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:36.920669 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:36.920669 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:36.920669 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:36.920669 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:36.920669 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:36.920669 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:36.920669 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:36.920669 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:24:36.920669 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:24:36.920669 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:24:36.920669 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:24:36.921572 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:24:36.921572 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:24:36.921572 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:24:36.921572 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:24:36.921572 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:36.921572 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:36.921572 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:36.921572 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:36.921572 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:36.921572 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:36.921572 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:36.921572 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:36.921572 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:36.921572 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:36.921572 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:36.921572 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:36.922531 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:36.922531 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:36.922531 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:36.922531 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:36.922531 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:24:36.922531 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:24:36.922531 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:24:36.922531 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:24:36.922531 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:24:36.922531 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:24:36.922531 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 17:24:36.922531 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:36.923164 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c23ec-88b0-44d7-892b-153e1e85219a None admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:36.923164 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c23ec-88b0-44d7-892b-153e1e85219a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:36.923164 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c23ec-88b0-44d7-892b-153e1e85219a None admin] PATH_INFO: `/v3/projects/19cc5221b8074f48b5f73dc9c4289b03/users/94b8121d0b0d4eef818b2a8b3508df18/roles/1a453be279744db09ef4e2fcf580beac` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:36.925327 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 295/608] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Jul 15 17:24:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:36.926281 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771cfbd-9aeb-47ec-a4c2-9725a5ca8be8 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:36.930691 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:36.946601 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4c23ec-88b0-44d7-892b-153e1e85219a None admin] RBAC: Authorizing `identity:create_grant(project_id=19cc5221b8074f48b5f73dc9c4289b03, user_id=94b8121d0b0d4eef818b2a8b3508df18, role_id=1a453be279744db09ef4e2fcf580beac)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:36.948575 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4c23ec-88b0-44d7-892b-153e1e85219a None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:36.963070 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:36.972145 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 314/609] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Jul 15 17:24:36 2022] PUT /identity/v3/projects/19cc5221b8074f48b5f73dc9c4289b03/users/94b8121d0b0d4eef818b2a8b3508df18/roles/1a453be279744db09ef4e2fcf580beac => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:24:36.973459 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c23ec-88b0-44d7-892b-153e1e85219a None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:37.049229 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771cfbd-9aeb-47ec-a4c2-9725a5ca8be8 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:37.091346 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762fcf9b-ae3f-4d74-b0a6-18479aca23a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:37.092456 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762fcf9b-ae3f-4d74-b0a6-18479aca23a6 None admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:37.092703 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762fcf9b-ae3f-4d74-b0a6-18479aca23a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:37.092976 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762fcf9b-ae3f-4d74-b0a6-18479aca23a6 None admin] PATH_INFO: `/v3/projects/19cc5221b8074f48b5f73dc9c4289b03/users/989272e5e803405d87d0833d503bb572/roles/1a453be279744db09ef4e2fcf580beac` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:37.109849 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762fcf9b-ae3f-4d74-b0a6-18479aca23a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=19cc5221b8074f48b5f73dc9c4289b03, user_id=989272e5e803405d87d0833d503bb572, role_id=1a453be279744db09ef4e2fcf580beac)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:37.111232 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762fcf9b-ae3f-4d74-b0a6-18479aca23a6 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:37.117614 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c23ec-88b0-44d7-892b-153e1e85219a None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:37.128234 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 296/610] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Jul 15 17:24:36 2022] PUT /identity/v3/projects/19cc5221b8074f48b5f73dc9c4289b03/users/989272e5e803405d87d0833d503bb572/roles/1a453be279744db09ef4e2fcf580beac => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:24:37.160450 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032815f-b6a9-4da2-a788-852eea73b5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:37.161448 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032815f-b6a9-4da2-a788-852eea73b5fc None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:37.161968 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032815f-b6a9-4da2-a788-852eea73b5fc None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:37.162406 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032815f-b6a9-4da2-a788-852eea73b5fc None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:37.163336 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032815f-b6a9-4da2-a788-852eea73b5fc None admin] RBAC: Adding query filter params (name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:37.163808 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032815f-b6a9-4da2-a788-852eea73b5fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:37.165550 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032815f-b6a9-4da2-a788-852eea73b5fc None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:37.176524 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 315/611] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Jul 15 17:24:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:37.183048 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762fcf9b-ae3f-4d74-b0a6-18479aca23a6 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:37.254440 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:37.315354 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762fcf9b-ae3f-4d74-b0a6-18479aca23a6 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:37.355534 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68375fe4-4d8e-4803-8923-4a0c4ac4a256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:37.356350 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68375fe4-4d8e-4803-8923-4a0c4ac4a256 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:37.356634 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68375fe4-4d8e-4803-8923-4a0c4ac4a256 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:37.356897 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68375fe4-4d8e-4803-8923-4a0c4ac4a256 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:37.367747 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68375fe4-4d8e-4803-8923-4a0c4ac4a256 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:37.369197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68375fe4-4d8e-4803-8923-4a0c4ac4a256 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:37.389256 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-68375fe4-4d8e-4803-8923-4a0c4ac4a256 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:37.389256 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:37.389256 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:37.389256 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:37.389256 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:37.389256 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:37.389256 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:37.389256 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:37.389256 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:37.389256 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:37.389256 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:37.389256 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:37.389256 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:37.389256 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:37.389256 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:37.390252 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:37.390252 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:37.390252 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:37.390252 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:37.390252 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:37.390252 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:37.390252 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:37.390252 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:37.390252 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:37.390252 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:37.390252 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:37.390252 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:37.390252 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:37.390252 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:37.390252 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:37.390252 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:37.390252 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:37.391299 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:37.391299 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:37.391299 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:37.391299 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:37.391299 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 297/612] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:37.399080 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032815f-b6a9-4da2-a788-852eea73b5fc None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:37.442962 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafa36c-5008-4137-ad4e-007c8f3375eb None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:37.443282 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafa36c-5008-4137-ad4e-007c8f3375eb None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:37.443514 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafa36c-5008-4137-ad4e-007c8f3375eb None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:37.445189 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 298/613] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:37.450736 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d00e5c-1fed-4657-9315-2d52d16999e5 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:37.451252 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d00e5c-1fed-4657-9315-2d52d16999e5 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:37.451517 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d00e5c-1fed-4657-9315-2d52d16999e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:37.465545 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:37.471260 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-f6d00e5c-1fed-4657-9315-2d52d16999e5 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:37.472776 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-f6d00e5c-1fed-4657-9315-2d52d16999e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:37.525592 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032815f-b6a9-4da2-a788-852eea73b5fc None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:37.549912 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 299/614] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 17:24:37.574052 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d00e5c-1fed-4657-9315-2d52d16999e5 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:37.592440 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6edb1ff-8aa2-4f01-8b9d-1840486c727e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:37.594845 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edb1ff-8aa2-4f01-8b9d-1840486c727e None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:37.595341 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edb1ff-8aa2-4f01-8b9d-1840486c727e None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:37.596477 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edb1ff-8aa2-4f01-8b9d-1840486c727e None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:37.597401 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6edb1ff-8aa2-4f01-8b9d-1840486c727e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:37.598119 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6edb1ff-8aa2-4f01-8b9d-1840486c727e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:37.601209 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6edb1ff-8aa2-4f01-8b9d-1840486c727e None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:37.624617 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 316/615] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:37.629249 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6edb1ff-8aa2-4f01-8b9d-1840486c727e None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:37.635934 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:37.751759 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d00e5c-1fed-4657-9315-2d52d16999e5 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:37.804092 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6edb1ff-8aa2-4f01-8b9d-1840486c727e None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:37.828674 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:37.830814 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8c724-e19a-41ec-982f-1b9838e67c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:37.831713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8c724-e19a-41ec-982f-1b9838e67c30 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:37.832001 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8c724-e19a-41ec-982f-1b9838e67c30 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:37.832280 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8c724-e19a-41ec-982f-1b9838e67c30 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:37.844637 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e84d7b-29f6-4ece-bb87-52d73252e2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:37.845688 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e84d7b-29f6-4ece-bb87-52d73252e2bc None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:37.846133 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e84d7b-29f6-4ece-bb87-52d73252e2bc None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:37.846543 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e84d7b-29f6-4ece-bb87-52d73252e2bc None admin] PATH_INFO: `/v3/users/swift` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:37.853690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca8c724-e19a-41ec-982f-1b9838e67c30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:24:37.854831 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e84d7b-29f6-4ece-bb87-52d73252e2bc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:37.856488 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e84d7b-29f6-4ece-bb87-52d73252e2bc None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:37.861807 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-9ca8c724-e19a-41ec-982f-1b9838e67c30 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 17:24:37.861807 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:37.861807 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:37.861807 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:37.861807 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:37.861807 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:37.861807 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:37.861807 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:37.861807 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:37.861807 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:37.861807 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:37.861807 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:37.861807 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:24:37.861807 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:24:37.861807 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:24:37.861807 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:24:37.862727 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:24:37.862727 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:24:37.862727 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:24:37.862727 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:24:37.862727 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:37.862727 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:37.862727 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:37.862727 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:37.862727 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:37.862727 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:37.862727 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:37.862727 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:37.862727 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:37.862727 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:37.862727 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:37.862727 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:37.863967 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:37.863967 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:37.863967 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:37.863967 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:37.863967 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:24:37.863967 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:24:37.863967 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:24:37.863967 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:24:37.863967 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:24:37.863967 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:24:37.863967 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 17:24:37.863967 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:37.863967 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 300/616] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Jul 15 17:24:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 17:24:37.869093 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8c724-e19a-41ec-982f-1b9838e67c30 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:37.876430 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-d7e84d7b-29f6-4ece-bb87-52d73252e2bc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 15 17:24:37.876430 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:37.876430 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:37.876430 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:37.876430 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:37.876430 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:37.876430 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:37.876430 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:37.876430 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:37.876430 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:37.876430 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:37.876430 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:37.876430 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 17:24:37.876430 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 17:24:37.876430 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 17:24:37.876430 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 17:24:37.877364 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:37.877364 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:37.877364 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 17:24:37.877364 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:24:37.877364 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 17:24:37.877364 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:24:37.877364 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:37.877364 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:37.877364 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:37.877364 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:37.877364 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:37.877364 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:37.877364 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:37.877364 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:37.877364 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:37.877364 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:37.877364 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:37.877364 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:37.878340 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:37.878340 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:37.878340 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 17:24:37.878340 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 17:24:37.878340 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 17:24:37.878340 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 17:24:37.878340 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 17:24:37.878340 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 17:24:37.878340 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 15 17:24:37.878340 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:37.885316 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 317/617] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jul 15 17:24:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:37.886662 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e84d7b-29f6-4ece-bb87-52d73252e2bc None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:37.992155 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:37.998172 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8c724-e19a-41ec-982f-1b9838e67c30 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:38.035595 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58f206-b914-4191-bdb5-e631aca1a0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:38.036376 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58f206-b914-4191-bdb5-e631aca1a0df None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:38.036727 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58f206-b914-4191-bdb5-e631aca1a0df None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:38.037067 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58f206-b914-4191-bdb5-e631aca1a0df None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:38.037926 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c58f206-b914-4191-bdb5-e631aca1a0df None admin] RBAC: Adding query filter params (name=service) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:38.038302 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c58f206-b914-4191-bdb5-e631aca1a0df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:38.039772 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c58f206-b914-4191-bdb5-e631aca1a0df None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:38.049163 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 301/618] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Jul 15 17:24:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:38.054665 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58f206-b914-4191-bdb5-e631aca1a0df None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:38.055088 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e84d7b-29f6-4ece-bb87-52d73252e2bc None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:38.142014 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe57d33-29a5-459f-afde-14646424a2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:38.142693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe57d33-29a5-459f-afde-14646424a2f2 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:38.142971 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe57d33-29a5-459f-afde-14646424a2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:38.143241 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe57d33-29a5-459f-afde-14646424a2f2 None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:38.144084 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe57d33-29a5-459f-afde-14646424a2f2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:38.144384 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe57d33-29a5-459f-afde-14646424a2f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:38.153900 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe57d33-29a5-459f-afde-14646424a2f2 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:38.172875 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58f206-b914-4191-bdb5-e631aca1a0df None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:38.188819 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 318/619] 10.222.0.27 () {56 vars in 1135 bytes} [Fri Jul 15 17:24:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:38.194168 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe57d33-29a5-459f-afde-14646424a2f2 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:38.215115 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661fc0f0-bb4d-4f7d-af1b-92374bd0603d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:38.216171 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fc0f0-bb4d-4f7d-af1b-92374bd0603d None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:38.216701 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fc0f0-bb4d-4f7d-af1b-92374bd0603d None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:38.217667 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fc0f0-bb4d-4f7d-af1b-92374bd0603d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:38.238150 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661fc0f0-bb4d-4f7d-af1b-92374bd0603d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:38.240762 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661fc0f0-bb4d-4f7d-af1b-92374bd0603d None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:38.274506 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:38.275248 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-661fc0f0-bb4d-4f7d-af1b-92374bd0603d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:38.275248 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:38.275248 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:38.275248 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:38.275248 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:38.275248 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:38.275248 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:38.275248 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:38.275248 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:38.275248 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:38.275248 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:38.275248 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:38.275248 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:38.275248 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:38.275248 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:38.276489 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:38.276489 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:38.276489 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:38.276489 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:38.276489 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:38.276489 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:38.276489 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:38.276489 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:38.276489 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:38.276489 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:38.276489 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:38.276489 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:38.276489 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:38.276489 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:38.276489 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:38.276489 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:38.276489 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:38.277621 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:38.277621 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:38.277621 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:38.277621 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:38.282231 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 302/620] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:38.287666 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661fc0f0-bb4d-4f7d-af1b-92374bd0603d None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:38.313109 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:38.405554 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe57d33-29a5-459f-afde-14646424a2f2 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:38.464411 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661fc0f0-bb4d-4f7d-af1b-92374bd0603d None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:38.471042 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982033c3-d59d-4d60-ab7e-4e2cf3e456b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:38.472282 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982033c3-d59d-4d60-ab7e-4e2cf3e456b1 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:38.472759 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982033c3-d59d-4d60-ab7e-4e2cf3e456b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:38.472981 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982033c3-d59d-4d60-ab7e-4e2cf3e456b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:38.483749 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982033c3-d59d-4d60-ab7e-4e2cf3e456b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:38.485226 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982033c3-d59d-4d60-ab7e-4e2cf3e456b1 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:38.511826 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-982033c3-d59d-4d60-ab7e-4e2cf3e456b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:38.511826 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:38.511826 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:38.511826 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:38.511826 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:38.511826 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:38.511826 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:38.511826 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:38.511826 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:38.511826 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:38.511826 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:38.511826 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:38.511826 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:38.511826 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:38.511826 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:38.512776 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:38.512776 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:38.512776 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:38.512776 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:38.512776 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:38.512776 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:38.512776 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:38.512776 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:38.512776 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:38.512776 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:38.512776 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:38.512776 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:38.512776 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:38.512776 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:38.512776 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:38.512776 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:38.512776 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:38.514596 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:38.514596 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:38.514596 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:38.514596 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:38.517795 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 319/621] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 17:24:38.518740 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde405d-b8df-4d9d-a505-a5302861141a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:38.519351 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982033c3-d59d-4d60-ab7e-4e2cf3e456b1 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:38.519883 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde405d-b8df-4d9d-a505-a5302861141a None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:38.520375 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde405d-b8df-4d9d-a505-a5302861141a None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:38.520875 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde405d-b8df-4d9d-a505-a5302861141a None admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:38.521872 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcde405d-b8df-4d9d-a505-a5302861141a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:38.522388 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcde405d-b8df-4d9d-a505-a5302861141a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:38.524013 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcde405d-b8df-4d9d-a505-a5302861141a None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:38.562417 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 303/622] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:24:38.568115 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde405d-b8df-4d9d-a505-a5302861141a None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:38.633912 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:38.643923 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982033c3-d59d-4d60-ab7e-4e2cf3e456b1 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:38.658147 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:38.679414 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67124e6d-2de8-4209-8ec8-70c6b3101afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:38.680083 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67124e6d-2de8-4209-8ec8-70c6b3101afe None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:38.680360 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67124e6d-2de8-4209-8ec8-70c6b3101afe None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:38.680630 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67124e6d-2de8-4209-8ec8-70c6b3101afe None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:38.681347 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67124e6d-2de8-4209-8ec8-70c6b3101afe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:38.681644 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67124e6d-2de8-4209-8ec8-70c6b3101afe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:38.683040 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67124e6d-2de8-4209-8ec8-70c6b3101afe None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:38.694757 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde405d-b8df-4d9d-a505-a5302861141a None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:38.697967 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 320/623] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:38.699233 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78911a1d-ebd1-4baf-9ff1-fe045ba5d042 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:38.699522 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78911a1d-ebd1-4baf-9ff1-fe045ba5d042 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:38.699795 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78911a1d-ebd1-4baf-9ff1-fe045ba5d042 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:38.703409 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 321/624] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:38.704130 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78911a1d-ebd1-4baf-9ff1-fe045ba5d042 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:38.733673 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052f0b4-abab-4c7a-bcf4-bdf2982684d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:38.735000 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052f0b4-abab-4c7a-bcf4-bdf2982684d5 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:38.735551 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052f0b4-abab-4c7a-bcf4-bdf2982684d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:38.736058 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052f0b4-abab-4c7a-bcf4-bdf2982684d5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:38.744338 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9052f0b4-abab-4c7a-bcf4-bdf2982684d5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:38.746093 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9052f0b4-abab-4c7a-bcf4-bdf2982684d5 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:38.761640 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-9052f0b4-abab-4c7a-bcf4-bdf2982684d5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 17:24:38.761640 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:38.761640 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:38.761640 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:38.761640 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:38.761640 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:38.761640 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:38.761640 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:38.761640 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:38.761640 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:38.761640 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:38.761640 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:38.761640 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 17:24:38.761640 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 17:24:38.761640 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 17:24:38.761640 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 17:24:38.762633 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:38.762633 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:38.762633 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 17:24:38.762633 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:24:38.762633 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 17:24:38.762633 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:24:38.762633 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:38.762633 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:38.762633 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:38.762633 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:38.762633 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:38.762633 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:38.762633 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:38.762633 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:38.762633 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:38.762633 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:38.762633 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:38.762633 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:38.764276 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:38.764276 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:38.764276 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 17:24:38.764276 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 17:24:38.764276 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 17:24:38.764276 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 17:24:38.764276 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 17:24:38.764276 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 17:24:38.764276 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 17:24:38.764276 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:38.766961 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 304/625] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Jul 15 17:24:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 17:24:38.768352 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9f211-78ab-4c89-b923-7a715e5b8202 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:38.768834 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9f211-78ab-4c89-b923-7a715e5b8202 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:38.769383 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9f211-78ab-4c89-b923-7a715e5b8202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:38.786955 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-8cd9f211-78ab-4c89-b923-7a715e5b8202 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:38.788508 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-8cd9f211-78ab-4c89-b923-7a715e5b8202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:38.804812 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78911a1d-ebd1-4baf-9ff1-fe045ba5d042 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:38.838650 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d14918-571a-4abc-9700-2a689dfa9c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:38.839373 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d14918-571a-4abc-9700-2a689dfa9c3e None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:38.839649 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d14918-571a-4abc-9700-2a689dfa9c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:38.839920 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d14918-571a-4abc-9700-2a689dfa9c3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:38.848642 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d14918-571a-4abc-9700-2a689dfa9c3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:38.850103 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d14918-571a-4abc-9700-2a689dfa9c3e None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:38.864111 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-49d14918-571a-4abc-9700-2a689dfa9c3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:24:38.864111 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:38.864111 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:38.864111 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:38.864111 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:38.864111 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:38.864111 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:38.864111 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:38.864111 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:38.864111 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:38.864111 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:38.864111 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:38.864111 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 17:24:38.864111 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 17:24:38.864111 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 17:24:38.865029 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 17:24:38.865029 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:38.865029 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:38.865029 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:38.865029 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:38.865029 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:38.865029 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:38.865029 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:38.865029 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:38.865029 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:38.865029 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:38.865029 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:38.865029 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:38.865029 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:38.865029 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:38.865029 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:38.865029 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:38.865953 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 17:24:38.865953 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 17:24:38.865953 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 17:24:38.865953 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 17:24:38.865953 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 17:24:38.865953 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 17:24:38.865953 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:24:38.865953 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:38.867292 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 305/627] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:24:38.868729 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9f211-78ab-4c89-b923-7a715e5b8202 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:38.870209 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 322/627] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:24:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 17:24:38.871511 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d14918-571a-4abc-9700-2a689dfa9c3e None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:38.883954 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:38.950483 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:38.978826 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d14918-571a-4abc-9700-2a689dfa9c3e None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:39.007748 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9f211-78ab-4c89-b923-7a715e5b8202 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:39.014158 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e0f94-136e-481d-9ffa-914d1535ab92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:39.014588 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e0f94-136e-481d-9ffa-914d1535ab92 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:39.014868 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e0f94-136e-481d-9ffa-914d1535ab92 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:39.015141 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e0f94-136e-481d-9ffa-914d1535ab92 None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:39.015926 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17e0f94-136e-481d-9ffa-914d1535ab92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:39.016226 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17e0f94-136e-481d-9ffa-914d1535ab92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:39.017660 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17e0f94-136e-481d-9ffa-914d1535ab92 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:39.034990 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 323/628] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jul 15 17:24:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:24:39.035902 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e0f94-136e-481d-9ffa-914d1535ab92 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:39.049231 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2c535-0145-4c02-b79c-d9b3cbd68564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:39.050299 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2c535-0145-4c02-b79c-d9b3cbd68564 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:39.050943 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2c535-0145-4c02-b79c-d9b3cbd68564 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:39.051514 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2c535-0145-4c02-b79c-d9b3cbd68564 None admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:39.052549 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2c535-0145-4c02-b79c-d9b3cbd68564 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:39.053051 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2c535-0145-4c02-b79c-d9b3cbd68564 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:39.055126 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2c535-0145-4c02-b79c-d9b3cbd68564 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:39.077388 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 306/629] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Jul 15 17:24:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:39.078644 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2c535-0145-4c02-b79c-d9b3cbd68564 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:39.109188 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:39.140581 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e0f94-136e-481d-9ffa-914d1535ab92 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:39.175702 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c14f3a-03a3-4a49-b425-7d57be4b08cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:39.176505 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c14f3a-03a3-4a49-b425-7d57be4b08cf None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:39.176784 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c14f3a-03a3-4a49-b425-7d57be4b08cf None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:39.177053 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c14f3a-03a3-4a49-b425-7d57be4b08cf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:39.187849 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c14f3a-03a3-4a49-b425-7d57be4b08cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:24:39.195027 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2c535-0145-4c02-b79c-d9b3cbd68564 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:39.195738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-40c14f3a-03a3-4a49-b425-7d57be4b08cf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 17:24:39.195738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:39.195738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:39.195738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:39.195738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:39.195738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:39.195738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:39.195738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:39.195738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:39.195738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:39.195738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:39.195738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:39.195738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:24:39.195738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:24:39.195738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:24:39.195738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:24:39.196641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:24:39.196641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:24:39.196641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:24:39.196641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:24:39.196641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:39.196641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:39.196641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:39.196641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:39.196641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:39.196641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:39.196641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:39.196641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:39.196641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:39.196641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:39.196641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:39.196641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:39.197487 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:39.197487 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:39.197487 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:39.197487 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:39.197487 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:24:39.197487 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:24:39.197487 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:24:39.197487 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:24:39.197487 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:24:39.197487 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:24:39.197487 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 17:24:39.197487 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:39.197487 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 324/630] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Jul 15 17:24:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:39.198773 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c14f3a-03a3-4a49-b425-7d57be4b08cf None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:39.219076 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:39.240104 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a798e9c0-eb20-455d-8120-bef4b6599abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:39.241492 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798e9c0-eb20-455d-8120-bef4b6599abc None admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:39.242014 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798e9c0-eb20-455d-8120-bef4b6599abc None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:39.242507 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798e9c0-eb20-455d-8120-bef4b6599abc None admin] PATH_INFO: `/v3/projects/19cc5221b8074f48b5f73dc9c4289b03/users/9dea565b75784465a8ea073883261d7b/roles/1a453be279744db09ef4e2fcf580beac` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:39.266346 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a798e9c0-eb20-455d-8120-bef4b6599abc None admin] RBAC: Authorizing `identity:create_grant(project_id=19cc5221b8074f48b5f73dc9c4289b03, user_id=9dea565b75784465a8ea073883261d7b, role_id=1a453be279744db09ef4e2fcf580beac)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:39.269073 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a798e9c0-eb20-455d-8120-bef4b6599abc None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:39.290480 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 307/631] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Jul 15 17:24:39 2022] PUT /identity/v3/projects/19cc5221b8074f48b5f73dc9c4289b03/users/9dea565b75784465a8ea073883261d7b/roles/1a453be279744db09ef4e2fcf580beac => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:24:39.291803 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a798e9c0-eb20-455d-8120-bef4b6599abc None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:39.323768 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c14f3a-03a3-4a49-b425-7d57be4b08cf None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:39.381774 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:39.391877 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722756a3-3b40-402a-9ef4-9fa014b983cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:39.392852 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722756a3-3b40-402a-9ef4-9fa014b983cc None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:39.393269 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722756a3-3b40-402a-9ef4-9fa014b983cc None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:39.393731 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722756a3-3b40-402a-9ef4-9fa014b983cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:39.492541 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a798e9c0-eb20-455d-8120-bef4b6599abc None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:39.516319 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722756a3-3b40-402a-9ef4-9fa014b983cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:39.517823 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722756a3-3b40-402a-9ef4-9fa014b983cc None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:39.550974 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4f3f9-24bb-4141-b5b0-69fd5b4da115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:39.551908 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4f3f9-24bb-4141-b5b0-69fd5b4da115 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:39.552180 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4f3f9-24bb-4141-b5b0-69fd5b4da115 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:39.552453 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4f3f9-24bb-4141-b5b0-69fd5b4da115 None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:39.553202 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed4f3f9-24bb-4141-b5b0-69fd5b4da115 None admin] RBAC: Adding query filter params (name=service) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:39.553493 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed4f3f9-24bb-4141-b5b0-69fd5b4da115 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:39.554897 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed4f3f9-24bb-4141-b5b0-69fd5b4da115 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:39.565017 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 308/632] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Jul 15 17:24:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:39.566404 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455b7e3-fc13-4748-bdc9-e84d348bad12 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:39.566703 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455b7e3-fc13-4748-bdc9-e84d348bad12 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:39.566978 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455b7e3-fc13-4748-bdc9-e84d348bad12 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:39.568478 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 309/633] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:39.569599 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88849c-86eb-4052-94f8-26b06823d3c8 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:39.571031 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88849c-86eb-4052-94f8-26b06823d3c8 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:39.571031 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88849c-86eb-4052-94f8-26b06823d3c8 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:39.572720 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 310/634] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:39.574188 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419d9b0-77d2-4528-b654-26e1d35b3687 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:39.574188 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419d9b0-77d2-4528-b654-26e1d35b3687 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:39.574379 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419d9b0-77d2-4528-b654-26e1d35b3687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:39.591455 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-2419d9b0-77d2-4528-b654-26e1d35b3687 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:39.592750 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-2419d9b0-77d2-4528-b654-26e1d35b3687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:39.616410 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:39.636987 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 325/635] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:24:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 17:24:39.639056 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13820fd8-50c3-4637-8d8a-37e22626ee4a None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:39.639822 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13820fd8-50c3-4637-8d8a-37e22626ee4a None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:39.640235 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13820fd8-50c3-4637-8d8a-37e22626ee4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:39.657705 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-13820fd8-50c3-4637-8d8a-37e22626ee4a None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:39.658932 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-13820fd8-50c3-4637-8d8a-37e22626ee4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:39.667598 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 311/636] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:24:39.668744 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2419d9b0-77d2-4528-b654-26e1d35b3687 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:39.690624 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:39.740158 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 326/637] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:24:39.741173 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13820fd8-50c3-4637-8d8a-37e22626ee4a None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:39.794668 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2419d9b0-77d2-4528-b654-26e1d35b3687 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:39.829907 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8952630-83a0-4160-8e16-3285b1aaf7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:39.831338 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8952630-83a0-4160-8e16-3285b1aaf7b6 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:39.831745 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8952630-83a0-4160-8e16-3285b1aaf7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:39.832036 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8952630-83a0-4160-8e16-3285b1aaf7b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:39.843261 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8952630-83a0-4160-8e16-3285b1aaf7b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:39.844690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8952630-83a0-4160-8e16-3285b1aaf7b6 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:39.853204 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13820fd8-50c3-4637-8d8a-37e22626ee4a None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:39.862502 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-d8952630-83a0-4160-8e16-3285b1aaf7b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:39.862502 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:39.862502 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:39.862502 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:39.862502 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:39.862502 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:39.862502 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:39.862502 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:39.862502 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:39.862502 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:39.862502 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:39.862502 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:39.862502 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:39.862502 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:39.862502 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:39.863422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:39.863422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:39.863422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:39.863422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:39.863422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:39.863422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:39.863422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:39.863422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:39.863422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:39.863422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:39.863422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:39.863422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:39.863422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:39.863422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:39.863422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:39.863422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:39.863422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:39.864291 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:39.864291 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:39.864291 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:39.864291 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:39.866297 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 312/638] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:39.867287 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8952630-83a0-4160-8e16-3285b1aaf7b6 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:39.883121 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:39.894290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ffc31-9a1d-4522-a9da-c59f9ede1ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:39.895021 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ffc31-9a1d-4522-a9da-c59f9ede1ffa None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:39.895296 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ffc31-9a1d-4522-a9da-c59f9ede1ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:39.895570 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ffc31-9a1d-4522-a9da-c59f9ede1ffa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:39.906052 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030ffc31-9a1d-4522-a9da-c59f9ede1ffa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:39.907652 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030ffc31-9a1d-4522-a9da-c59f9ede1ffa None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:39.926589 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-030ffc31-9a1d-4522-a9da-c59f9ede1ffa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:39.926589 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:39.926589 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:39.926589 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:39.926589 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:39.926589 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:39.926589 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:39.926589 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:39.926589 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:39.926589 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:39.926589 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:39.926589 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:39.926589 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:39.926589 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:39.926589 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:39.927680 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:39.927680 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:39.927680 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:39.927680 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:39.927680 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:39.927680 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:39.927680 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:39.927680 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:39.927680 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:39.927680 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:39.927680 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:39.927680 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:39.927680 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:39.927680 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:39.927680 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:39.927680 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:39.927680 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:39.933175 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:39.933175 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:39.933175 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:39.933175 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:39.933175 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 327/639] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:39.933175 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ffc31-9a1d-4522-a9da-c59f9ede1ffa None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:39.947262 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:39.982581 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8952630-83a0-4160-8e16-3285b1aaf7b6 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:40.019395 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b812e7-1f07-4e82-a7fe-de417578d0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:40.020393 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b812e7-1f07-4e82-a7fe-de417578d0fe None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:40.020845 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b812e7-1f07-4e82-a7fe-de417578d0fe None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:40.021120 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b812e7-1f07-4e82-a7fe-de417578d0fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:40.032960 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b812e7-1f07-4e82-a7fe-de417578d0fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:24:40.035240 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ffc31-9a1d-4522-a9da-c59f9ede1ffa None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:40.040984 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-a4b812e7-1f07-4e82-a7fe-de417578d0fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 17:24:40.040984 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:40.040984 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:40.040984 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:40.040984 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:40.040984 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:40.040984 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:40.040984 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:40.040984 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:40.040984 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:40.040984 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:40.040984 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:40.040984 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:24:40.040984 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:24:40.040984 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:24:40.040984 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:24:40.042116 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:24:40.042116 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:24:40.042116 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:24:40.042116 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:24:40.042116 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:40.042116 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:40.042116 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:40.042116 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:40.042116 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:40.042116 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:40.042116 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:40.042116 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:40.042116 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:40.042116 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:40.042116 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:40.042116 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:40.043122 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:40.043122 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:40.043122 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:40.043122 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:40.043122 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:24:40.043122 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:24:40.043122 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:24:40.043122 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:24:40.043122 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:24:40.043122 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:24:40.043122 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 17:24:40.043122 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:40.046133 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 313/640] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Jul 15 17:24:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:40.047293 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b812e7-1f07-4e82-a7fe-de417578d0fe None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:40.074916 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc03819-c289-47e4-9f4c-d54ba154395a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:40.075712 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc03819-c289-47e4-9f4c-d54ba154395a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:40.076256 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc03819-c289-47e4-9f4c-d54ba154395a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:40.076970 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc03819-c289-47e4-9f4c-d54ba154395a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:40.088202 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc03819-c289-47e4-9f4c-d54ba154395a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:24:40.096648 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-6dc03819-c289-47e4-9f4c-d54ba154395a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 17:24:40.096648 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:40.096648 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:40.096648 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:40.096648 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:40.096648 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:40.096648 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:40.096648 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:40.096648 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:40.096648 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:40.096648 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:40.096648 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:40.096648 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:24:40.096648 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:24:40.096648 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:24:40.096648 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:24:40.097634 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:24:40.097634 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:24:40.097634 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:24:40.097634 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:24:40.097634 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:40.097634 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:40.097634 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:40.097634 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:40.097634 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:40.097634 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:40.097634 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:40.097634 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:40.097634 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:40.097634 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:40.097634 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:40.097634 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:40.098621 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:40.098621 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:40.098621 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:40.098621 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:40.098621 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:24:40.098621 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:24:40.098621 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:24:40.098621 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:24:40.098621 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:24:40.098621 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:24:40.098621 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 17:24:40.098621 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:40.102731 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 328/641] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Jul 15 17:24:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:40.103433 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc03819-c289-47e4-9f4c-d54ba154395a None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:40.127111 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:40.163923 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b812e7-1f07-4e82-a7fe-de417578d0fe None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:40.175713 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:40.202213 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317575d0-be2c-4af4-b0fc-f0765d253ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:40.202873 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317575d0-be2c-4af4-b0fc-f0765d253ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:40.203158 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317575d0-be2c-4af4-b0fc-f0765d253ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:40.203427 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317575d0-be2c-4af4-b0fc-f0765d253ac3 None admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:40.204146 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317575d0-be2c-4af4-b0fc-f0765d253ac3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:40.204448 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317575d0-be2c-4af4-b0fc-f0765d253ac3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:40.205427 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc03819-c289-47e4-9f4c-d54ba154395a None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:40.206162 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317575d0-be2c-4af4-b0fc-f0765d253ac3 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:40.219754 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 314/642] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:40.220547 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317575d0-be2c-4af4-b0fc-f0765d253ac3 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:40.244070 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7067b7a-f0f3-4b8d-9518-6e850bc2fb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:40.244727 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7067b7a-f0f3-4b8d-9518-6e850bc2fb49 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:40.245006 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7067b7a-f0f3-4b8d-9518-6e850bc2fb49 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:40.245276 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7067b7a-f0f3-4b8d-9518-6e850bc2fb49 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:40.246024 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7067b7a-f0f3-4b8d-9518-6e850bc2fb49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:40.246326 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7067b7a-f0f3-4b8d-9518-6e850bc2fb49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:40.247723 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7067b7a-f0f3-4b8d-9518-6e850bc2fb49 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:40.265004 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 329/643] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:40.265004 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7067b7a-f0f3-4b8d-9518-6e850bc2fb49 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:40.332373 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317575d0-be2c-4af4-b0fc-f0765d253ac3 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:40.370803 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:40.372276 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7067b7a-f0f3-4b8d-9518-6e850bc2fb49 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:40.377804 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a469bd-3233-4022-b540-f07a8f463e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:40.378488 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a469bd-3233-4022-b540-f07a8f463e87 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:40.378764 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a469bd-3233-4022-b540-f07a8f463e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:40.379030 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a469bd-3233-4022-b540-f07a8f463e87 None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:40.379775 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a469bd-3233-4022-b540-f07a8f463e87 None admin] RBAC: Adding query filter params (name=service) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:40.380095 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a469bd-3233-4022-b540-f07a8f463e87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:40.382670 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a469bd-3233-4022-b540-f07a8f463e87 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:40.392613 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 315/644] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Jul 15 17:24:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:40.393396 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a469bd-3233-4022-b540-f07a8f463e87 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:40.409449 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:40.416532 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cce206-95a7-4c32-8e1b-3f51a5153889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:40.417830 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cce206-95a7-4c32-8e1b-3f51a5153889 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:40.418277 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cce206-95a7-4c32-8e1b-3f51a5153889 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:40.418694 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cce206-95a7-4c32-8e1b-3f51a5153889 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:40.419694 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cce206-95a7-4c32-8e1b-3f51a5153889 None admin] RBAC: Adding query filter params (name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:40.420646 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cce206-95a7-4c32-8e1b-3f51a5153889 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:40.422286 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cce206-95a7-4c32-8e1b-3f51a5153889 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:40.430688 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 330/645] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Jul 15 17:24:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:40.431468 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cce206-95a7-4c32-8e1b-3f51a5153889 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:40.509903 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a469bd-3233-4022-b540-f07a8f463e87 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:40.549117 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96bc6a6-edc8-470d-91a4-5afff1a21350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:40.549955 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bc6a6-edc8-470d-91a4-5afff1a21350 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:40.550236 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bc6a6-edc8-470d-91a4-5afff1a21350 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:40.550510 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bc6a6-edc8-470d-91a4-5afff1a21350 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:40.551515 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cce206-95a7-4c32-8e1b-3f51a5153889 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:40.558803 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96bc6a6-edc8-470d-91a4-5afff1a21350 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:40.560369 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96bc6a6-edc8-470d-91a4-5afff1a21350 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:40.576840 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-c96bc6a6-edc8-470d-91a4-5afff1a21350 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 15 17:24:40.576840 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:40.576840 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:40.576840 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:40.576840 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:40.576840 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:40.576840 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:40.576840 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:40.576840 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:40.576840 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:40.576840 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:40.576840 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:40.576840 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 17:24:40.576840 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 17:24:40.576840 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 17:24:40.576840 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 17:24:40.578035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:40.578035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:40.578035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 17:24:40.578035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:24:40.578035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 17:24:40.578035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:24:40.578035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:40.578035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:40.578035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:40.578035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:40.578035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:40.578035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:40.578035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:40.578035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:40.578035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:40.578035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:40.578035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:40.578035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:40.579143 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:40.579143 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:40.579143 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 17:24:40.579143 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 17:24:40.579143 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 17:24:40.579143 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 17:24:40.579143 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 17:24:40.579143 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 17:24:40.579143 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 15 17:24:40.579143 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:40.579143 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 316/646] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:24:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:40.579736 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96bc6a6-edc8-470d-91a4-5afff1a21350 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:40.592064 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd7d6c5-1042-4018-a2a1-9c4f7c25ac92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:40.593129 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7d6c5-1042-4018-a2a1-9c4f7c25ac92 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:40.593469 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7d6c5-1042-4018-a2a1-9c4f7c25ac92 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:40.593829 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7d6c5-1042-4018-a2a1-9c4f7c25ac92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:40.601169 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd7d6c5-1042-4018-a2a1-9c4f7c25ac92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:40.602638 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd7d6c5-1042-4018-a2a1-9c4f7c25ac92 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:40.616930 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-7dd7d6c5-1042-4018-a2a1-9c4f7c25ac92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:24:40.616930 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:40.616930 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:40.616930 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:40.616930 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:40.616930 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:40.616930 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:40.616930 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:40.616930 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:40.616930 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:40.616930 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:40.616930 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:40.616930 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 17:24:40.616930 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 17:24:40.616930 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 17:24:40.618014 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 17:24:40.618014 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:40.618014 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:40.618014 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:40.618014 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:40.618014 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:40.618014 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:40.618014 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:40.618014 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:40.618014 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:40.618014 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:40.618014 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:40.618014 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:40.618014 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:40.618014 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:40.618014 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:40.618014 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:40.624248 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 17:24:40.624248 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 17:24:40.624248 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 17:24:40.624248 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 17:24:40.624248 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 17:24:40.624248 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 17:24:40.624248 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:24:40.624248 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:40.624248 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 331/647] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:24:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:40.624248 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd7d6c5-1042-4018-a2a1-9c4f7c25ac92 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:40.651393 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:40.692774 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:40.702051 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96bc6a6-edc8-470d-91a4-5afff1a21350 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:40.736972 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ccd5b6-2f31-4f2d-b01c-67f59fdcb6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:40.737877 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ccd5b6-2f31-4f2d-b01c-67f59fdcb6fc None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:40.738219 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ccd5b6-2f31-4f2d-b01c-67f59fdcb6fc None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:40.738554 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ccd5b6-2f31-4f2d-b01c-67f59fdcb6fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:40.739773 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd7d6c5-1042-4018-a2a1-9c4f7c25ac92 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:40.750182 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ccd5b6-2f31-4f2d-b01c-67f59fdcb6fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:40.751722 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ccd5b6-2f31-4f2d-b01c-67f59fdcb6fc None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:40.773373 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-65ccd5b6-2f31-4f2d-b01c-67f59fdcb6fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:40.773373 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:40.773373 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:40.773373 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:40.773373 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:40.773373 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:40.773373 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:40.773373 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:40.773373 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:40.773373 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:40.773373 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:40.773373 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:40.773373 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:40.773373 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:40.773373 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:40.774454 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:40.774454 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:40.774454 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:40.774454 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:40.774454 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:40.774454 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:40.774454 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:40.774454 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:40.774454 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:40.774454 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:40.774454 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:40.774454 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:40.774454 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:40.774454 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:40.774454 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:40.774454 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:40.774454 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:40.775384 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:40.775384 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:40.775384 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:40.775384 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:40.775384 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 317/648] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:40.775775 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ccd5b6-2f31-4f2d-b01c-67f59fdcb6fc None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:40.780219 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092631bd-1111-45a0-8876-3c724c9ec21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:40.781002 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092631bd-1111-45a0-8876-3c724c9ec21a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:40.781316 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092631bd-1111-45a0-8876-3c724c9ec21a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:40.781589 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092631bd-1111-45a0-8876-3c724c9ec21a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:40.795297 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092631bd-1111-45a0-8876-3c724c9ec21a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:40.796759 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092631bd-1111-45a0-8876-3c724c9ec21a None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:40.814904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-092631bd-1111-45a0-8876-3c724c9ec21a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:40.814904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:40.814904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:40.814904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:40.814904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:40.814904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:40.814904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:40.814904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:40.814904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:40.814904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:40.814904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:40.814904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:40.814904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:40.814904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:40.814904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:40.816015 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:40.816015 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:40.816015 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:40.816015 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:40.816015 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:40.816015 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:40.816015 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:40.816015 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:40.816015 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:40.816015 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:40.816015 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:40.816015 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:40.816015 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:40.816015 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:40.816015 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:40.816015 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:40.816015 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:40.816925 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:40.816925 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:40.816925 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:40.816925 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:40.816925 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 332/649] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:40.817209 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092631bd-1111-45a0-8876-3c724c9ec21a None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:40.891525 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ccd5b6-2f31-4f2d-b01c-67f59fdcb6fc None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:40.899517 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:40.930712 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148add19-1180-46a7-95db-70b030562834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:40.931393 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148add19-1180-46a7-95db-70b030562834 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:40.931675 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148add19-1180-46a7-95db-70b030562834 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:40.931953 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148add19-1180-46a7-95db-70b030562834 None admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:40.932795 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148add19-1180-46a7-95db-70b030562834 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:40.933105 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148add19-1180-46a7-95db-70b030562834 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:40.934331 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092631bd-1111-45a0-8876-3c724c9ec21a None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:40.934582 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148add19-1180-46a7-95db-70b030562834 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:40.943133 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:40.954045 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 318/650] 10.222.0.27 () {56 vars in 1137 bytes} [Fri Jul 15 17:24:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:40.954720 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148add19-1180-46a7-95db-70b030562834 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:40.976429 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be6eaa-759b-40b0-8e33-acf6849b1f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:40.977095 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be6eaa-759b-40b0-8e33-acf6849b1f68 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:40.977373 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be6eaa-759b-40b0-8e33-acf6849b1f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:40.977639 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be6eaa-759b-40b0-8e33-acf6849b1f68 None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:40.978464 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be6eaa-759b-40b0-8e33-acf6849b1f68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:40.978763 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be6eaa-759b-40b0-8e33-acf6849b1f68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:40.980194 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be6eaa-759b-40b0-8e33-acf6849b1f68 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:40.992140 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 333/651] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jul 15 17:24:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:40.997532 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be6eaa-759b-40b0-8e33-acf6849b1f68 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:41.063257 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148add19-1180-46a7-95db-70b030562834 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:41.099643 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb83add-ada7-44b1-be4e-d1a3483906a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:41.100302 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb83add-ada7-44b1-be4e-d1a3483906a9 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:41.100585 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb83add-ada7-44b1-be4e-d1a3483906a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:41.100863 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb83add-ada7-44b1-be4e-d1a3483906a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:41.101584 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb83add-ada7-44b1-be4e-d1a3483906a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:41.101913 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb83add-ada7-44b1-be4e-d1a3483906a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:41.103284 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb83add-ada7-44b1-be4e-d1a3483906a9 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:41.105997 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be6eaa-759b-40b0-8e33-acf6849b1f68 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:41.119520 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 319/652] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:41.119520 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb83add-ada7-44b1-be4e-d1a3483906a9 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:41.143296 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:41.147505 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ba7e2c-546a-4bb5-93e5-5ecda534ed48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:41.148168 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba7e2c-546a-4bb5-93e5-5ecda534ed48 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:41.148449 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba7e2c-546a-4bb5-93e5-5ecda534ed48 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:41.148720 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba7e2c-546a-4bb5-93e5-5ecda534ed48 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:41.149493 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ba7e2c-546a-4bb5-93e5-5ecda534ed48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:41.149724 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ba7e2c-546a-4bb5-93e5-5ecda534ed48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:41.151171 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ba7e2c-546a-4bb5-93e5-5ecda534ed48 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:41.164569 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 334/653] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:41.169761 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ba7e2c-546a-4bb5-93e5-5ecda534ed48 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:41.197605 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:41.220793 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb83add-ada7-44b1-be4e-d1a3483906a9 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:41.255824 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1329b34-b45b-4b71-98e9-a42fda3d4001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:41.256483 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1329b34-b45b-4b71-98e9-a42fda3d4001 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:41.256765 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1329b34-b45b-4b71-98e9-a42fda3d4001 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:41.257041 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1329b34-b45b-4b71-98e9-a42fda3d4001 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:41.274848 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ba7e2c-546a-4bb5-93e5-5ecda534ed48 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:41.308727 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d637679-2da5-46b8-925f-3f5892f24ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:41.309379 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d637679-2da5-46b8-925f-3f5892f24ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:41.309659 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d637679-2da5-46b8-925f-3f5892f24ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:41.309962 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d637679-2da5-46b8-925f-3f5892f24ff6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:41.311142 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d637679-2da5-46b8-925f-3f5892f24ff6 None admin] RBAC: Adding query filter params (role.id=1a453be279744db09ef4e2fcf580beac, scope.project.id=19cc5221b8074f48b5f73dc9c4289b03, user.id=f9d548c8199e4fdbbce7597bebd63421) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:41.311486 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d637679-2da5-46b8-925f-3f5892f24ff6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:41.313125 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d637679-2da5-46b8-925f-3f5892f24ff6 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:41.329818 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 335/654] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jul 15 17:24:41 2022] GET /identity/v3/role_assignments?user.id=f9d548c8199e4fdbbce7597bebd63421&scope.project.id=19cc5221b8074f48b5f73dc9c4289b03&role.id=1a453be279744db09ef4e2fcf580beac => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:41.329818 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d637679-2da5-46b8-925f-3f5892f24ff6 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:41.346810 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1329b34-b45b-4b71-98e9-a42fda3d4001 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:41.348407 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1329b34-b45b-4b71-98e9-a42fda3d4001 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:41.375887 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:41.436507 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:41.447209 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d637679-2da5-46b8-925f-3f5892f24ff6 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:41.485915 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 320/655] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:24:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 17:24:41.485915 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1329b34-b45b-4b71-98e9-a42fda3d4001 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:41.493361 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db8cad-057d-4219-b21a-595d1378ec72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:41.494212 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db8cad-057d-4219-b21a-595d1378ec72 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:41.494955 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db8cad-057d-4219-b21a-595d1378ec72 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:41.495245 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db8cad-057d-4219-b21a-595d1378ec72 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:41.503938 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9db8cad-057d-4219-b21a-595d1378ec72 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:41.505383 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9db8cad-057d-4219-b21a-595d1378ec72 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:41.523281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-a9db8cad-057d-4219-b21a-595d1378ec72 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 17:24:41.523281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:41.523281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:41.523281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:41.523281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:41.523281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:41.523281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:41.523281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:41.523281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:41.523281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:41.523281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:41.523281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:41.523281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 17:24:41.523281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 17:24:41.523281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 17:24:41.523281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 17:24:41.524524 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:41.524524 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:41.524524 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 17:24:41.524524 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:24:41.524524 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 17:24:41.524524 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:24:41.524524 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:41.524524 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:41.524524 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:41.524524 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:41.524524 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:41.524524 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:41.524524 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:41.524524 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:41.524524 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:41.524524 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:41.524524 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:41.524524 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:41.526017 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:41.526017 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:41.526017 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 17:24:41.526017 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 17:24:41.526017 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 17:24:41.526017 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 17:24:41.526017 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 17:24:41.526017 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 17:24:41.526017 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 17:24:41.526017 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:41.526017 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 336/656] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:24:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:41.526017 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cc9fe-5b2a-44b4-897a-69ac5514bf3a None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:41.526017 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cc9fe-5b2a-44b4-897a-69ac5514bf3a None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:41.526928 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cc9fe-5b2a-44b4-897a-69ac5514bf3a None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:41.529213 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 337/657] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:41.529213 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36cc9fe-5b2a-44b4-897a-69ac5514bf3a None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:41.597384 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1329b34-b45b-4b71-98e9-a42fda3d4001 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:41.623503 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:41.635973 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48208e7-d323-43df-a187-ebf5a8f7a2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:41.636925 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48208e7-d323-43df-a187-ebf5a8f7a2ed None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:41.637308 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48208e7-d323-43df-a187-ebf5a8f7a2ed None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:41.637673 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48208e7-d323-43df-a187-ebf5a8f7a2ed None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:41.642918 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36cc9fe-5b2a-44b4-897a-69ac5514bf3a None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:41.646003 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48208e7-d323-43df-a187-ebf5a8f7a2ed None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:41.646942 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48208e7-d323-43df-a187-ebf5a8f7a2ed None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:41.661951 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-f48208e7-d323-43df-a187-ebf5a8f7a2ed None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 17:24:41.661951 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:41.661951 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:41.661951 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:41.661951 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:41.661951 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:41.661951 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:41.661951 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:41.661951 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:41.661951 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:41.661951 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:41.661951 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:41.661951 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 17:24:41.661951 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 17:24:41.661951 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 17:24:41.661951 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 17:24:41.663115 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:41.663115 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:41.663115 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 17:24:41.663115 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:24:41.663115 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 17:24:41.663115 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:24:41.663115 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:41.663115 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:41.663115 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:41.663115 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:41.663115 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:41.663115 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:41.663115 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:41.663115 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:41.663115 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:41.663115 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:41.663115 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:41.663115 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:41.664269 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:41.664269 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:41.664269 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 17:24:41.664269 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 17:24:41.664269 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 17:24:41.664269 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 17:24:41.664269 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 17:24:41.664269 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 17:24:41.664269 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 17:24:41.664269 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:41.670285 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 321/658] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Jul 15 17:24:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:41.670285 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48208e7-d323-43df-a187-ebf5a8f7a2ed None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:41.685269 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c790e936-eb1a-4289-aa03-9a921f215570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:41.686196 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790e936-eb1a-4289-aa03-9a921f215570 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:41.686545 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790e936-eb1a-4289-aa03-9a921f215570 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:41.686891 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790e936-eb1a-4289-aa03-9a921f215570 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:41.697728 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c790e936-eb1a-4289-aa03-9a921f215570 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:41.699317 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c790e936-eb1a-4289-aa03-9a921f215570 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:41.717468 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-c790e936-eb1a-4289-aa03-9a921f215570 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:41.717468 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:41.717468 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:41.717468 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:41.717468 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:41.717468 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:41.717468 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:41.717468 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:41.717468 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:41.717468 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:41.717468 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:41.717468 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:41.717468 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:41.717468 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:41.717468 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:41.718647 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:41.718647 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:41.718647 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:41.718647 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:41.718647 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:41.718647 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:41.718647 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:41.718647 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:41.718647 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:41.718647 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:41.718647 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:41.718647 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:41.718647 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:41.718647 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:41.718647 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:41.718647 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:41.718647 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:41.719731 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:41.719731 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:41.719731 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:41.719731 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:41.720339 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 338/659] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:41.721694 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbb004-7dd7-46ba-9041-1e012e6e8c92 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:41.722080 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbb004-7dd7-46ba-9041-1e012e6e8c92 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:41.722422 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbb004-7dd7-46ba-9041-1e012e6e8c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:41.727592 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:41.744089 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-22bbb004-7dd7-46ba-9041-1e012e6e8c92 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:41.745996 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-22bbb004-7dd7-46ba-9041-1e012e6e8c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:41.780239 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48208e7-d323-43df-a187-ebf5a8f7a2ed None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:41.818400 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da389d-20fd-4b87-bded-6b2fd555b0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:41.819539 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da389d-20fd-4b87-bded-6b2fd555b0c6 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:41.820071 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da389d-20fd-4b87-bded-6b2fd555b0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:41.820540 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da389d-20fd-4b87-bded-6b2fd555b0c6 None admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:41.822304 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da389d-20fd-4b87-bded-6b2fd555b0c6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:41.822852 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da389d-20fd-4b87-bded-6b2fd555b0c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:41.825580 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da389d-20fd-4b87-bded-6b2fd555b0c6 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:41.841367 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 339/660] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:24:41.842545 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bbb004-7dd7-46ba-9041-1e012e6e8c92 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:41.847821 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 322/661] 10.222.0.27 () {56 vars in 1137 bytes} [Fri Jul 15 17:24:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:41.848647 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da389d-20fd-4b87-bded-6b2fd555b0c6 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:41.895470 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:41.954987 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bbb004-7dd7-46ba-9041-1e012e6e8c92 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:41.955234 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da389d-20fd-4b87-bded-6b2fd555b0c6 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:41.986920 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:41.990810 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b493340-a8c7-4d85-a731-caf16cd8d21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:41.991487 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b493340-a8c7-4d85-a731-caf16cd8d21c None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:41.991763 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b493340-a8c7-4d85-a731-caf16cd8d21c None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:41.992031 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b493340-a8c7-4d85-a731-caf16cd8d21c None admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:41.992748 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b493340-a8c7-4d85-a731-caf16cd8d21c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:41.992853 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f37b85-1ce2-445d-a2eb-e8f5f141d60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:41.993045 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b493340-a8c7-4d85-a731-caf16cd8d21c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:41.993733 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f37b85-1ce2-445d-a2eb-e8f5f141d60c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:41.994218 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f37b85-1ce2-445d-a2eb-e8f5f141d60c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:41.994486 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b493340-a8c7-4d85-a731-caf16cd8d21c None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:41.994582 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f37b85-1ce2-445d-a2eb-e8f5f141d60c None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:41.995525 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f37b85-1ce2-445d-a2eb-e8f5f141d60c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:41.995931 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f37b85-1ce2-445d-a2eb-e8f5f141d60c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:41.997453 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f37b85-1ce2-445d-a2eb-e8f5f141d60c None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:42.011371 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 323/662] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:42.012246 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b493340-a8c7-4d85-a731-caf16cd8d21c None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:42.015675 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 340/663] 10.222.0.27 () {56 vars in 1139 bytes} [Fri Jul 15 17:24:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:42.016803 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f37b85-1ce2-445d-a2eb-e8f5f141d60c None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:42.121266 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b493340-a8c7-4d85-a731-caf16cd8d21c None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:42.123212 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:42.125727 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f37b85-1ce2-445d-a2eb-e8f5f141d60c None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:42.158013 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ddb9d-4bab-4f20-b00a-e596d17c6f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:42.158674 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ddb9d-4bab-4f20-b00a-e596d17c6f0a None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:42.159079 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ddb9d-4bab-4f20-b00a-e596d17c6f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:42.159358 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ddb9d-4bab-4f20-b00a-e596d17c6f0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:42.163200 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f45a23-86cd-4b7e-a7e9-d906020d7578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:42.163984 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f45a23-86cd-4b7e-a7e9-d906020d7578 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:42.164268 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f45a23-86cd-4b7e-a7e9-d906020d7578 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:42.164544 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f45a23-86cd-4b7e-a7e9-d906020d7578 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:42.175676 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f45a23-86cd-4b7e-a7e9-d906020d7578 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:24:42.183432 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-55f45a23-86cd-4b7e-a7e9-d906020d7578 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 17:24:42.183432 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:42.183432 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:42.183432 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:42.183432 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:42.183432 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:42.183432 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:42.183432 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:42.183432 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:42.183432 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:42.183432 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:42.183432 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:42.183432 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:24:42.183432 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:24:42.183432 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:24:42.183432 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:24:42.184353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:24:42.184353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:24:42.184353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:24:42.184353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:24:42.184353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:42.184353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:42.184353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:42.184353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:42.184353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:42.184353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:42.184353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:42.184353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:42.184353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:42.184353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:42.184353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:42.184353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:42.185215 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:42.185215 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:42.185215 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:42.185215 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:42.185215 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:24:42.185215 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:24:42.185215 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:24:42.185215 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:24:42.185215 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:24:42.185215 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:24:42.185215 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 17:24:42.185215 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:42.185215 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 341/664] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Jul 15 17:24:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:42.185980 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f45a23-86cd-4b7e-a7e9-d906020d7578 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:42.237572 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383ddb9d-4bab-4f20-b00a-e596d17c6f0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:42.238397 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:42.240113 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383ddb9d-4bab-4f20-b00a-e596d17c6f0a None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:42.292668 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f45a23-86cd-4b7e-a7e9-d906020d7578 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:42.332640 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aafa89-8b11-4b26-92c1-5155529203a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:42.333446 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aafa89-8b11-4b26-92c1-5155529203a2 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:42.333732 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aafa89-8b11-4b26-92c1-5155529203a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:42.334039 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aafa89-8b11-4b26-92c1-5155529203a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:42.340682 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aafa89-8b11-4b26-92c1-5155529203a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:42.342200 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aafa89-8b11-4b26-92c1-5155529203a2 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:42.346482 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 324/665] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:24:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 17:24:42.347497 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ddb9d-4bab-4f20-b00a-e596d17c6f0a None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:42.349877 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:42.359848 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-b8aafa89-8b11-4b26-92c1-5155529203a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:24:42.359848 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:42.359848 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:42.359848 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:42.359848 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:42.359848 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:42.359848 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:42.359848 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:42.359848 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:42.359848 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:42.359848 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:42.359848 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:42.359848 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 17:24:42.359848 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 17:24:42.359848 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 17:24:42.360966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 17:24:42.360966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:42.360966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:42.360966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:42.360966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:42.360966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:42.360966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:42.360966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:42.360966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:42.360966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:42.360966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:42.360966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:42.360966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:42.360966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:42.360966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:42.360966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:42.360966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:42.361935 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 17:24:42.361935 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 17:24:42.361935 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 17:24:42.361935 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 17:24:42.361935 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 17:24:42.361935 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 17:24:42.361935 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:24:42.361935 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:42.361935 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 342/666] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:24:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:42.362429 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aafa89-8b11-4b26-92c1-5155529203a2 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:42.461672 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aafa89-8b11-4b26-92c1-5155529203a2 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:42.462160 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ddb9d-4bab-4f20-b00a-e596d17c6f0a None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:42.474227 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:42.497357 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19e817-dcc8-44b6-9843-07ba8ce32527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:42.498149 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19e817-dcc8-44b6-9843-07ba8ce32527 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:42.498436 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19e817-dcc8-44b6-9843-07ba8ce32527 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:42.498709 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19e817-dcc8-44b6-9843-07ba8ce32527 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:42.500492 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d355c-50f7-406a-b42e-30f3004a6244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:42.501239 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d355c-50f7-406a-b42e-30f3004a6244 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:42.501722 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d355c-50f7-406a-b42e-30f3004a6244 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:42.502026 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d355c-50f7-406a-b42e-30f3004a6244 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:42.503747 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d355c-50f7-406a-b42e-30f3004a6244 None admin] RBAC: Adding query filter params (name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:42.504059 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d355c-50f7-406a-b42e-30f3004a6244 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:42.505509 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d355c-50f7-406a-b42e-30f3004a6244 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:42.520941 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 343/667] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Jul 15 17:24:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:42.520941 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d355c-50f7-406a-b42e-30f3004a6244 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:42.577204 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19e817-dcc8-44b6-9843-07ba8ce32527 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:42.578605 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19e817-dcc8-44b6-9843-07ba8ce32527 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:42.580897 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:42.622780 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d355c-50f7-406a-b42e-30f3004a6244 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:42.657662 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de394bc4-b970-44e0-8a90-b3f33e2c93b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:42.658335 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de394bc4-b970-44e0-8a90-b3f33e2c93b1 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:42.658516 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de394bc4-b970-44e0-8a90-b3f33e2c93b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:42.658788 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de394bc4-b970-44e0-8a90-b3f33e2c93b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:42.669946 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de394bc4-b970-44e0-8a90-b3f33e2c93b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:42.671391 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de394bc4-b970-44e0-8a90-b3f33e2c93b1 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:42.688741 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 325/668] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:24:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 17:24:42.688741 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19e817-dcc8-44b6-9843-07ba8ce32527 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:42.688982 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-de394bc4-b970-44e0-8a90-b3f33e2c93b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:42.688982 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:42.688982 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:42.688982 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:42.688982 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:42.688982 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:42.688982 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:42.688982 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:42.688982 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:42.688982 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:42.688982 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:42.688982 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:42.688982 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:42.688982 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:42.688982 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:42.689824 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:42.689824 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:42.689824 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:42.689824 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:42.689824 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:42.689824 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:42.689824 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:42.689824 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:42.689824 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:42.689824 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:42.689824 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:42.689824 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:42.689824 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:42.689824 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:42.689824 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:42.689824 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:42.689824 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:42.690705 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:42.690705 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:42.690705 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:42.690705 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:42.690705 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 344/669] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:42.691010 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de394bc4-b970-44e0-8a90-b3f33e2c93b1 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:42.718763 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:42.796481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de394bc4-b970-44e0-8a90-b3f33e2c93b1 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:42.797471 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19e817-dcc8-44b6-9843-07ba8ce32527 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:42.799916 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:42.835171 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b6ba5b-58d4-47f7-9d65-4464d2981c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:42.835367 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26008d83-8720-4a7e-a969-d28d372daf7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:42.835747 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6ba5b-58d4-47f7-9d65-4464d2981c4b None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:42.835930 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26008d83-8720-4a7e-a969-d28d372daf7c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:42.836045 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6ba5b-58d4-47f7-9d65-4464d2981c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:42.836205 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26008d83-8720-4a7e-a969-d28d372daf7c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:42.836305 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6ba5b-58d4-47f7-9d65-4464d2981c4b None admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:42.836452 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26008d83-8720-4a7e-a969-d28d372daf7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:42.837065 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b6ba5b-58d4-47f7-9d65-4464d2981c4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:42.837375 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b6ba5b-58d4-47f7-9d65-4464d2981c4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:42.838850 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b6ba5b-58d4-47f7-9d65-4464d2981c4b None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:42.848392 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26008d83-8720-4a7e-a969-d28d372daf7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:42.849857 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26008d83-8720-4a7e-a969-d28d372daf7c None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:42.855600 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 326/670] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jul 15 17:24:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:42.855600 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b6ba5b-58d4-47f7-9d65-4464d2981c4b None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:42.873728 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-26008d83-8720-4a7e-a969-d28d372daf7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:42.873728 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:42.873728 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:42.873728 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:42.873728 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:42.873728 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:42.873728 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:42.873728 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:42.873728 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:42.873728 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:42.873728 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:42.873728 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:42.873728 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:42.873728 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:42.873728 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:42.874690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:42.874690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:42.874690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:42.874690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:42.874690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:42.874690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:42.874690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:42.874690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:42.874690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:42.874690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:42.874690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:42.874690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:42.874690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:42.874690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:42.874690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:42.874690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:42.874690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:42.875599 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:42.875599 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:42.875599 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:42.875599 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:42.875599 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 345/671] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:42.875893 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26008d83-8720-4a7e-a969-d28d372daf7c None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:42.958210 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:42.972089 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b6ba5b-58d4-47f7-9d65-4464d2981c4b None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:42.984165 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26008d83-8720-4a7e-a969-d28d372daf7c None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:43.007810 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1e6d4-92ba-4353-b1f8-1de65d815fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:43.008621 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1e6d4-92ba-4353-b1f8-1de65d815fac None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:43.008905 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1e6d4-92ba-4353-b1f8-1de65d815fac None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:43.009185 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1e6d4-92ba-4353-b1f8-1de65d815fac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:43.019040 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470ab19-5e9c-462b-aa9b-9f72299d3e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:43.019706 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470ab19-5e9c-462b-aa9b-9f72299d3e51 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:43.020021 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470ab19-5e9c-462b-aa9b-9f72299d3e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:43.020260 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470ab19-5e9c-462b-aa9b-9f72299d3e51 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:43.020374 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa1e6d4-92ba-4353-b1f8-1de65d815fac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:43.020984 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470ab19-5e9c-462b-aa9b-9f72299d3e51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:43.021290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470ab19-5e9c-462b-aa9b-9f72299d3e51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:43.021742 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa1e6d4-92ba-4353-b1f8-1de65d815fac None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:43.022671 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470ab19-5e9c-462b-aa9b-9f72299d3e51 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:43.039331 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 346/672] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:43.039331 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470ab19-5e9c-462b-aa9b-9f72299d3e51 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:43.039581 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-8aa1e6d4-92ba-4353-b1f8-1de65d815fac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:43.039581 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:43.039581 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:43.039581 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:43.039581 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:43.039581 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:43.039581 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:43.039581 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:43.039581 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:43.039581 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:43.039581 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:43.039581 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:43.039581 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:43.039581 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:43.039581 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:43.040434 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:43.040434 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:43.040434 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:43.040434 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:43.040434 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:43.040434 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:43.040434 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:43.040434 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:43.040434 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:43.040434 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:43.040434 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:43.040434 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:43.040434 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:43.040434 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:43.040434 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:43.040434 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:43.040434 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:43.041337 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:43.041337 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:43.041337 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:43.041337 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:43.041337 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 327/673] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:43.041625 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1e6d4-92ba-4353-b1f8-1de65d815fac None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:43.061428 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:43.151891 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1e6d4-92ba-4353-b1f8-1de65d815fac None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:43.152654 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470ab19-5e9c-462b-aa9b-9f72299d3e51 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:43.187626 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e79316-cdf4-4760-82ea-9f59ad5be523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:43.188300 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e79316-cdf4-4760-82ea-9f59ad5be523 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:43.188582 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e79316-cdf4-4760-82ea-9f59ad5be523 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:43.188860 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e79316-cdf4-4760-82ea-9f59ad5be523 None admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:43.189147 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c1263-f724-4a7e-a60a-b3ec967af9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:43.189583 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e79316-cdf4-4760-82ea-9f59ad5be523 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:43.189828 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c1263-f724-4a7e-a60a-b3ec967af9f1 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:43.189935 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e79316-cdf4-4760-82ea-9f59ad5be523 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:43.190118 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c1263-f724-4a7e-a60a-b3ec967af9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:43.190394 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c1263-f724-4a7e-a60a-b3ec967af9f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:43.191224 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c1263-f724-4a7e-a60a-b3ec967af9f1 None admin] RBAC: Adding query filter params (role.id=1a453be279744db09ef4e2fcf580beac, scope.project.id=19cc5221b8074f48b5f73dc9c4289b03, user.id=14775984c9d4463a8e8848dcf189714b) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:43.191329 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e79316-cdf4-4760-82ea-9f59ad5be523 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:43.191536 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c1263-f724-4a7e-a60a-b3ec967af9f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:43.192957 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c1263-f724-4a7e-a60a-b3ec967af9f1 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:43.196489 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:43.208466 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 328/674] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:43.208466 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e79316-cdf4-4760-82ea-9f59ad5be523 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:43.208730 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 347/675] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jul 15 17:24:43 2022] GET /identity/v3/role_assignments?user.id=14775984c9d4463a8e8848dcf189714b&scope.project.id=19cc5221b8074f48b5f73dc9c4289b03&role.id=1a453be279744db09ef4e2fcf580beac => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:43.208730 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c1263-f724-4a7e-a60a-b3ec967af9f1 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:43.295012 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:43.324921 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e79316-cdf4-4760-82ea-9f59ad5be523 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:43.337034 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c1263-f724-4a7e-a60a-b3ec967af9f1 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:43.363838 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3520cfa-e436-403c-967e-725ddcfd454f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:43.364211 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3520cfa-e436-403c-967e-725ddcfd454f None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:43.364482 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3520cfa-e436-403c-967e-725ddcfd454f None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:43.364759 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3520cfa-e436-403c-967e-725ddcfd454f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:43.373079 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3520cfa-e436-403c-967e-725ddcfd454f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:43.374584 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3520cfa-e436-403c-967e-725ddcfd454f None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:43.377505 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef2f15-0380-434a-9d51-9c2930559300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:43.378459 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef2f15-0380-434a-9d51-9c2930559300 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:43.378957 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef2f15-0380-434a-9d51-9c2930559300 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:43.379438 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef2f15-0380-434a-9d51-9c2930559300 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:43.380358 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef2f15-0380-434a-9d51-9c2930559300 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:43.380868 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef2f15-0380-434a-9d51-9c2930559300 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:43.382552 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef2f15-0380-434a-9d51-9c2930559300 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:43.390647 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-a3520cfa-e436-403c-967e-725ddcfd454f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:24:43.390647 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:43.390647 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:43.390647 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:43.390647 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:43.390647 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:43.390647 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:43.390647 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:43.390647 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:43.390647 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:43.390647 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:43.390647 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:43.390647 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 17:24:43.390647 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 17:24:43.390647 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 17:24:43.391538 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 17:24:43.391538 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:43.391538 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:43.391538 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:43.391538 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:43.391538 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:43.391538 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:43.391538 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:43.391538 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:43.391538 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:43.391538 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:43.391538 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:43.391538 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:43.391538 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:43.391538 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:43.391538 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:43.391538 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:43.392432 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 17:24:43.392432 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 17:24:43.392432 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 17:24:43.392432 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 17:24:43.392432 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 17:24:43.392432 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 17:24:43.392432 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:24:43.392432 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:43.392432 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 329/676] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:24:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:43.393650 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3520cfa-e436-403c-967e-725ddcfd454f None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:43.400060 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 348/677] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:43.401154 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef2f15-0380-434a-9d51-9c2930559300 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:43.474999 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:43.511321 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3520cfa-e436-403c-967e-725ddcfd454f None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:43.515665 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef2f15-0380-434a-9d51-9c2930559300 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:43.547184 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb289a6-0f6a-47f9-94a5-e4c6ed9ddd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:43.547988 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb289a6-0f6a-47f9-94a5-e4c6ed9ddd63 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:43.548269 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb289a6-0f6a-47f9-94a5-e4c6ed9ddd63 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:43.548567 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb289a6-0f6a-47f9-94a5-e4c6ed9ddd63 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:43.549660 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01606767-7826-4862-96fe-8d67caa7dbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:43.550355 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01606767-7826-4862-96fe-8d67caa7dbbb None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:43.550510 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:43.550660 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01606767-7826-4862-96fe-8d67caa7dbbb None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:43.550895 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01606767-7826-4862-96fe-8d67caa7dbbb None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:43.551684 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01606767-7826-4862-96fe-8d67caa7dbbb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:43.551982 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01606767-7826-4862-96fe-8d67caa7dbbb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:43.553671 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01606767-7826-4862-96fe-8d67caa7dbbb None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:43.557584 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb289a6-0f6a-47f9-94a5-e4c6ed9ddd63 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:43.559244 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb289a6-0f6a-47f9-94a5-e4c6ed9ddd63 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:43.565983 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 349/678] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jul 15 17:24:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:43.567259 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb244ae-dab3-45ef-ab66-ed56c940f2a2 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:43.567542 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb244ae-dab3-45ef-ab66-ed56c940f2a2 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:43.567815 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb244ae-dab3-45ef-ab66-ed56c940f2a2 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:43.569200 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 350/679] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:43.573620 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb244ae-dab3-45ef-ab66-ed56c940f2a2 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:43.580059 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-6eb289a6-0f6a-47f9-94a5-e4c6ed9ddd63 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 15 17:24:43.580059 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:43.580059 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:43.580059 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:43.580059 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:43.580059 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:43.580059 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:43.580059 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:43.580059 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:43.580059 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:43.580059 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:43.580059 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:43.580059 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 17:24:43.580059 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 17:24:43.580059 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 17:24:43.580059 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 17:24:43.581359 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:43.581359 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:43.581359 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 17:24:43.581359 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:24:43.581359 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 17:24:43.581359 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:24:43.581359 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:43.581359 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:43.581359 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:43.581359 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:43.581359 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:43.581359 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:43.581359 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:43.581359 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:43.581359 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:43.581359 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:43.581359 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:43.581359 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:43.582352 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:43.582352 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:43.582352 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 17:24:43.582352 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 17:24:43.582352 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 17:24:43.582352 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 17:24:43.582352 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 17:24:43.582352 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 17:24:43.582352 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 15 17:24:43.582352 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:43.583453 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 330/680] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jul 15 17:24:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:43.584265 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb289a6-0f6a-47f9-94a5-e4c6ed9ddd63 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:43.682028 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb244ae-dab3-45ef-ab66-ed56c940f2a2 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:43.695594 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb289a6-0f6a-47f9-94a5-e4c6ed9ddd63 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:43.703985 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:43.719524 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e800d67-f335-4f04-90e9-d4a6c931915d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:43.720402 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e800d67-f335-4f04-90e9-d4a6c931915d None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:43.720608 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e800d67-f335-4f04-90e9-d4a6c931915d None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:43.720882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e800d67-f335-4f04-90e9-d4a6c931915d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:43.728313 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e800d67-f335-4f04-90e9-d4a6c931915d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:43.729694 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e800d67-f335-4f04-90e9-d4a6c931915d None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:43.733367 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f342f-a536-4014-8e2e-20f4f0012ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:43.734049 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f342f-a536-4014-8e2e-20f4f0012ca8 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:43.734327 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f342f-a536-4014-8e2e-20f4f0012ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:43.734597 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f342f-a536-4014-8e2e-20f4f0012ca8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:43.735418 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f342f-a536-4014-8e2e-20f4f0012ca8 None admin] RBAC: Adding query filter params (role.id=1a453be279744db09ef4e2fcf580beac, scope.project.id=19cc5221b8074f48b5f73dc9c4289b03, user.id=94b8121d0b0d4eef818b2a8b3508df18) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:43.735713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f342f-a536-4014-8e2e-20f4f0012ca8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:43.737118 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f342f-a536-4014-8e2e-20f4f0012ca8 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:43.743913 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 331/681] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jul 15 17:24:43 2022] GET /identity/v3/role_assignments?user.id=94b8121d0b0d4eef818b2a8b3508df18&scope.project.id=19cc5221b8074f48b5f73dc9c4289b03&role.id=1a453be279744db09ef4e2fcf580beac => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:43.744065 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-2e800d67-f335-4f04-90e9-d4a6c931915d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:24:43.744065 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:43.744065 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:43.744065 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:43.744065 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:43.744065 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:43.744065 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:43.744065 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:43.744065 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:43.744065 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:43.744065 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:43.744065 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:43.744065 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 17:24:43.744065 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 17:24:43.744065 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 17:24:43.745200 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 17:24:43.745200 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:43.745200 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:43.745200 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:43.745200 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:43.745200 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:43.745200 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:43.745200 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:43.745200 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:43.745200 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:43.745200 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:43.745200 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:43.745200 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:43.745200 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:43.745200 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:43.745200 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:43.745200 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:43.746682 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 17:24:43.746682 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 17:24:43.746682 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 17:24:43.746682 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 17:24:43.746682 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 17:24:43.746682 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 17:24:43.746682 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:24:43.746682 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:43.747219 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982ccd2-0989-41f3-8b20-6d151c002d86 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:43.747219 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982ccd2-0989-41f3-8b20-6d151c002d86 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:43.747219 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982ccd2-0989-41f3-8b20-6d151c002d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:43.750101 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 351/682] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:24:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:43.751176 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e800d67-f335-4f04-90e9-d4a6c931915d None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:43.767305 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-5982ccd2-0989-41f3-8b20-6d151c002d86 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:43.768697 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-5982ccd2-0989-41f3-8b20-6d151c002d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:43.837254 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:43.859110 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 332/683] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:24:43.860496 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982ccd2-0989-41f3-8b20-6d151c002d86 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:43.890374 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e800d67-f335-4f04-90e9-d4a6c931915d None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:43.932003 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b15c73-9dad-4273-920e-8948b74da571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:43.932680 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b15c73-9dad-4273-920e-8948b74da571 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:43.932958 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b15c73-9dad-4273-920e-8948b74da571 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:43.933232 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b15c73-9dad-4273-920e-8948b74da571 None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:43.936094 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b15c73-9dad-4273-920e-8948b74da571 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:43.936094 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b15c73-9dad-4273-920e-8948b74da571 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:43.936094 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b15c73-9dad-4273-920e-8948b74da571 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:43.954285 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 352/684] 10.222.0.27 () {56 vars in 1135 bytes} [Fri Jul 15 17:24:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:43.955128 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b15c73-9dad-4273-920e-8948b74da571 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:43.987153 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982ccd2-0989-41f3-8b20-6d151c002d86 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:44.006337 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:44.031560 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5fecc-19d5-4c69-96d5-7c94b03ab488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:44.032238 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5fecc-19d5-4c69-96d5-7c94b03ab488 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:44.032523 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5fecc-19d5-4c69-96d5-7c94b03ab488 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:44.032802 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5fecc-19d5-4c69-96d5-7c94b03ab488 None admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:44.033600 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5fecc-19d5-4c69-96d5-7c94b03ab488 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:44.033942 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5fecc-19d5-4c69-96d5-7c94b03ab488 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:44.036227 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5fecc-19d5-4c69-96d5-7c94b03ab488 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:44.053897 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 333/685] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jul 15 17:24:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:44.053897 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5fecc-19d5-4c69-96d5-7c94b03ab488 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:44.076768 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b15c73-9dad-4273-920e-8948b74da571 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:44.116158 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613cad8-b610-402d-b11e-c61001677231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:44.117118 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613cad8-b610-402d-b11e-c61001677231 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:44.117493 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613cad8-b610-402d-b11e-c61001677231 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:44.117898 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613cad8-b610-402d-b11e-c61001677231 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:44.118845 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:44.129929 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b613cad8-b610-402d-b11e-c61001677231 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:24:44.137753 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-b613cad8-b610-402d-b11e-c61001677231 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:24:44.137753 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:44.137753 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:44.137753 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:44.137753 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:44.137753 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:44.137753 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:44.137753 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:44.137753 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:44.137753 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:44.137753 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:44.137753 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:44.137753 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:24:44.137753 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:24:44.137753 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:24:44.137753 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:24:44.138997 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:24:44.138997 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:24:44.138997 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:24:44.138997 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:24:44.138997 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:44.138997 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:44.138997 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:44.138997 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:44.138997 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:44.138997 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:44.138997 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:44.138997 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:44.138997 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:44.138997 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:44.138997 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:44.138997 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:44.140033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:44.140033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:44.140033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:44.140033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:44.140033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:24:44.140033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:24:44.140033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:24:44.140033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:24:44.140033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:24:44.140033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:24:44.140033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:24:44.140033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:44.146655 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 353/686] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jul 15 17:24:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:44.146655 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613cad8-b610-402d-b11e-c61001677231 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:44.197437 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5fecc-19d5-4c69-96d5-7c94b03ab488 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:44.248401 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368ee4d-458f-47d6-aaf8-d3f9449bedbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:44.249047 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368ee4d-458f-47d6-aaf8-d3f9449bedbf None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:44.249349 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368ee4d-458f-47d6-aaf8-d3f9449bedbf None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:44.249618 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368ee4d-458f-47d6-aaf8-d3f9449bedbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:44.258268 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:44.263116 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613cad8-b610-402d-b11e-c61001677231 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:44.299189 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf135c76-ebe8-45a8-a6ab-4b864dc573ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:44.299842 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf135c76-ebe8-45a8-a6ab-4b864dc573ab None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:44.300117 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf135c76-ebe8-45a8-a6ab-4b864dc573ab None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:44.300381 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf135c76-ebe8-45a8-a6ab-4b864dc573ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:44.301197 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf135c76-ebe8-45a8-a6ab-4b864dc573ab None admin] RBAC: Adding query filter params (role.id=1a453be279744db09ef4e2fcf580beac, scope.project.id=19cc5221b8074f48b5f73dc9c4289b03, user.id=989272e5e803405d87d0833d503bb572) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:44.301498 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf135c76-ebe8-45a8-a6ab-4b864dc573ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:44.302946 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf135c76-ebe8-45a8-a6ab-4b864dc573ab None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:44.319338 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 354/687] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jul 15 17:24:44 2022] GET /identity/v3/role_assignments?user.id=989272e5e803405d87d0833d503bb572&scope.project.id=19cc5221b8074f48b5f73dc9c4289b03&role.id=1a453be279744db09ef4e2fcf580beac => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:44.320633 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf135c76-ebe8-45a8-a6ab-4b864dc573ab None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:44.355703 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368ee4d-458f-47d6-aaf8-d3f9449bedbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:44.358669 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368ee4d-458f-47d6-aaf8-d3f9449bedbf None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:44.446189 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:44.503365 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 334/688] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:24:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 17:24:44.508910 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368ee4d-458f-47d6-aaf8-d3f9449bedbf None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:44.515922 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf135c76-ebe8-45a8-a6ab-4b864dc573ab None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:44.555577 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb505f6-0189-4213-8a1c-f4b7723f3fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:44.556256 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb505f6-0189-4213-8a1c-f4b7723f3fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:44.556535 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb505f6-0189-4213-8a1c-f4b7723f3fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:44.556806 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb505f6-0189-4213-8a1c-f4b7723f3fc8 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:44.557562 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb505f6-0189-4213-8a1c-f4b7723f3fc8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:44.557893 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb505f6-0189-4213-8a1c-f4b7723f3fc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:44.559262 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb505f6-0189-4213-8a1c-f4b7723f3fc8 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:44.570031 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 355/689] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:24:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:44.576836 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb505f6-0189-4213-8a1c-f4b7723f3fc8 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:44.606363 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:44.625389 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368ee4d-458f-47d6-aaf8-d3f9449bedbf None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:44.671288 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6516285-71bd-42cc-b857-05da12f02bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:44.672675 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6516285-71bd-42cc-b857-05da12f02bda None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:44.673228 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6516285-71bd-42cc-b857-05da12f02bda None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:44.673507 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6516285-71bd-42cc-b857-05da12f02bda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:44.691976 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6516285-71bd-42cc-b857-05da12f02bda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:44.694029 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6516285-71bd-42cc-b857-05da12f02bda None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:44.707567 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:44.718156 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-c6516285-71bd-42cc-b857-05da12f02bda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:44.718156 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:44.718156 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:44.718156 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:44.718156 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:44.718156 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:44.718156 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:44.718156 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:44.718156 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:44.718156 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:44.718156 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:44.718156 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:44.718156 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:44.718156 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:44.718156 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:44.719041 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:44.719041 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:44.719041 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:44.719041 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:44.719041 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:44.719041 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:44.719041 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:44.719041 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:44.719041 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:44.719041 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:44.719041 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:44.719041 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:44.719041 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:44.719041 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:44.719041 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:44.719041 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:44.719041 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:44.719926 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:44.719926 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:44.719926 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:44.719926 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:44.720142 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb505f6-0189-4213-8a1c-f4b7723f3fc8 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:44.720550 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 335/690] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:44.727079 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6516285-71bd-42cc-b857-05da12f02bda None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:44.799220 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4cc713-40f7-4c58-be99-5f81b2694c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:44.800073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cc713-40f7-4c58-be99-5f81b2694c10 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:44.800309 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cc713-40f7-4c58-be99-5f81b2694c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:44.800581 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cc713-40f7-4c58-be99-5f81b2694c10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:44.824029 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4cc713-40f7-4c58-be99-5f81b2694c10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:44.825481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4cc713-40f7-4c58-be99-5f81b2694c10 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:44.836460 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6516285-71bd-42cc-b857-05da12f02bda None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:44.855145 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-2c4cc713-40f7-4c58-be99-5f81b2694c10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:44.855145 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:44.855145 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:44.855145 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:44.855145 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:44.855145 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:44.855145 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:44.855145 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:44.855145 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:44.855145 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:44.855145 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:44.855145 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:44.855145 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:44.855145 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:44.855145 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:44.856078 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:44.856078 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:44.856078 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:44.856078 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:44.856078 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:44.856078 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:44.856078 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:44.856078 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:44.856078 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:44.856078 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:44.856078 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:44.856078 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:44.856078 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:44.856078 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:44.856078 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:44.856078 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:44.856078 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:44.857073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:44.857073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:44.857073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:44.857073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:44.862226 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 356/691] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:44.867289 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4cc713-40f7-4c58-be99-5f81b2694c10 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:44.879372 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f386e4b-4de9-4184-bc7d-51e864e88d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:44.880051 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f386e4b-4de9-4184-bc7d-51e864e88d74 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:44.880335 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f386e4b-4de9-4184-bc7d-51e864e88d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:44.880608 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f386e4b-4de9-4184-bc7d-51e864e88d74 None admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:44.881337 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f386e4b-4de9-4184-bc7d-51e864e88d74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:44.881638 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f386e4b-4de9-4184-bc7d-51e864e88d74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:44.887122 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f386e4b-4de9-4184-bc7d-51e864e88d74 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:44.912372 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 336/692] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:44.917315 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f386e4b-4de9-4184-bc7d-51e864e88d74 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:44.985551 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:45.023432 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:45.043949 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4cc713-40f7-4c58-be99-5f81b2694c10 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:45.087994 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f386e4b-4de9-4184-bc7d-51e864e88d74 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:45.107868 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81fd686-c57a-4625-9b86-85702d2b34a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:45.108575 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81fd686-c57a-4625-9b86-85702d2b34a3 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:45.110416 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81fd686-c57a-4625-9b86-85702d2b34a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:45.110794 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81fd686-c57a-4625-9b86-85702d2b34a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:45.111622 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81fd686-c57a-4625-9b86-85702d2b34a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:45.113235 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81fd686-c57a-4625-9b86-85702d2b34a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:45.116224 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81fd686-c57a-4625-9b86-85702d2b34a3 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:45.144601 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 357/693] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:24:45.146522 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf07e257-4651-4219-8365-0273380a544a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:45.147427 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07e257-4651-4219-8365-0273380a544a None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:45.147799 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07e257-4651-4219-8365-0273380a544a None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:45.148161 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07e257-4651-4219-8365-0273380a544a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:45.150551 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81fd686-c57a-4625-9b86-85702d2b34a3 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:45.156085 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf07e257-4651-4219-8365-0273380a544a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:45.157706 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf07e257-4651-4219-8365-0273380a544a None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:45.172755 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-bf07e257-4651-4219-8365-0273380a544a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:24:45.172755 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:45.172755 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:45.172755 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:45.172755 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:45.172755 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:45.172755 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:45.172755 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:45.172755 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:45.172755 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:45.172755 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:45.172755 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:45.172755 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 17:24:45.172755 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 17:24:45.172755 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 17:24:45.173940 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 17:24:45.173940 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:45.173940 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:45.173940 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:45.173940 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:45.173940 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:45.173940 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:45.173940 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:45.173940 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:45.173940 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:45.173940 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:45.173940 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:45.173940 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:45.173940 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:45.173940 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:45.173940 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:45.173940 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:45.175032 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 17:24:45.175032 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 17:24:45.175032 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 17:24:45.175032 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 17:24:45.175032 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 17:24:45.175032 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 17:24:45.175032 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:24:45.175032 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:45.177038 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 337/694] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:24:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 17:24:45.185228 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf07e257-4651-4219-8365-0273380a544a None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:45.276741 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81fd686-c57a-4625-9b86-85702d2b34a3 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:45.331851 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf07e257-4651-4219-8365-0273380a544a None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:45.349653 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ca78b-68f3-48ce-b2cd-6eb026c64b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:45.350543 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ca78b-68f3-48ce-b2cd-6eb026c64b15 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:45.350972 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ca78b-68f3-48ce-b2cd-6eb026c64b15 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:45.351253 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ca78b-68f3-48ce-b2cd-6eb026c64b15 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:45.358613 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:45.367263 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:45.368753 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5ca78b-68f3-48ce-b2cd-6eb026c64b15 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:45.371578 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5ca78b-68f3-48ce-b2cd-6eb026c64b15 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:45.384173 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1b504-4203-47a5-ad88-0b5a7bd4daff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:45.384858 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1b504-4203-47a5-ad88-0b5a7bd4daff None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:45.385138 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1b504-4203-47a5-ad88-0b5a7bd4daff None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:45.385459 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1b504-4203-47a5-ad88-0b5a7bd4daff None admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:45.386371 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d1b504-4203-47a5-ad88-0b5a7bd4daff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:45.386722 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d1b504-4203-47a5-ad88-0b5a7bd4daff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:45.388347 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d1b504-4203-47a5-ad88-0b5a7bd4daff None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:45.404381 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-fa5ca78b-68f3-48ce-b2cd-6eb026c64b15 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 17:24:45.404381 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:45.404381 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:45.404381 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:45.404381 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:45.404381 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:45.404381 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:45.404381 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:45.404381 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:45.404381 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:45.404381 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:45.404381 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:45.404381 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 17:24:45.404381 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 17:24:45.404381 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 17:24:45.404381 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 17:24:45.405717 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:45.405717 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:45.405717 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 17:24:45.405717 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:24:45.405717 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 17:24:45.405717 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:24:45.405717 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:45.405717 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:45.405717 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:45.405717 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:45.405717 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:45.405717 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:45.405717 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:45.405717 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:45.405717 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:45.405717 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:45.405717 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:45.405717 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:45.406711 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:45.406711 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:45.406711 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 17:24:45.406711 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 17:24:45.406711 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 17:24:45.406711 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 17:24:45.406711 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 17:24:45.406711 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 17:24:45.406711 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 17:24:45.406711 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:45.406711 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 358/695] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Jul 15 17:24:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 17:24:45.414619 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 338/696] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jul 15 17:24:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:45.414891 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ca78b-68f3-48ce-b2cd-6eb026c64b15 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:45.423719 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1b504-4203-47a5-ad88-0b5a7bd4daff None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:45.554210 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ca78b-68f3-48ce-b2cd-6eb026c64b15 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:45.562044 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1b504-4203-47a5-ad88-0b5a7bd4daff None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:45.595438 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e2376-54e2-4a3a-94f6-e560e7694b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:45.596413 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e2376-54e2-4a3a-94f6-e560e7694b16 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:45.596951 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e2376-54e2-4a3a-94f6-e560e7694b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:45.597362 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e2376-54e2-4a3a-94f6-e560e7694b16 None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:45.597737 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a7986b-73d5-47a0-ba47-e40c0e070e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:45.598492 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7986b-73d5-47a0-ba47-e40c0e070e1b None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:45.598778 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7986b-73d5-47a0-ba47-e40c0e070e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:45.598980 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e2376-54e2-4a3a-94f6-e560e7694b16 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:45.599082 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7986b-73d5-47a0-ba47-e40c0e070e1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:45.599341 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e2376-54e2-4a3a-94f6-e560e7694b16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:45.599942 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a7986b-73d5-47a0-ba47-e40c0e070e1b None admin] RBAC: Adding query filter params (role.id=1a453be279744db09ef4e2fcf580beac, scope.project.id=19cc5221b8074f48b5f73dc9c4289b03, user.id=9dea565b75784465a8ea073883261d7b) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:45.600199 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a7986b-73d5-47a0-ba47-e40c0e070e1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:45.600825 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e2376-54e2-4a3a-94f6-e560e7694b16 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:45.601607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a7986b-73d5-47a0-ba47-e40c0e070e1b None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:45.608762 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 339/697] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jul 15 17:24:45 2022] GET /identity/v3/role_assignments?user.id=9dea565b75784465a8ea073883261d7b&scope.project.id=19cc5221b8074f48b5f73dc9c4289b03&role.id=1a453be279744db09ef4e2fcf580beac => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:24:45.627609 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 359/698] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Jul 15 17:24:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:45.633290 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a7986b-73d5-47a0-ba47-e40c0e070e1b None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:45.686771 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:45.746018 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a7986b-73d5-47a0-ba47-e40c0e070e1b None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:45.782929 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380eb2f1-5793-4204-a2a5-74c42f45b142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:45.783595 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380eb2f1-5793-4204-a2a5-74c42f45b142 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:45.783878 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380eb2f1-5793-4204-a2a5-74c42f45b142 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:45.784156 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380eb2f1-5793-4204-a2a5-74c42f45b142 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:45.788001 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f38333-ad28-4803-a45c-ee5198a685de None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:45.788468 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f38333-ad28-4803-a45c-ee5198a685de None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:45.788545 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f38333-ad28-4803-a45c-ee5198a685de None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:45.790325 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 360/699] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:45.795918 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea6f37-da13-4292-b980-41c8fceb6fe9 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:45.796223 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea6f37-da13-4292-b980-41c8fceb6fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:45.796473 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea6f37-da13-4292-b980-41c8fceb6fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:45.855485 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-a9ea6f37-da13-4292-b980-41c8fceb6fe9 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:45.857570 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a9ea6f37-da13-4292-b980-41c8fceb6fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:45.860433 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380eb2f1-5793-4204-a2a5-74c42f45b142 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:45.861935 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380eb2f1-5793-4204-a2a5-74c42f45b142 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:45.908543 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:45.939632 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:45.963193 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 361/700] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 17:24:45.967316 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 340/701] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:24:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 17:24:45.972737 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea6f37-da13-4292-b980-41c8fceb6fe9 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:45.993943 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380eb2f1-5793-4204-a2a5-74c42f45b142 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:46.102272 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea6f37-da13-4292-b980-41c8fceb6fe9 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:46.125617 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380eb2f1-5793-4204-a2a5-74c42f45b142 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:46.144614 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53940d-3e91-42ad-aea5-684ab5d02414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:46.146177 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53940d-3e91-42ad-aea5-684ab5d02414 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:46.146664 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53940d-3e91-42ad-aea5-684ab5d02414 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:46.147159 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53940d-3e91-42ad-aea5-684ab5d02414 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:46.162433 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb53940d-3e91-42ad-aea5-684ab5d02414 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:46.162903 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1859022c-5bc5-4f07-9deb-7c333f733713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:46.163717 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859022c-5bc5-4f07-9deb-7c333f733713 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:46.163994 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859022c-5bc5-4f07-9deb-7c333f733713 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:46.164265 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859022c-5bc5-4f07-9deb-7c333f733713 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:46.165104 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb53940d-3e91-42ad-aea5-684ab5d02414 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:46.175740 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1859022c-5bc5-4f07-9deb-7c333f733713 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:46.177238 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1859022c-5bc5-4f07-9deb-7c333f733713 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:46.180219 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:46.189601 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-bb53940d-3e91-42ad-aea5-684ab5d02414 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:46.189601 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:46.189601 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:46.189601 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:46.189601 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:46.189601 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:46.189601 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:46.189601 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:46.189601 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:46.189601 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:46.189601 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:46.189601 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:46.189601 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:46.189601 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:46.189601 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:46.190639 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:46.190639 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:46.190639 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:46.190639 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:46.190639 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:46.190639 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:46.190639 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:46.190639 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:46.190639 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:46.190639 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:46.190639 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:46.190639 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:46.190639 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:46.190639 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:46.190639 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:46.190639 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:46.190639 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:46.191530 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:46.191530 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:46.191530 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:46.191530 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:46.194302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 362/702] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:46.195839 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24563432-aed1-437a-b42f-0ea505c55145 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:46.196328 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24563432-aed1-437a-b42f-0ea505c55145 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:46.196827 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24563432-aed1-437a-b42f-0ea505c55145 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:46.202369 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-1859022c-5bc5-4f07-9deb-7c333f733713 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:46.202369 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:46.202369 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:46.202369 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:46.202369 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:46.202369 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:46.202369 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:46.202369 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:46.202369 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:46.202369 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:46.202369 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:46.202369 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:46.202369 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:46.202369 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:46.202369 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:46.203515 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:46.203515 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:46.203515 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:46.203515 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:46.203515 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:46.203515 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:46.203515 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:46.203515 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:46.203515 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:46.203515 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:46.203515 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:46.203515 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:46.203515 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:46.203515 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:46.203515 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:46.203515 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:46.203515 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:46.204660 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:46.204660 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:46.204660 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:46.204660 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:46.204894 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 363/703] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:46.204894 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24563432-aed1-437a-b42f-0ea505c55145 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:46.205031 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 341/704] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 17:24:46.209105 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f5d12-c78c-45dc-823d-78ae2f82f363 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:46.209392 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f5d12-c78c-45dc-823d-78ae2f82f363 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:46.209664 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f5d12-c78c-45dc-823d-78ae2f82f363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:46.235525 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-ee1f5d12-c78c-45dc-823d-78ae2f82f363 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:46.237035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-ee1f5d12-c78c-45dc-823d-78ae2f82f363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:46.249249 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:46.321347 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 342/705] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:24:46.325828 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f5d12-c78c-45dc-823d-78ae2f82f363 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:46.334496 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24563432-aed1-437a-b42f-0ea505c55145 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:46.380837 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407852ba-8be1-4c99-af87-84491df8e913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:46.381439 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407852ba-8be1-4c99-af87-84491df8e913 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:46.381724 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407852ba-8be1-4c99-af87-84491df8e913 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:46.382049 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407852ba-8be1-4c99-af87-84491df8e913 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:46.382774 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407852ba-8be1-4c99-af87-84491df8e913 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:46.383078 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407852ba-8be1-4c99-af87-84491df8e913 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:46.384449 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407852ba-8be1-4c99-af87-84491df8e913 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:46.398813 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 364/706] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:46.399793 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407852ba-8be1-4c99-af87-84491df8e913 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:46.452323 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f5d12-c78c-45dc-823d-78ae2f82f363 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:46.482242 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:46.494413 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d87af-c2aa-468c-93c5-58d377b222de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:46.495962 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d87af-c2aa-468c-93c5-58d377b222de None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:46.496461 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d87af-c2aa-468c-93c5-58d377b222de None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:46.496932 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d87af-c2aa-468c-93c5-58d377b222de None admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:46.498695 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d87af-c2aa-468c-93c5-58d377b222de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:46.499588 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d87af-c2aa-468c-93c5-58d377b222de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:46.501473 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d87af-c2aa-468c-93c5-58d377b222de None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:46.516309 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:46.525829 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407852ba-8be1-4c99-af87-84491df8e913 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:46.526262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 343/707] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:46.528034 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d87af-c2aa-468c-93c5-58d377b222de None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:46.561162 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babbda32-1f9e-4779-bcb7-01f2eab26553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:46.562270 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbda32-1f9e-4779-bcb7-01f2eab26553 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:46.562737 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbda32-1f9e-4779-bcb7-01f2eab26553 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:46.563172 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbda32-1f9e-4779-bcb7-01f2eab26553 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:46.564021 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babbda32-1f9e-4779-bcb7-01f2eab26553 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:46.565553 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babbda32-1f9e-4779-bcb7-01f2eab26553 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:46.580389 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-babbda32-1f9e-4779-bcb7-01f2eab26553 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 17:24:46.580389 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:46.580389 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 17:24:46.580389 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 17:24:46.580389 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 17:24:46.580389 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 17:24:46.580389 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 17:24:46.580389 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:24:46.580389 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 17:24:46.580389 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:46.580389 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 17:24:46.580389 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:46.580389 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:46.580389 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:46.580389 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:46.580389 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:46.581734 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:46.581734 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:46.581734 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:46.581734 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:46.581734 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:46.581734 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:46.581734 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:46.581734 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 17:24:46.581734 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 17:24:46.581734 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 17:24:46.581734 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 17:24:46.581734 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:46.581734 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:46.581734 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:46.581734 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:46.581734 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:46.582629 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:46.582629 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:46.582629 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:46.582629 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:46.582629 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:46.582629 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:46.582629 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:46.582629 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:46.582629 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:46.582629 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:46.582629 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:46.582629 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 17:24:46.582629 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:24:46.582629 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 17:24:46.582629 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:46.585637 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 365/708] 10.222.0.27 () {56 vars in 1129 bytes} [Fri Jul 15 17:24:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:46.586694 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babbda32-1f9e-4779-bcb7-01f2eab26553 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:46.663069 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d87af-c2aa-468c-93c5-58d377b222de None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:46.707253 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf54e3-a390-4af6-98a1-2349390975cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:46.708473 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf54e3-a390-4af6-98a1-2349390975cb None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:46.708755 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf54e3-a390-4af6-98a1-2349390975cb None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:46.709039 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf54e3-a390-4af6-98a1-2349390975cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:46.715027 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babbda32-1f9e-4779-bcb7-01f2eab26553 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:46.719096 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf54e3-a390-4af6-98a1-2349390975cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:46.720579 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf54e3-a390-4af6-98a1-2349390975cb None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:46.739911 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-dbbf54e3-a390-4af6-98a1-2349390975cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:24:46.739911 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:46.739911 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:46.739911 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:46.739911 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:46.739911 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:46.739911 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:46.739911 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:46.739911 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:46.739911 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:46.739911 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:46.739911 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:46.739911 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 17:24:46.739911 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 17:24:46.739911 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 17:24:46.740864 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 17:24:46.740864 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:46.740864 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:46.740864 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:46.740864 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:46.740864 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:46.740864 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:46.740864 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:46.740864 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:46.740864 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:46.740864 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:46.740864 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:46.740864 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:46.740864 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:46.740864 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:46.740864 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:46.740864 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:46.742405 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 17:24:46.742405 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 17:24:46.742405 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 17:24:46.742405 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 17:24:46.742405 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 17:24:46.742405 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 17:24:46.742405 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:24:46.742405 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:46.742405 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 344/709] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:24:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:46.742405 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf54e3-a390-4af6-98a1-2349390975cb None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:46.757195 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff790d-513d-4d2a-9249-7db07b5313b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:46.757898 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff790d-513d-4d2a-9249-7db07b5313b3 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:46.758187 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff790d-513d-4d2a-9249-7db07b5313b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:46.758459 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff790d-513d-4d2a-9249-7db07b5313b3 None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:46.759180 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ff790d-513d-4d2a-9249-7db07b5313b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:46.760623 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ff790d-513d-4d2a-9249-7db07b5313b3 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:46.785826 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 366/710] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Jul 15 17:24:46 2022] POST /identity/v3/users => generated 254 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:24:46.785826 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff790d-513d-4d2a-9249-7db07b5313b3 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:46.808266 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:46.830227 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:46.881799 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf54e3-a390-4af6-98a1-2349390975cb None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:46.918908 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff790d-513d-4d2a-9249-7db07b5313b3 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:46.930232 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ecaaf7-03de-4ec8-9e5c-c1b4f3207cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:46.931456 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecaaf7-03de-4ec8-9e5c-c1b4f3207cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:46.931811 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecaaf7-03de-4ec8-9e5c-c1b4f3207cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:46.932172 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecaaf7-03de-4ec8-9e5c-c1b4f3207cd9 None admin] PATH_INFO: `/v3/services` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:46.933349 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ecaaf7-03de-4ec8-9e5c-c1b4f3207cd9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:46.934995 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ecaaf7-03de-4ec8-9e5c-c1b4f3207cd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:46.935759 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ecaaf7-03de-4ec8-9e5c-c1b4f3207cd9 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:46.942517 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 345/711] 10.222.0.27 () {56 vars in 1124 bytes} [Fri Jul 15 17:24:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:46.944041 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6709d-15c7-4fac-bcc1-25e495f165fd None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:46.944523 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6709d-15c7-4fac-bcc1-25e495f165fd None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:46.944976 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6709d-15c7-4fac-bcc1-25e495f165fd None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:46.946375 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 346/712] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:46.952525 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b6709d-15c7-4fac-bcc1-25e495f165fd None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:46.970783 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e04b836-8f44-4e5b-b3ff-c75ff83d46ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:46.971712 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04b836-8f44-4e5b-b3ff-c75ff83d46ba None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:46.972398 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04b836-8f44-4e5b-b3ff-c75ff83d46ba None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:46.972713 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04b836-8f44-4e5b-b3ff-c75ff83d46ba None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:46.973665 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e04b836-8f44-4e5b-b3ff-c75ff83d46ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:46.974065 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e04b836-8f44-4e5b-b3ff-c75ff83d46ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:46.975476 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e04b836-8f44-4e5b-b3ff-c75ff83d46ba None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:46.991240 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 367/713] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jul 15 17:24:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:46.992593 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d78a8c-8f6e-4f0c-b45f-d7976582221b None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:46.992886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d78a8c-8f6e-4f0c-b45f-d7976582221b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:46.993164 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d78a8c-8f6e-4f0c-b45f-d7976582221b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:47.011103 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-51d78a8c-8f6e-4f0c-b45f-d7976582221b None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:47.012313 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-51d78a8c-8f6e-4f0c-b45f-d7976582221b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:47.086707 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b6709d-15c7-4fac-bcc1-25e495f165fd None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:47.091786 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 368/714] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:24:47.092852 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d78a8c-8f6e-4f0c-b45f-d7976582221b None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:47.100002 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:47.113325 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:47.134379 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fbd179-b180-46a7-bba5-264dc7e00969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:47.136364 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbd179-b180-46a7-bba5-264dc7e00969 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:47.136844 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbd179-b180-46a7-bba5-264dc7e00969 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:47.137560 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbd179-b180-46a7-bba5-264dc7e00969 None admin] PATH_INFO: `/v3/services` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:47.139272 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fbd179-b180-46a7-bba5-264dc7e00969 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:47.139797 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fbd179-b180-46a7-bba5-264dc7e00969 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:47.142276 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fbd179-b180-46a7-bba5-264dc7e00969 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:47.149896 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 347/715] 10.222.0.27 () {56 vars in 1124 bytes} [Fri Jul 15 17:24:46 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:47.151546 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fbd179-b180-46a7-bba5-264dc7e00969 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:47.269792 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d78a8c-8f6e-4f0c-b45f-d7976582221b None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:47.325939 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fbd179-b180-46a7-bba5-264dc7e00969 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:47.351401 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d9541-8402-4f98-a0f3-bccb9c2f2752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:47.352062 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d9541-8402-4f98-a0f3-bccb9c2f2752 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:47.352340 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d9541-8402-4f98-a0f3-bccb9c2f2752 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:47.352615 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d9541-8402-4f98-a0f3-bccb9c2f2752 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:47.353450 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d9541-8402-4f98-a0f3-bccb9c2f2752 None admin] RBAC: Adding query filter params (role.id=70d242b29ede4648b639c7ddae5eaead, scope.project.id=19cc5221b8074f48b5f73dc9c4289b03, user.id=f9d548c8199e4fdbbce7597bebd63421) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:47.353754 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d9541-8402-4f98-a0f3-bccb9c2f2752 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:47.355939 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d9541-8402-4f98-a0f3-bccb9c2f2752 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:47.363306 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 369/716] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jul 15 17:24:47 2022] GET /identity/v3/role_assignments?user.id=f9d548c8199e4fdbbce7597bebd63421&scope.project.id=19cc5221b8074f48b5f73dc9c4289b03&role.id=70d242b29ede4648b639c7ddae5eaead => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:47.382387 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3606817-d46d-4874-bd6a-f34a1d219f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:47.383594 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3606817-d46d-4874-bd6a-f34a1d219f86 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:47.384086 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3606817-d46d-4874-bd6a-f34a1d219f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:47.384590 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3606817-d46d-4874-bd6a-f34a1d219f86 None admin] PATH_INFO: `/v3/services/network` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:47.385475 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3606817-d46d-4874-bd6a-f34a1d219f86 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:47.387147 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3606817-d46d-4874-bd6a-f34a1d219f86 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:47.402858 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-a3606817-d46d-4874-bd6a-f34a1d219f86 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 17:24:47.402858 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:47.402858 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 17:24:47.402858 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 17:24:47.402858 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 17:24:47.402858 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 17:24:47.402858 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 17:24:47.402858 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:24:47.402858 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 17:24:47.402858 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:47.402858 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 17:24:47.402858 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:47.402858 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:47.402858 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:47.402858 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:47.402858 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:47.402858 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:47.404011 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:47.404011 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:47.404011 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:47.404011 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:47.404011 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:47.404011 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:47.404011 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 17:24:47.404011 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 17:24:47.404011 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 17:24:47.404011 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 17:24:47.404011 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:47.404011 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:47.404011 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:47.404011 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:47.404011 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:47.404011 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:47.404857 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:47.404857 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:47.404857 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:47.404857 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:47.404857 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:47.404857 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:47.404857 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:47.404857 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:47.404857 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:47.404857 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:47.404857 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 17:24:47.404857 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:24:47.404857 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 17:24:47.404857 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:47.408101 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 348/717] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:24:47 2022] GET /identity/v3/services/network => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:47.418983 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d9541-8402-4f98-a0f3-bccb9c2f2752 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:47.542911 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:47.577481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d9541-8402-4f98-a0f3-bccb9c2f2752 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:47.620921 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d64768-403f-4f43-83be-53af06d061d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:47.621604 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d64768-403f-4f43-83be-53af06d061d9 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:47.621910 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d64768-403f-4f43-83be-53af06d061d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:47.622189 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d64768-403f-4f43-83be-53af06d061d9 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:47.622944 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d64768-403f-4f43-83be-53af06d061d9 None admin] RBAC: Adding query filter params (name=network) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:47.623252 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d64768-403f-4f43-83be-53af06d061d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:47.624632 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d64768-403f-4f43-83be-53af06d061d9 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:47.629797 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 370/718] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Jul 15 17:24:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:47.636603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3606817-d46d-4874-bd6a-f34a1d219f86 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:47.687013 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:47.769669 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3606817-d46d-4874-bd6a-f34a1d219f86 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:47.809471 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba95d53-3355-4da0-9fe4-1f5190c71d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:47.810140 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba95d53-3355-4da0-9fe4-1f5190c71d8a None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:47.810424 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba95d53-3355-4da0-9fe4-1f5190c71d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:47.810693 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba95d53-3355-4da0-9fe4-1f5190c71d8a None admin] PATH_INFO: `/v3/services` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:47.811406 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba95d53-3355-4da0-9fe4-1f5190c71d8a None admin] RBAC: Adding query filter params (type=network) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:47.811707 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba95d53-3355-4da0-9fe4-1f5190c71d8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:47.813087 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba95d53-3355-4da0-9fe4-1f5190c71d8a None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:47.823326 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 349/719] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Jul 15 17:24:47 2022] GET /identity/v3/services?type=network => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:48.142539 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640a925-b15a-44dc-8e65-453982d3ae65 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:48.142539 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640a925-b15a-44dc-8e65-453982d3ae65 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:48.142539 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640a925-b15a-44dc-8e65-453982d3ae65 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:48.143601 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 371/720] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:48.149682 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa338b39-4a90-4486-9442-06dc6e3f9d51 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:48.150685 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa338b39-4a90-4486-9442-06dc6e3f9d51 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:48.151210 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa338b39-4a90-4486-9442-06dc6e3f9d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:48.169795 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-aa338b39-4a90-4486-9442-06dc6e3f9d51 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:48.172236 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-aa338b39-4a90-4486-9442-06dc6e3f9d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:48.240823 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 350/721] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:24:48.263465 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f640a925-b15a-44dc-8e65-453982d3ae65 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:48.406808 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f640a925-b15a-44dc-8e65-453982d3ae65 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:48.457571 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ac26c-6fc0-4089-8d44-498560acfb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:48.458413 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ac26c-6fc0-4089-8d44-498560acfb00 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:48.458697 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ac26c-6fc0-4089-8d44-498560acfb00 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:48.458975 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ac26c-6fc0-4089-8d44-498560acfb00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:48.460962 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:48.475205 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ac26c-6fc0-4089-8d44-498560acfb00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:24:48.484461 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-128ac26c-6fc0-4089-8d44-498560acfb00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:24:48.484461 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:48.484461 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:48.484461 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:48.484461 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:48.484461 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:48.484461 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:48.484461 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:48.484461 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:48.484461 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:48.484461 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:48.484461 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:48.484461 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:24:48.484461 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:24:48.484461 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:24:48.484461 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:24:48.485427 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:24:48.485427 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:24:48.485427 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:24:48.485427 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:24:48.485427 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:48.485427 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:48.485427 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:48.485427 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:48.485427 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:48.485427 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:48.485427 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:48.485427 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:48.485427 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:48.485427 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:48.485427 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:48.485427 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:48.486351 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:48.486351 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:48.486351 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:48.486351 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:48.486351 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:24:48.486351 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:24:48.486351 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:24:48.486351 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:24:48.486351 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:24:48.486351 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:24:48.486351 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:24:48.486351 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:48.488787 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 372/722] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jul 15 17:24:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:48.498937 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa338b39-4a90-4486-9442-06dc6e3f9d51 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:48.542206 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:48.637415 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa338b39-4a90-4486-9442-06dc6e3f9d51 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:48.689965 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ea019-774c-49de-a728-62f017e607ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:48.691004 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ea019-774c-49de-a728-62f017e607ef None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:48.691503 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ea019-774c-49de-a728-62f017e607ef None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:48.691987 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ea019-774c-49de-a728-62f017e607ef None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:48.692945 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ea019-774c-49de-a728-62f017e607ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:48.693479 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ea019-774c-49de-a728-62f017e607ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:48.695086 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ea019-774c-49de-a728-62f017e607ef None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:48.709855 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 351/723] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:24:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:48.715553 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ac26c-6fc0-4089-8d44-498560acfb00 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:48.850151 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ac26c-6fc0-4089-8d44-498560acfb00 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:48.895492 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cb84e-7ad1-45b3-ad42-3ac91ffb89e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:48.896292 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cb84e-7ad1-45b3-ad42-3ac91ffb89e2 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:48.896572 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cb84e-7ad1-45b3-ad42-3ac91ffb89e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:48.896844 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cb84e-7ad1-45b3-ad42-3ac91ffb89e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:48.917937 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4cb84e-7ad1-45b3-ad42-3ac91ffb89e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:48.919569 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4cb84e-7ad1-45b3-ad42-3ac91ffb89e2 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:48.940742 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-9b4cb84e-7ad1-45b3-ad42-3ac91ffb89e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:48.940742 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:48.940742 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:48.940742 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:48.940742 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:48.940742 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:48.940742 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:48.940742 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:48.940742 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:48.940742 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:48.940742 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:48.940742 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:48.940742 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:48.940742 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:48.940742 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:48.941705 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:48.941705 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:48.941705 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:48.941705 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:48.941705 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:48.941705 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:48.941705 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:48.941705 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:48.941705 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:48.941705 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:48.941705 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:48.941705 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:48.941705 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:48.941705 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:48.941705 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:48.941705 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:48.941705 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:48.942714 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:48.942714 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:48.942714 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:48.942714 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:48.942714 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 373/724] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:48.947469 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ea019-774c-49de-a728-62f017e607ef None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:49.062855 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:49.072450 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ea019-774c-49de-a728-62f017e607ef None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:49.111100 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee522cb-40df-4d4d-bf0f-c13223e81ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:49.111765 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee522cb-40df-4d4d-bf0f-c13223e81ae4 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:49.112041 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee522cb-40df-4d4d-bf0f-c13223e81ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:49.112305 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee522cb-40df-4d4d-bf0f-c13223e81ae4 None admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:49.113019 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee522cb-40df-4d4d-bf0f-c13223e81ae4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:49.113320 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee522cb-40df-4d4d-bf0f-c13223e81ae4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:49.114711 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee522cb-40df-4d4d-bf0f-c13223e81ae4 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:49.126465 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 352/725] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:49.134869 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cb84e-7ad1-45b3-ad42-3ac91ffb89e2 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:49.226591 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:49.244626 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e59e98-2d3e-4319-9866-a57b3723cb14 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:49.245130 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e59e98-2d3e-4319-9866-a57b3723cb14 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:49.245208 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e59e98-2d3e-4319-9866-a57b3723cb14 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:49.246817 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 353/726] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 17:24:49.253931 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7723eb1-b585-4e1b-bb51-e8acf9f41e6c None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:49.254219 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7723eb1-b585-4e1b-bb51-e8acf9f41e6c None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:49.254497 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7723eb1-b585-4e1b-bb51-e8acf9f41e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:49.282119 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-b7723eb1-b585-4e1b-bb51-e8acf9f41e6c None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:49.283325 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-b7723eb1-b585-4e1b-bb51-e8acf9f41e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:49.311657 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cb84e-7ad1-45b3-ad42-3ac91ffb89e2 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:49.371547 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56300e-3a8a-405d-a2ba-cfc5fe951eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:49.372382 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56300e-3a8a-405d-a2ba-cfc5fe951eef None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:49.372695 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56300e-3a8a-405d-a2ba-cfc5fe951eef None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:49.373030 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56300e-3a8a-405d-a2ba-cfc5fe951eef None admin] PATH_INFO: `/v3/users/swift` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:49.386119 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e56300e-3a8a-405d-a2ba-cfc5fe951eef None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:49.387568 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e56300e-3a8a-405d-a2ba-cfc5fe951eef None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:49.412536 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 354/727] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 17:24:49.413135 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-5e56300e-3a8a-405d-a2ba-cfc5fe951eef None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 15 17:24:49.413135 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:49.413135 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:49.413135 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:49.413135 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:49.413135 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:49.413135 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:49.413135 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:49.413135 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:49.413135 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:49.413135 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:49.413135 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:49.413135 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 17:24:49.413135 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 17:24:49.413135 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 17:24:49.413135 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 17:24:49.414073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:49.414073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:49.414073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 17:24:49.414073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:24:49.414073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 17:24:49.414073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:24:49.414073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:49.414073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:49.414073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:49.414073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:49.414073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:49.414073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:49.414073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:49.414073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:49.414073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:49.414073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:49.414073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:49.414073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:49.414993 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:49.414993 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:49.414993 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 17:24:49.414993 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 17:24:49.414993 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 17:24:49.414993 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 17:24:49.414993 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 17:24:49.414993 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 17:24:49.414993 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 15 17:24:49.414993 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:49.418879 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 374/728] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jul 15 17:24:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:49.424306 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7723eb1-b585-4e1b-bb51-e8acf9f41e6c None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:49.462360 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56300e-3a8a-405d-a2ba-cfc5fe951eef None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:49.548364 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:49.566397 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7723eb1-b585-4e1b-bb51-e8acf9f41e6c None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:49.612590 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680f1e7-0a75-4c0d-8462-d53506372faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:49.613650 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680f1e7-0a75-4c0d-8462-d53506372faa None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:49.614099 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680f1e7-0a75-4c0d-8462-d53506372faa None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:49.614572 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680f1e7-0a75-4c0d-8462-d53506372faa None admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:49.616045 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680f1e7-0a75-4c0d-8462-d53506372faa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:49.616619 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680f1e7-0a75-4c0d-8462-d53506372faa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:49.618528 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680f1e7-0a75-4c0d-8462-d53506372faa None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:49.637956 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 355/729] 10.222.0.27 () {56 vars in 1135 bytes} [Fri Jul 15 17:24:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:24:49.643517 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680f1e7-0a75-4c0d-8462-d53506372faa None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:49.659666 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56300e-3a8a-405d-a2ba-cfc5fe951eef None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:49.667447 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:49.700960 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b53673e-5485-4b53-aa9b-563a48120130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:49.702360 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53673e-5485-4b53-aa9b-563a48120130 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:49.704659 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53673e-5485-4b53-aa9b-563a48120130 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:49.705154 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53673e-5485-4b53-aa9b-563a48120130 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:49.726825 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b53673e-5485-4b53-aa9b-563a48120130 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:24:49.737230 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-3b53673e-5485-4b53-aa9b-563a48120130 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 17:24:49.737230 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:49.737230 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:49.737230 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:49.737230 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:49.737230 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:49.737230 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:49.737230 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:49.737230 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:49.737230 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:49.737230 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:49.737230 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:49.737230 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:24:49.737230 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:24:49.737230 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:24:49.737230 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:24:49.738221 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:24:49.738221 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:24:49.738221 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:24:49.738221 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:24:49.738221 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:49.738221 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:49.738221 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:49.738221 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:49.738221 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:49.738221 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:49.738221 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:49.738221 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:49.738221 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:49.738221 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:49.738221 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:49.738221 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:49.739106 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:49.739106 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:49.739106 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:49.739106 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:49.739106 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:24:49.739106 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:24:49.739106 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:24:49.739106 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:24:49.739106 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:24:49.739106 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:24:49.739106 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 17:24:49.739106 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:49.741932 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 375/730] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Jul 15 17:24:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 17:24:49.743713 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800c2cd-f473-4292-885e-3f5930c0b8bc None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:49.744003 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800c2cd-f473-4292-885e-3f5930c0b8bc None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:49.744283 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800c2cd-f473-4292-885e-3f5930c0b8bc None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:49.745719 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 376/731] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:49.747029 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800c2cd-f473-4292-885e-3f5930c0b8bc None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:49.796201 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680f1e7-0a75-4c0d-8462-d53506372faa None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:49.831722 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef710b-8895-4ffd-8a06-52500d079f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:49.832735 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef710b-8895-4ffd-8a06-52500d079f5d None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:49.833283 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef710b-8895-4ffd-8a06-52500d079f5d None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:49.833747 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef710b-8895-4ffd-8a06-52500d079f5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:49.850136 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:49.861086 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800c2cd-f473-4292-885e-3f5930c0b8bc None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:49.897388 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf3e0b-130d-4ebd-87ec-c92b18b83f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:49.898093 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf3e0b-130d-4ebd-87ec-c92b18b83f81 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:49.898430 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf3e0b-130d-4ebd-87ec-c92b18b83f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:49.898703 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf3e0b-130d-4ebd-87ec-c92b18b83f81 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:49.899505 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bf3e0b-130d-4ebd-87ec-c92b18b83f81 None admin] RBAC: Adding query filter params (name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:49.899814 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bf3e0b-130d-4ebd-87ec-c92b18b83f81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:49.901183 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bf3e0b-130d-4ebd-87ec-c92b18b83f81 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:49.911983 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 377/732] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Jul 15 17:24:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:49.913383 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ad2ac-c43d-4d2e-b7f5-208846a0a878 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:49.913909 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ad2ac-c43d-4d2e-b7f5-208846a0a878 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:49.914219 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ad2ac-c43d-4d2e-b7f5-208846a0a878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:49.926616 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef710b-8895-4ffd-8a06-52500d079f5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:49.928252 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef710b-8895-4ffd-8a06-52500d079f5d None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:49.931288 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-140ad2ac-c43d-4d2e-b7f5-208846a0a878 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:49.932471 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-140ad2ac-c43d-4d2e-b7f5-208846a0a878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:49.956169 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:50.001203 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 378/733] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:24:50.002564 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c722edd-9afb-4cd8-9fdd-393f36921080 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:50.002854 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c722edd-9afb-4cd8-9fdd-393f36921080 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:50.003130 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c722edd-9afb-4cd8-9fdd-393f36921080 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:50.004516 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 379/734] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:50.009109 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c722edd-9afb-4cd8-9fdd-393f36921080 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:50.045232 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 356/735] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:24:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 17:24:50.046915 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a64513-8032-4a86-bcc9-d4ed783a2062 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:50.047379 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a64513-8032-4a86-bcc9-d4ed783a2062 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:50.047820 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a64513-8032-4a86-bcc9-d4ed783a2062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:50.066194 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-92a64513-8032-4a86-bcc9-d4ed783a2062 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:50.067503 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-92a64513-8032-4a86-bcc9-d4ed783a2062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:50.105039 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:50.119715 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c722edd-9afb-4cd8-9fdd-393f36921080 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:50.138865 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 357/736] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:24:50.139689 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a64513-8032-4a86-bcc9-d4ed783a2062 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:50.159213 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b1dd9-c9a9-4018-a433-eedf1b26cce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:50.160023 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b1dd9-c9a9-4018-a433-eedf1b26cce4 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:50.160306 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b1dd9-c9a9-4018-a433-eedf1b26cce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:50.160585 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b1dd9-c9a9-4018-a433-eedf1b26cce4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:50.171285 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6b1dd9-c9a9-4018-a433-eedf1b26cce4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:50.172770 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6b1dd9-c9a9-4018-a433-eedf1b26cce4 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:50.190971 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-ec6b1dd9-c9a9-4018-a433-eedf1b26cce4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:50.190971 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:50.190971 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:50.190971 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:50.190971 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:50.190971 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:50.190971 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:50.190971 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:50.190971 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:50.190971 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:50.190971 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:50.190971 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:50.190971 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:50.190971 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:50.190971 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:50.191914 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:50.191914 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:50.191914 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:50.191914 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:50.191914 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:50.191914 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:50.191914 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:50.191914 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:50.191914 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:50.191914 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:50.191914 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:50.191914 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:50.191914 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:50.191914 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:50.191914 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:50.191914 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:50.191914 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:50.192908 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:50.192908 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:50.192908 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:50.192908 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:50.192908 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 380/737] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:50.193188 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b1dd9-c9a9-4018-a433-eedf1b26cce4 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:50.206526 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:50.262893 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a64513-8032-4a86-bcc9-d4ed783a2062 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:50.294080 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b1dd9-c9a9-4018-a433-eedf1b26cce4 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:50.299602 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145b5bb-3ef0-4f9e-b9ab-ea5ff3120511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:50.300510 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145b5bb-3ef0-4f9e-b9ab-ea5ff3120511 None admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:50.301139 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145b5bb-3ef0-4f9e-b9ab-ea5ff3120511 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:50.301500 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145b5bb-3ef0-4f9e-b9ab-ea5ff3120511 None admin] PATH_INFO: `/v3/services` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:50.302264 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7145b5bb-3ef0-4f9e-b9ab-ea5ff3120511 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:50.306462 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7145b5bb-3ef0-4f9e-b9ab-ea5ff3120511 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:50.330202 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 358/738] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Jul 15 17:24:50 2022] POST /identity/v3/services => generated 251 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:24:50.332481 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145b5bb-3ef0-4f9e-b9ab-ea5ff3120511 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:50.348720 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af431f77-ffdc-49a0-b3df-4160c212732c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:50.350251 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af431f77-ffdc-49a0-b3df-4160c212732c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:50.350703 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af431f77-ffdc-49a0-b3df-4160c212732c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:50.351161 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af431f77-ffdc-49a0-b3df-4160c212732c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:50.368813 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af431f77-ffdc-49a0-b3df-4160c212732c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:50.371207 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af431f77-ffdc-49a0-b3df-4160c212732c None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:50.372343 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:50.400116 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-af431f77-ffdc-49a0-b3df-4160c212732c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:50.400116 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:50.400116 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:50.400116 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:50.400116 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:50.400116 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:50.400116 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:50.400116 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:50.400116 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:50.400116 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:50.400116 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:50.400116 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:50.400116 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:50.400116 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:50.400116 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:50.401291 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:50.401291 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:50.401291 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:50.401291 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:50.401291 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:50.401291 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:50.401291 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:50.401291 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:50.401291 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:50.401291 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:50.401291 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:50.401291 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:50.401291 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:50.401291 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:50.401291 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:50.401291 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:50.401291 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:50.402414 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:50.402414 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:50.402414 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:50.402414 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:50.405303 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 381/739] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:50.406686 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af431f77-ffdc-49a0-b3df-4160c212732c None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:50.457900 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145b5bb-3ef0-4f9e-b9ab-ea5ff3120511 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:50.478463 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:50.499657 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47adaf9-b15a-40c8-97dc-391112597286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:50.500486 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47adaf9-b15a-40c8-97dc-391112597286 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:50.500764 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47adaf9-b15a-40c8-97dc-391112597286 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:50.501036 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47adaf9-b15a-40c8-97dc-391112597286 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:50.513116 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47adaf9-b15a-40c8-97dc-391112597286 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:24:50.521056 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-c47adaf9-b15a-40c8-97dc-391112597286 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:24:50.521056 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:50.521056 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:50.521056 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:50.521056 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:50.521056 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:50.521056 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:50.521056 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:50.521056 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:50.521056 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:50.521056 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:50.521056 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:50.521056 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:24:50.521056 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:24:50.521056 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:24:50.521056 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:24:50.522252 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:24:50.522252 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:24:50.522252 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:24:50.522252 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:24:50.522252 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:50.522252 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:50.522252 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:50.522252 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:50.522252 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:50.522252 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:50.522252 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:50.522252 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:50.522252 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:50.522252 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:50.522252 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:50.522252 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:50.523786 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:50.523786 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:50.523786 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:50.523786 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:50.523786 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:24:50.523786 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:24:50.523786 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:24:50.523786 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:24:50.523786 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:24:50.523786 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:24:50.523786 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:24:50.523786 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:50.523786 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 359/740] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jul 15 17:24:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:50.523786 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47adaf9-b15a-40c8-97dc-391112597286 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:50.531701 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af431f77-ffdc-49a0-b3df-4160c212732c None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:50.565937 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9559f104-e7b1-44a2-b4d1-f2df3a81fd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:50.566615 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559f104-e7b1-44a2-b4d1-f2df3a81fd80 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:50.566898 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559f104-e7b1-44a2-b4d1-f2df3a81fd80 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:50.567171 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559f104-e7b1-44a2-b4d1-f2df3a81fd80 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:50.567896 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9559f104-e7b1-44a2-b4d1-f2df3a81fd80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:50.568203 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9559f104-e7b1-44a2-b4d1-f2df3a81fd80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:50.570052 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9559f104-e7b1-44a2-b4d1-f2df3a81fd80 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:50.625458 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:50.636222 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47adaf9-b15a-40c8-97dc-391112597286 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:50.675815 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438a259-6dbc-474a-b511-5057be00d9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:50.676499 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438a259-6dbc-474a-b511-5057be00d9db None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:50.676781 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438a259-6dbc-474a-b511-5057be00d9db None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:50.677062 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438a259-6dbc-474a-b511-5057be00d9db None admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:50.677824 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1438a259-6dbc-474a-b511-5057be00d9db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:50.678121 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1438a259-6dbc-474a-b511-5057be00d9db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:50.679501 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1438a259-6dbc-474a-b511-5057be00d9db None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:50.697539 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 360/741] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:50.697539 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c149346-9b06-4598-819e-3d73b49042fc None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:50.697539 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c149346-9b06-4598-819e-3d73b49042fc None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:50.697539 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c149346-9b06-4598-819e-3d73b49042fc None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:50.700679 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 361/742] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:50.701456 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c149346-9b06-4598-819e-3d73b49042fc None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:50.702695 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 382/743] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:50.703521 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9559f104-e7b1-44a2-b4d1-f2df3a81fd80 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:50.809129 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9559f104-e7b1-44a2-b4d1-f2df3a81fd80 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:50.817251 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c149346-9b06-4598-819e-3d73b49042fc None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:50.828149 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:50.846494 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be382cd-b8ca-4b1b-b573-fb5938c26e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:50.847276 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be382cd-b8ca-4b1b-b573-fb5938c26e5f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:50.847556 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be382cd-b8ca-4b1b-b573-fb5938c26e5f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:50.847826 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be382cd-b8ca-4b1b-b573-fb5938c26e5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:50.854447 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be382cd-b8ca-4b1b-b573-fb5938c26e5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:50.855907 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be382cd-b8ca-4b1b-b573-fb5938c26e5f None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:50.859254 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1367b-6838-46cf-9c74-679e4685ed6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:50.860144 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1367b-6838-46cf-9c74-679e4685ed6c None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:50.860630 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1367b-6838-46cf-9c74-679e4685ed6c None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:50.861103 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1367b-6838-46cf-9c74-679e4685ed6c None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:50.862065 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c1367b-6838-46cf-9c74-679e4685ed6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:50.862550 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c1367b-6838-46cf-9c74-679e4685ed6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:50.864146 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c1367b-6838-46cf-9c74-679e4685ed6c None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:50.869534 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-6be382cd-b8ca-4b1b-b573-fb5938c26e5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:24:50.869534 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:50.869534 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:50.869534 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:50.869534 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:50.869534 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:50.869534 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:50.869534 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:50.869534 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:50.869534 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:50.869534 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:50.869534 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:50.869534 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 17:24:50.869534 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 17:24:50.869534 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 17:24:50.870482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 17:24:50.870482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:50.870482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:50.870482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:50.870482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:50.870482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:50.870482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:50.870482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:50.870482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:50.870482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:50.870482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:50.870482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:50.870482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:50.870482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:50.870482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:50.870482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:50.870482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:50.871389 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 17:24:50.871389 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 17:24:50.871389 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 17:24:50.871389 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 17:24:50.871389 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 17:24:50.871389 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 17:24:50.871389 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:24:50.871389 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:50.878213 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 362/744] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:24:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:50.878213 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c6de0-2840-4e56-a3bd-b92ef4069a1f None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:50.878213 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c6de0-2840-4e56-a3bd-b92ef4069a1f None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:50.878499 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 383/745] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:24:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:50.878575 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c6de0-2840-4e56-a3bd-b92ef4069a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:50.878645 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be382cd-b8ca-4b1b-b573-fb5938c26e5f None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:50.894489 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-b07c6de0-2840-4e56-a3bd-b92ef4069a1f None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:50.895679 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-b07c6de0-2840-4e56-a3bd-b92ef4069a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:50.906369 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:50.973930 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 363/746] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:50 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 17:24:50.974818 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c6de0-2840-4e56-a3bd-b92ef4069a1f None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:50.981200 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be382cd-b8ca-4b1b-b573-fb5938c26e5f None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:51.017000 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c1b88-121e-49bd-90a3-8a8bcca65b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:51.017878 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c1b88-121e-49bd-90a3-8a8bcca65b8d None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:51.018134 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c1b88-121e-49bd-90a3-8a8bcca65b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:51.018401 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c1b88-121e-49bd-90a3-8a8bcca65b8d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:51.025479 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c1b88-121e-49bd-90a3-8a8bcca65b8d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:51.026943 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c1b88-121e-49bd-90a3-8a8bcca65b8d None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:51.042285 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-a62c1b88-121e-49bd-90a3-8a8bcca65b8d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 17:24:51.042285 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:51.042285 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:51.042285 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:51.042285 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:51.042285 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:51.042285 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:51.042285 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:51.042285 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:51.042285 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:51.042285 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:51.042285 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:51.042285 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 17:24:51.042285 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 17:24:51.042285 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 17:24:51.042285 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 17:24:51.043374 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:51.043374 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:51.043374 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 17:24:51.043374 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:24:51.043374 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 17:24:51.043374 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:24:51.043374 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:51.043374 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:51.043374 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:51.043374 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:51.043374 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:51.043374 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:51.043374 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:51.043374 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:51.043374 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:51.043374 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:51.043374 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:51.043374 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:51.044504 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:51.044504 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:51.044504 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 17:24:51.044504 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 17:24:51.044504 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 17:24:51.044504 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 17:24:51.044504 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 17:24:51.044504 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 17:24:51.044504 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 17:24:51.044504 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:51.044504 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 384/747] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Jul 15 17:24:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:51.044504 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c1b88-121e-49bd-90a3-8a8bcca65b8d None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:51.086668 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:51.095756 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c6de0-2840-4e56-a3bd-b92ef4069a1f None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:51.130366 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b31e4b-33b6-4216-bdc4-db1e540bad9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:51.130958 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b31e4b-33b6-4216-bdc4-db1e540bad9f None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:51.131236 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b31e4b-33b6-4216-bdc4-db1e540bad9f None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:51.131503 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b31e4b-33b6-4216-bdc4-db1e540bad9f None admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:51.132287 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b31e4b-33b6-4216-bdc4-db1e540bad9f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:51.132603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b31e4b-33b6-4216-bdc4-db1e540bad9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:51.134054 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b31e4b-33b6-4216-bdc4-db1e540bad9f None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:51.146027 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 364/748] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jul 15 17:24:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:51.146799 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b31e4b-33b6-4216-bdc4-db1e540bad9f None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:51.151486 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:51.159519 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c1b88-121e-49bd-90a3-8a8bcca65b8d None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:51.197021 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa56136-95c2-46e6-9fa4-4adfdb6a68d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:51.197835 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa56136-95c2-46e6-9fa4-4adfdb6a68d8 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:51.198120 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa56136-95c2-46e6-9fa4-4adfdb6a68d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:51.198463 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa56136-95c2-46e6-9fa4-4adfdb6a68d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:51.208867 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa56136-95c2-46e6-9fa4-4adfdb6a68d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:51.210335 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa56136-95c2-46e6-9fa4-4adfdb6a68d8 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:51.229632 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-2fa56136-95c2-46e6-9fa4-4adfdb6a68d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:51.229632 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:51.229632 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:51.229632 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:51.229632 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:51.229632 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:51.229632 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:51.229632 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:51.229632 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:51.229632 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:51.229632 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:51.229632 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:51.229632 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:51.229632 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:51.229632 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:51.230667 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:51.230667 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:51.230667 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:51.230667 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:51.230667 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:51.230667 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:51.230667 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:51.230667 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:51.230667 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:51.230667 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:51.230667 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:51.230667 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:51.230667 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:51.230667 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:51.230667 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:51.230667 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:51.230667 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:51.231576 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:51.231576 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:51.231576 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:51.231576 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:51.236980 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 385/749] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:51.236980 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa56136-95c2-46e6-9fa4-4adfdb6a68d8 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:51.253746 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b31e4b-33b6-4216-bdc4-db1e540bad9f None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:51.288794 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7dba9-2621-49d2-88d3-dc7c37db1efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:51.289458 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7dba9-2621-49d2-88d3-dc7c37db1efc None admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:51.289737 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7dba9-2621-49d2-88d3-dc7c37db1efc None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:51.290055 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7dba9-2621-49d2-88d3-dc7c37db1efc None admin] PATH_INFO: `/v3/services` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:51.290780 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7dba9-2621-49d2-88d3-dc7c37db1efc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:51.292159 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7dba9-2621-49d2-88d3-dc7c37db1efc None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:51.309886 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 365/750] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Jul 15 17:24:51 2022] POST /identity/v3/services => generated 240 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:24:51.310577 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7dba9-2621-49d2-88d3-dc7c37db1efc None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:51.361328 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:51.375847 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa56136-95c2-46e6-9fa4-4adfdb6a68d8 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:51.396736 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:51.434916 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbafb47f-5157-479d-9b0e-20116a8f4444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:51.435885 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafb47f-5157-479d-9b0e-20116a8f4444 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:51.436228 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafb47f-5157-479d-9b0e-20116a8f4444 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:51.436615 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafb47f-5157-479d-9b0e-20116a8f4444 None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:51.438206 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbafb47f-5157-479d-9b0e-20116a8f4444 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:51.438718 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbafb47f-5157-479d-9b0e-20116a8f4444 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:51.440549 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbafb47f-5157-479d-9b0e-20116a8f4444 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:51.451763 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7dba9-2621-49d2-88d3-dc7c37db1efc None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:51.466419 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 386/751] 10.222.0.27 () {56 vars in 1149 bytes} [Fri Jul 15 17:24:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:51.467805 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbafb47f-5157-479d-9b0e-20116a8f4444 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:51.499899 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d58e25-898c-4d77-bb68-86a08168c13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:51.500892 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d58e25-898c-4d77-bb68-86a08168c13a None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:51.501171 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d58e25-898c-4d77-bb68-86a08168c13a None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:51.501814 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d58e25-898c-4d77-bb68-86a08168c13a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:51.502314 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d58e25-898c-4d77-bb68-86a08168c13a None admin] RBAC: Adding query filter params (role.id=70d242b29ede4648b639c7ddae5eaead, scope.project.id=19cc5221b8074f48b5f73dc9c4289b03, user.id=9dea565b75784465a8ea073883261d7b) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:51.502622 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d58e25-898c-4d77-bb68-86a08168c13a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:51.504051 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d58e25-898c-4d77-bb68-86a08168c13a None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:51.510458 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 366/752] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jul 15 17:24:51 2022] GET /identity/v3/role_assignments?user.id=9dea565b75784465a8ea073883261d7b&scope.project.id=19cc5221b8074f48b5f73dc9c4289b03&role.id=70d242b29ede4648b639c7ddae5eaead => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:51.511255 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d58e25-898c-4d77-bb68-86a08168c13a None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:51.592955 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbafb47f-5157-479d-9b0e-20116a8f4444 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:51.637945 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07951d-45a3-4afa-b52b-61b233df5db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:51.638913 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07951d-45a3-4afa-b52b-61b233df5db1 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:51.639179 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07951d-45a3-4afa-b52b-61b233df5db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:51.639534 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07951d-45a3-4afa-b52b-61b233df5db1 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:51.640418 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c07951d-45a3-4afa-b52b-61b233df5db1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:51.640802 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c07951d-45a3-4afa-b52b-61b233df5db1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:51.642290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c07951d-45a3-4afa-b52b-61b233df5db1 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:51.643973 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d58e25-898c-4d77-bb68-86a08168c13a None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:51.659572 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 387/753] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:51.661183 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07951d-45a3-4afa-b52b-61b233df5db1 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:51.667555 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:51.692719 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:51.706080 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0c094-94b1-4edc-92ee-c529126f0a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:51.707472 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0c094-94b1-4edc-92ee-c529126f0a11 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:51.707992 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0c094-94b1-4edc-92ee-c529126f0a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:51.708712 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0c094-94b1-4edc-92ee-c529126f0a11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:51.788703 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c0c094-94b1-4edc-92ee-c529126f0a11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:51.789642 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07951d-45a3-4afa-b52b-61b233df5db1 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:51.790181 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c0c094-94b1-4edc-92ee-c529126f0a11 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:51.825766 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d74c8b-6b66-4660-b5bc-f516d2cc475b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:51.826587 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d74c8b-6b66-4660-b5bc-f516d2cc475b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:51.826872 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d74c8b-6b66-4660-b5bc-f516d2cc475b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:51.827139 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d74c8b-6b66-4660-b5bc-f516d2cc475b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:51.837323 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d74c8b-6b66-4660-b5bc-f516d2cc475b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:51.838800 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d74c8b-6b66-4660-b5bc-f516d2cc475b None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:51.857379 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-c6d74c8b-6b66-4660-b5bc-f516d2cc475b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 17:24:51.857379 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:51.857379 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:51.857379 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:51.857379 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:51.857379 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:51.857379 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:51.857379 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:51.857379 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:51.857379 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:51.857379 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:51.857379 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:51.857379 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 17:24:51.857379 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 17:24:51.857379 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 17:24:51.857379 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 17:24:51.858395 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:51.858395 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:51.858395 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 17:24:51.858395 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:24:51.858395 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 17:24:51.858395 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:24:51.858395 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:51.858395 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:51.858395 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:51.858395 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:51.858395 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:51.858395 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:51.858395 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:51.858395 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:51.858395 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:51.858395 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:51.858395 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:51.858395 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:51.859344 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:51.859344 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:51.859344 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 17:24:51.859344 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 17:24:51.859344 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 17:24:51.859344 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 17:24:51.859344 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 17:24:51.859344 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 17:24:51.859344 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 17:24:51.859344 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:51.859870 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 388/754] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Jul 15 17:24:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:51.868761 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d74c8b-6b66-4660-b5bc-f516d2cc475b None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:51.915528 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 367/755] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:24:51 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 17:24:51.922859 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0c094-94b1-4edc-92ee-c529126f0a11 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:51.953349 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:51.972234 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:52.036830 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0c094-94b1-4edc-92ee-c529126f0a11 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:52.062995 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d74c8b-6b66-4660-b5bc-f516d2cc475b None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:52.076912 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca32202-bbd2-433d-9a8f-c01310d16769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:52.078120 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca32202-bbd2-433d-9a8f-c01310d16769 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:52.078596 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca32202-bbd2-433d-9a8f-c01310d16769 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:52.079058 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca32202-bbd2-433d-9a8f-c01310d16769 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:52.092755 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca32202-bbd2-433d-9a8f-c01310d16769 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:52.095000 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca32202-bbd2-433d-9a8f-c01310d16769 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:52.116258 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-4ca32202-bbd2-433d-9a8f-c01310d16769 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:52.116258 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:52.116258 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:52.116258 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:52.116258 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:52.116258 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:52.116258 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:52.116258 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:52.116258 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:52.116258 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:52.116258 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:52.116258 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:52.116258 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:52.116258 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:52.116258 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:52.117197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:52.117197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:52.117197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:52.117197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:52.117197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:52.117197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:52.117197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:52.117197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:52.117197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:52.117197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:52.117197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:52.117197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:52.117197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:52.117197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:52.117197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:52.117197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:52.117197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:52.118208 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:52.118208 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:52.118208 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:52.118208 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:52.121044 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 368/756] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:52.126779 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca32202-bbd2-433d-9a8f-c01310d16769 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:52.138580 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd09cf-e7df-4186-9cfd-c85a20da20ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:52.139278 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd09cf-e7df-4186-9cfd-c85a20da20ec None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:52.139562 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd09cf-e7df-4186-9cfd-c85a20da20ec None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:52.139841 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd09cf-e7df-4186-9cfd-c85a20da20ec None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:52.140929 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd09cf-e7df-4186-9cfd-c85a20da20ec None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:52.141051 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd09cf-e7df-4186-9cfd-c85a20da20ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:52.142451 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd09cf-e7df-4186-9cfd-c85a20da20ec None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:52.181561 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 389/757] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Jul 15 17:24:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:52.187097 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd09cf-e7df-4186-9cfd-c85a20da20ec None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:52.219262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:52.242980 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca32202-bbd2-433d-9a8f-c01310d16769 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:52.340290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd09cf-e7df-4186-9cfd-c85a20da20ec None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:52.346489 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a962e95-b5c8-462e-add7-c4068d1a864a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:52.347174 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a962e95-b5c8-462e-add7-c4068d1a864a None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:52.347451 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a962e95-b5c8-462e-add7-c4068d1a864a None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:52.347718 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a962e95-b5c8-462e-add7-c4068d1a864a None admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:52.348450 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a962e95-b5c8-462e-add7-c4068d1a864a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:52.348749 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a962e95-b5c8-462e-add7-c4068d1a864a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:52.350129 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a962e95-b5c8-462e-add7-c4068d1a864a None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:52.370232 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:52.380634 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa958aaa-c10d-4a0e-aaf2-38d9e6529865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:52.381761 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa958aaa-c10d-4a0e-aaf2-38d9e6529865 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:52.382270 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa958aaa-c10d-4a0e-aaf2-38d9e6529865 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:52.382738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa958aaa-c10d-4a0e-aaf2-38d9e6529865 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:52.384095 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 369/758] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:24:52.394349 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a962e95-b5c8-462e-add7-c4068d1a864a None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:52.399014 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa958aaa-c10d-4a0e-aaf2-38d9e6529865 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:52.400979 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa958aaa-c10d-4a0e-aaf2-38d9e6529865 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:52.421481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-fa958aaa-c10d-4a0e-aaf2-38d9e6529865 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:52.421481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:52.421481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:52.421481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:52.421481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:52.421481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:52.421481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:52.421481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:52.421481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:52.421481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:52.421481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:52.421481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:52.421481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:52.421481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:52.421481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:52.422474 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:52.422474 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:52.422474 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:52.422474 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:52.422474 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:52.422474 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:52.422474 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:52.422474 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:52.422474 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:52.422474 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:52.422474 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:52.422474 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:52.422474 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:52.422474 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:52.422474 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:52.422474 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:52.422474 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:52.423360 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:52.423360 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:52.423360 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:52.423360 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:52.425960 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 390/759] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 17:24:52.431058 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa958aaa-c10d-4a0e-aaf2-38d9e6529865 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:52.534793 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa958aaa-c10d-4a0e-aaf2-38d9e6529865 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:52.578283 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b644a4-a308-45cc-a349-b5512093dce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:52.579204 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b644a4-a308-45cc-a349-b5512093dce9 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:52.579486 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b644a4-a308-45cc-a349-b5512093dce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:52.580936 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b644a4-a308-45cc-a349-b5512093dce9 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:52.581730 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b644a4-a308-45cc-a349-b5512093dce9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:52.582060 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b644a4-a308-45cc-a349-b5512093dce9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:52.583505 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b644a4-a308-45cc-a349-b5512093dce9 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:52.602123 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 391/760] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:24:52.607640 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b644a4-a308-45cc-a349-b5512093dce9 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:52.621571 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a962e95-b5c8-462e-add7-c4068d1a864a None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:52.654160 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:52.663098 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdbfef8-2df9-43a8-b9b4-af3282fdb990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:52.664810 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbfef8-2df9-43a8-b9b4-af3282fdb990 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:52.665298 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbfef8-2df9-43a8-b9b4-af3282fdb990 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:52.666141 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbfef8-2df9-43a8-b9b4-af3282fdb990 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:52.676712 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdbfef8-2df9-43a8-b9b4-af3282fdb990 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:52.679283 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdbfef8-2df9-43a8-b9b4-af3282fdb990 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:52.683247 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:52.702122 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-2cdbfef8-2df9-43a8-b9b4-af3282fdb990 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:24:52.702122 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:52.702122 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:52.702122 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:52.702122 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:52.702122 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:52.702122 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:52.702122 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:52.702122 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:52.702122 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:52.702122 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:52.702122 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:52.702122 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 17:24:52.702122 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 17:24:52.702122 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 17:24:52.703040 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 17:24:52.703040 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:52.703040 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:52.703040 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:52.703040 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:52.703040 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:52.703040 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:52.703040 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:52.703040 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:52.703040 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:52.703040 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:52.703040 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:52.703040 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:52.703040 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:52.703040 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:52.703040 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:52.703040 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:52.703963 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 17:24:52.703963 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 17:24:52.703963 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 17:24:52.703963 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 17:24:52.703963 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 17:24:52.703963 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 17:24:52.703963 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:24:52.703963 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:52.707049 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 370/761] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:24:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:52.709216 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c93fd0-73eb-495a-a2ba-b5713cf5a9c2 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:52.709642 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c93fd0-73eb-495a-a2ba-b5713cf5a9c2 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:52.710086 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c93fd0-73eb-495a-a2ba-b5713cf5a9c2 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:52.716095 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 371/762] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:52.716095 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c93fd0-73eb-495a-a2ba-b5713cf5a9c2 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:52.733653 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b644a4-a308-45cc-a349-b5512093dce9 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:52.770184 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8baa6-b51b-4bd9-9b42-702755f631d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:52.771472 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8baa6-b51b-4bd9-9b42-702755f631d3 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:52.771472 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8baa6-b51b-4bd9-9b42-702755f631d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:52.771793 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8baa6-b51b-4bd9-9b42-702755f631d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:52.784208 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8baa6-b51b-4bd9-9b42-702755f631d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:52.785807 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8baa6-b51b-4bd9-9b42-702755f631d3 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:52.800715 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-f4b8baa6-b51b-4bd9-9b42-702755f631d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:24:52.800715 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:52.800715 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:52.800715 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:52.800715 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:52.800715 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:52.800715 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:52.800715 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:52.800715 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:52.800715 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:52.800715 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:52.800715 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:52.800715 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 17:24:52.800715 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 17:24:52.800715 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 17:24:52.801673 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 17:24:52.801673 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:52.801673 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:52.801673 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:52.801673 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:52.801673 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:52.801673 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:52.801673 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:52.801673 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:52.801673 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:52.801673 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:52.801673 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:52.801673 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:52.801673 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:52.801673 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:52.801673 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:52.801673 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:52.802608 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 17:24:52.802608 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 17:24:52.802608 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 17:24:52.802608 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 17:24:52.802608 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 17:24:52.802608 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 17:24:52.802608 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:24:52.802608 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:52.807171 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 392/763] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:24:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:52.808664 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf7edd-8aa1-4c2f-b5f7-97854c349b8a None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:52.808948 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf7edd-8aa1-4c2f-b5f7-97854c349b8a None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:52.809227 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf7edd-8aa1-4c2f-b5f7-97854c349b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:52.828889 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-6caf7edd-8aa1-4c2f-b5f7-97854c349b8a None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:52.830141 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-6caf7edd-8aa1-4c2f-b5f7-97854c349b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:52.854018 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c93fd0-73eb-495a-a2ba-b5713cf5a9c2 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:52.891331 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30269a-6840-4577-8f81-99d84d50ec07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:52.892056 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30269a-6840-4577-8f81-99d84d50ec07 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:52.892334 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30269a-6840-4577-8f81-99d84d50ec07 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:52.892604 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30269a-6840-4577-8f81-99d84d50ec07 None admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:52.893685 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d30269a-6840-4577-8f81-99d84d50ec07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:52.894068 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d30269a-6840-4577-8f81-99d84d50ec07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:52.895775 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d30269a-6840-4577-8f81-99d84d50ec07 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:52.911015 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 372/764] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jul 15 17:24:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:52.911989 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30269a-6840-4577-8f81-99d84d50ec07 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:52.919082 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 393/765] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:24:52.919082 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf7edd-8aa1-4c2f-b5f7-97854c349b8a None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:52.956874 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:53.004851 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:53.036237 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf7edd-8aa1-4c2f-b5f7-97854c349b8a None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:53.059221 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30269a-6840-4577-8f81-99d84d50ec07 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:53.074166 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb0a3d-20ed-469b-9600-319d816ef18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:53.074941 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb0a3d-20ed-469b-9600-319d816ef18e None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:53.075312 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb0a3d-20ed-469b-9600-319d816ef18e None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:53.075705 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb0a3d-20ed-469b-9600-319d816ef18e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:53.076882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eb0a3d-20ed-469b-9600-319d816ef18e None admin] RBAC: Adding query filter params (role.id=1a453be279744db09ef4e2fcf580beac, scope.project.id=19cc5221b8074f48b5f73dc9c4289b03, user.id=b73d09bd7c1e4753a45cfdb00cc5abe9) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:53.077285 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eb0a3d-20ed-469b-9600-319d816ef18e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:53.078929 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eb0a3d-20ed-469b-9600-319d816ef18e None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:53.086051 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 394/766] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jul 15 17:24:52 2022] GET /identity/v3/role_assignments?user.id=b73d09bd7c1e4753a45cfdb00cc5abe9&scope.project.id=19cc5221b8074f48b5f73dc9c4289b03&role.id=1a453be279744db09ef4e2fcf580beac => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:53.087047 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb0a3d-20ed-469b-9600-319d816ef18e None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:53.102130 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a5e01-eb69-4abd-94be-76aa158f92ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:53.103260 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a5e01-eb69-4abd-94be-76aa158f92ea None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:53.103720 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a5e01-eb69-4abd-94be-76aa158f92ea None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:53.104180 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a5e01-eb69-4abd-94be-76aa158f92ea None admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:53.105169 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833a5e01-eb69-4abd-94be-76aa158f92ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:53.105677 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833a5e01-eb69-4abd-94be-76aa158f92ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:53.108554 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833a5e01-eb69-4abd-94be-76aa158f92ea None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:53.124639 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 373/767] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jul 15 17:24:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:53.137418 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a5e01-eb69-4abd-94be-76aa158f92ea None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:53.261241 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a5e01-eb69-4abd-94be-76aa158f92ea None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:53.282742 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:53.297827 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb0a3d-20ed-469b-9600-319d816ef18e None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:53.298019 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:53.312715 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bfacf5-4d8e-4322-9d5f-af0162fb561f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:53.314540 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfacf5-4d8e-4322-9d5f-af0162fb561f None admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:53.315838 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfacf5-4d8e-4322-9d5f-af0162fb561f None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:53.316317 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfacf5-4d8e-4322-9d5f-af0162fb561f None admin] PATH_INFO: `/v3/projects/19cc5221b8074f48b5f73dc9c4289b03/users/f9d548c8199e4fdbbce7597bebd63421/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:53.319420 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bfacf5-4d8e-4322-9d5f-af0162fb561f None admin] RBAC: Authorizing `identity:create_grant(project_id=19cc5221b8074f48b5f73dc9c4289b03, user_id=f9d548c8199e4fdbbce7597bebd63421, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:53.321642 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bfacf5-4d8e-4322-9d5f-af0162fb561f None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:53.339863 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 374/768] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Jul 15 17:24:53 2022] PUT /identity/v3/projects/19cc5221b8074f48b5f73dc9c4289b03/users/f9d548c8199e4fdbbce7597bebd63421/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:24:53.383705 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec717ee-1e97-4900-9d53-7461bda04ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:53.384545 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec717ee-1e97-4900-9d53-7461bda04ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:53.384826 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec717ee-1e97-4900-9d53-7461bda04ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:53.385204 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec717ee-1e97-4900-9d53-7461bda04ca6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:53.386424 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec717ee-1e97-4900-9d53-7461bda04ca6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:53.387354 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec717ee-1e97-4900-9d53-7461bda04ca6 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:53.405454 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-0ec717ee-1e97-4900-9d53-7461bda04ca6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 17:24:53.405454 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:53.405454 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 17:24:53.405454 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 17:24:53.405454 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 17:24:53.405454 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 17:24:53.405454 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 17:24:53.405454 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:24:53.405454 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 17:24:53.405454 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:53.405454 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 17:24:53.405454 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:53.405454 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:53.405454 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:53.405454 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:53.405454 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:53.406482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:53.406482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:53.406482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:53.406482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:53.406482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:53.406482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:53.406482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:53.406482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 17:24:53.406482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 17:24:53.406482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 17:24:53.406482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 17:24:53.406482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:53.406482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:53.406482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:53.406482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:53.406482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:53.407342 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:53.407342 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:53.407342 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:53.407342 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:53.407342 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:53.407342 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:53.407342 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:53.407342 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:53.407342 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:53.407342 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:53.407342 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:53.407342 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 17:24:53.407342 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:24:53.407342 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 17:24:53.407342 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:53.407342 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 395/769] 10.222.0.27 () {56 vars in 1129 bytes} [Fri Jul 15 17:24:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:53.414716 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bfacf5-4d8e-4322-9d5f-af0162fb561f None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:53.644110 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bfacf5-4d8e-4322-9d5f-af0162fb561f None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:53.679221 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c20141-249e-4856-a185-3b112717b502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:53.680285 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c20141-249e-4856-a185-3b112717b502 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:53.680784 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c20141-249e-4856-a185-3b112717b502 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:53.681250 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c20141-249e-4856-a185-3b112717b502 None admin] PATH_INFO: `/v3/services` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:53.682186 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c20141-249e-4856-a185-3b112717b502 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:53.682685 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c20141-249e-4856-a185-3b112717b502 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:53.684261 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c20141-249e-4856-a185-3b112717b502 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:53.689510 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 375/770] 10.222.0.27 () {56 vars in 1124 bytes} [Fri Jul 15 17:24:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:53.695944 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec717ee-1e97-4900-9d53-7461bda04ca6 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:53.766610 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033d553-ed77-416e-971a-c008a78c2ebf None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:53.767774 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033d553-ed77-416e-971a-c008a78c2ebf None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:53.768276 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033d553-ed77-416e-971a-c008a78c2ebf None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:53.770683 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 376/771] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:53.778562 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6c10b-99a8-4e4b-a2e4-f5040ddf2e68 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:53.779560 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6c10b-99a8-4e4b-a2e4-f5040ddf2e68 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:53.780039 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6c10b-99a8-4e4b-a2e4-f5040ddf2e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:53.805309 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-dbf6c10b-99a8-4e4b-a2e4-f5040ddf2e68 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:53.806526 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-dbf6c10b-99a8-4e4b-a2e4-f5040ddf2e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:53.824863 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec717ee-1e97-4900-9d53-7461bda04ca6 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:53.853930 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:53.886287 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 377/772] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:24:53.909019 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9648c5-5763-4c53-9ea2-23e7e997e70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:53.909613 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9648c5-5763-4c53-9ea2-23e7e997e70e None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:53.909926 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9648c5-5763-4c53-9ea2-23e7e997e70e None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:53.910202 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9648c5-5763-4c53-9ea2-23e7e997e70e None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:53.910919 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9648c5-5763-4c53-9ea2-23e7e997e70e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:53.911221 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9648c5-5763-4c53-9ea2-23e7e997e70e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:53.912655 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9648c5-5763-4c53-9ea2-23e7e997e70e None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:53.920105 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 396/773] 10.222.0.27 () {56 vars in 1124 bytes} [Fri Jul 15 17:24:53 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:53.925937 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6c10b-99a8-4e4b-a2e4-f5040ddf2e68 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:53.940400 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9648c5-5763-4c53-9ea2-23e7e997e70e None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:53.964011 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:54.054754 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9648c5-5763-4c53-9ea2-23e7e997e70e None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:54.067404 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6c10b-99a8-4e4b-a2e4-f5040ddf2e68 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:54.092730 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a489045-ea36-4e6f-bdf9-33f740634f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:54.093536 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a489045-ea36-4e6f-bdf9-33f740634f8d None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:54.093869 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a489045-ea36-4e6f-bdf9-33f740634f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:54.094146 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a489045-ea36-4e6f-bdf9-33f740634f8d None admin] PATH_INFO: `/v3/services/network` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:54.094927 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a489045-ea36-4e6f-bdf9-33f740634f8d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:54.096403 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a489045-ea36-4e6f-bdf9-33f740634f8d None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:54.103690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7af8d-e360-4f74-9e05-9e3c00c3d8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:54.104612 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7af8d-e360-4f74-9e05-9e3c00c3d8d3 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:54.105091 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7af8d-e360-4f74-9e05-9e3c00c3d8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:54.105574 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7af8d-e360-4f74-9e05-9e3c00c3d8d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:54.106619 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b7af8d-e360-4f74-9e05-9e3c00c3d8d3 None admin] RBAC: Adding query filter params (interface=public, service_id=5664ec52651b47ec9acf7e69dc0b91e6, region_id=RegionOne) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:54.107128 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b7af8d-e360-4f74-9e05-9e3c00c3d8d3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:54.108677 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b7af8d-e360-4f74-9e05-9e3c00c3d8d3 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:54.109141 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-4a489045-ea36-4e6f-bdf9-33f740634f8d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 17:24:54.109141 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:54.109141 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 17:24:54.109141 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 17:24:54.109141 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 17:24:54.109141 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 17:24:54.109141 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 17:24:54.109141 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:24:54.109141 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 17:24:54.109141 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:54.109141 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 17:24:54.109141 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:54.109141 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:54.109141 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:54.109141 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:54.109141 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:54.109141 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:54.110323 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:54.110323 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:54.110323 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:54.110323 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:54.110323 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:54.110323 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:54.110323 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 17:24:54.110323 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 17:24:54.110323 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 17:24:54.110323 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 17:24:54.110323 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:54.110323 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:54.110323 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:54.110323 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:54.110323 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:54.110323 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:54.111163 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:54.111163 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:54.111163 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:54.111163 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:54.111163 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:54.111163 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:54.111163 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:54.111163 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:54.111163 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:54.111163 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:54.111163 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 17:24:54.111163 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:24:54.111163 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 17:24:54.111163 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:54.111163 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 397/774] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:24:53 2022] GET /identity/v3/services/network => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:54.111940 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77cd76-b7d6-4cee-9613-6c6e50cfd8da None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:54.112393 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77cd76-b7d6-4cee-9613-6c6e50cfd8da None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:54.112494 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77cd76-b7d6-4cee-9613-6c6e50cfd8da None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:54.117808 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 398/775] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:54.117808 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77cd76-b7d6-4cee-9613-6c6e50cfd8da None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:54.129886 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 378/776] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Jul 15 17:24:53 2022] GET /identity/v3/endpoints?service_id=5664ec52651b47ec9acf7e69dc0b91e6&interface=public®ion_id=RegionOne => generated 194 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:54.131510 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cff385-471e-45cc-8e28-e5e1f177ced3 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:54.132023 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cff385-471e-45cc-8e28-e5e1f177ced3 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:54.132504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cff385-471e-45cc-8e28-e5e1f177ced3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:54.149330 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-52cff385-471e-45cc-8e28-e5e1f177ced3 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:54.150832 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-52cff385-471e-45cc-8e28-e5e1f177ced3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:54.180483 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:54.206614 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:54.225954 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 379/777] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:24:54.227178 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cff385-471e-45cc-8e28-e5e1f177ced3 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:54.229255 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77cd76-b7d6-4cee-9613-6c6e50cfd8da None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:54.271582 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5c295-dc3b-4d53-bb2e-9a5a8c9a839e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:54.271582 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5c295-dc3b-4d53-bb2e-9a5a8c9a839e None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:54.271582 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5c295-dc3b-4d53-bb2e-9a5a8c9a839e None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:54.271582 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5c295-dc3b-4d53-bb2e-9a5a8c9a839e None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:54.272010 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b5c295-dc3b-4d53-bb2e-9a5a8c9a839e None admin] RBAC: Adding query filter params (name=network) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:54.272010 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b5c295-dc3b-4d53-bb2e-9a5a8c9a839e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:54.272010 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b5c295-dc3b-4d53-bb2e-9a5a8c9a839e None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:54.277336 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 399/778] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Jul 15 17:24:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:54.278264 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5c295-dc3b-4d53-bb2e-9a5a8c9a839e None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:54.349016 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cff385-471e-45cc-8e28-e5e1f177ced3 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:54.384359 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4015e00-ea92-4e9d-ac19-8a65925e9a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:54.385210 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4015e00-ea92-4e9d-ac19-8a65925e9a5a None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:54.385590 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4015e00-ea92-4e9d-ac19-8a65925e9a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:54.385988 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4015e00-ea92-4e9d-ac19-8a65925e9a5a None admin] PATH_INFO: `/v3/services` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:54.386782 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4015e00-ea92-4e9d-ac19-8a65925e9a5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:54.388343 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4015e00-ea92-4e9d-ac19-8a65925e9a5a None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:54.388473 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5c295-dc3b-4d53-bb2e-9a5a8c9a839e None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:54.398114 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 380/779] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Jul 15 17:24:54 2022] GET /identity/v3/services => generated 772 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:54.399133 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4015e00-ea92-4e9d-ac19-8a65925e9a5a None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:54.426970 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2252f65-e68e-4473-985e-c3e0ef485041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:54.427893 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2252f65-e68e-4473-985e-c3e0ef485041 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:54.428173 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2252f65-e68e-4473-985e-c3e0ef485041 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:54.428441 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2252f65-e68e-4473-985e-c3e0ef485041 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:54.441033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2252f65-e68e-4473-985e-c3e0ef485041 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:24:54.449264 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-e2252f65-e68e-4473-985e-c3e0ef485041 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:24:54.449264 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:54.449264 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:54.449264 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:54.449264 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:54.449264 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:54.449264 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:54.449264 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:54.449264 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:54.449264 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:54.449264 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:54.449264 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:54.449264 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:24:54.449264 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:24:54.449264 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:24:54.449264 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:24:54.451663 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:24:54.451663 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:24:54.451663 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:24:54.451663 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:24:54.451663 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:54.451663 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:54.451663 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:54.451663 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:54.451663 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:54.451663 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:54.451663 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:54.451663 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:54.451663 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:54.451663 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:54.451663 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:54.451663 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:54.454060 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:54.454060 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:54.454060 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:54.454060 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:54.454060 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:24:54.454060 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:24:54.454060 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:24:54.454060 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:24:54.454060 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:24:54.454060 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:24:54.454060 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:24:54.454060 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:54.455919 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:54.456399 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 400/780] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jul 15 17:24:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:54.465815 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2252f65-e68e-4473-985e-c3e0ef485041 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:54.472094 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:54.532718 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4015e00-ea92-4e9d-ac19-8a65925e9a5a None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:54.570985 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ffc8e-6dec-4262-a4b6-d538b4ecbd2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:54.571706 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ffc8e-6dec-4262-a4b6-d538b4ecbd2d None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:54.571988 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ffc8e-6dec-4262-a4b6-d538b4ecbd2d None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:54.572258 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ffc8e-6dec-4262-a4b6-d538b4ecbd2d None admin] PATH_INFO: `/v3/services` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:54.572968 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ffc8e-6dec-4262-a4b6-d538b4ecbd2d None admin] RBAC: Adding query filter params (type=network) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:54.573269 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ffc8e-6dec-4262-a4b6-d538b4ecbd2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:54.574692 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ffc8e-6dec-4262-a4b6-d538b4ecbd2d None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:54.581928 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 381/781] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Jul 15 17:24:54 2022] GET /identity/v3/services?type=network => generated 350 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:54.590921 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ffc8e-6dec-4262-a4b6-d538b4ecbd2d None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:54.681253 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2252f65-e68e-4473-985e-c3e0ef485041 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:54.718594 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137fb64a-15ca-46a4-8900-4f7693b0f712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:54.719202 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fb64a-15ca-46a4-8900-4f7693b0f712 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:54.719489 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fb64a-15ca-46a4-8900-4f7693b0f712 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:54.719758 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fb64a-15ca-46a4-8900-4f7693b0f712 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:54.720602 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137fb64a-15ca-46a4-8900-4f7693b0f712 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:54.720906 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137fb64a-15ca-46a4-8900-4f7693b0f712 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:54.723294 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137fb64a-15ca-46a4-8900-4f7693b0f712 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:54.733073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 401/782] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:24:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:24:54.740231 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:54.742801 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137fb64a-15ca-46a4-8900-4f7693b0f712 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:54.747710 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ffc8e-6dec-4262-a4b6-d538b4ecbd2d None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:54.788952 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120763e-e9a7-4942-bce2-7ec1a957287d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:54.789614 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120763e-e9a7-4942-bce2-7ec1a957287d None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:54.789934 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120763e-e9a7-4942-bce2-7ec1a957287d None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:54.790201 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120763e-e9a7-4942-bce2-7ec1a957287d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:54.790982 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9120763e-e9a7-4942-bce2-7ec1a957287d None admin] RBAC: Adding query filter params (interface=public, service_id=57f5a91d605d4f5687c518151cbee09d, region_id=RegionOne) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:54.791283 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9120763e-e9a7-4942-bce2-7ec1a957287d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:54.793154 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9120763e-e9a7-4942-bce2-7ec1a957287d None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:54.799236 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 382/783] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Jul 15 17:24:54 2022] GET /identity/v3/endpoints?service_id=57f5a91d605d4f5687c518151cbee09d&interface=public®ion_id=RegionOne => generated 194 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:54.806626 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120763e-e9a7-4942-bce2-7ec1a957287d None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:54.854620 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:54.908961 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137fb64a-15ca-46a4-8900-4f7693b0f712 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:54.965157 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d94b61-41e8-4add-9979-8e697b169194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:54.966070 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d94b61-41e8-4add-9979-8e697b169194 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:54.966351 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d94b61-41e8-4add-9979-8e697b169194 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:54.966841 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d94b61-41e8-4add-9979-8e697b169194 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:54.982709 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d94b61-41e8-4add-9979-8e697b169194 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:54.984097 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d94b61-41e8-4add-9979-8e697b169194 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:54.986336 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120763e-e9a7-4942-bce2-7ec1a957287d None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:55.012313 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-69d94b61-41e8-4add-9979-8e697b169194 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:55.012313 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:55.012313 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:55.012313 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:55.012313 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:55.012313 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:55.012313 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:55.012313 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:55.012313 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:55.012313 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:55.012313 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:55.012313 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:55.012313 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:55.012313 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:55.012313 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:55.013339 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:55.013339 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:55.013339 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:55.013339 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:55.013339 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:55.013339 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:55.013339 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:55.013339 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:55.013339 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:55.013339 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:55.013339 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:55.013339 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:55.013339 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:55.013339 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:55.013339 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:55.013339 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:55.013339 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:55.014274 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:55.014274 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:55.014274 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:55.014274 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:55.016999 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 402/784] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:55.022818 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d94b61-41e8-4add-9979-8e697b169194 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:55.062666 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e611e-5ae7-47e1-a42b-116624a2b545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:55.063760 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e611e-5ae7-47e1-a42b-116624a2b545 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:55.064258 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e611e-5ae7-47e1-a42b-116624a2b545 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:55.064852 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e611e-5ae7-47e1-a42b-116624a2b545 None admin] PATH_INFO: `/v3/services` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:55.066105 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479e611e-5ae7-47e1-a42b-116624a2b545 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:55.068076 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479e611e-5ae7-47e1-a42b-116624a2b545 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:55.075398 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 383/785] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Jul 15 17:24:54 2022] GET /identity/v3/services => generated 772 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:24:55.156132 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d94b61-41e8-4add-9979-8e697b169194 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:55.186308 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:55.195328 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f7a04-8e77-4806-8ae5-41caffaf767b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:55.196343 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f7a04-8e77-4806-8ae5-41caffaf767b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:55.196822 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f7a04-8e77-4806-8ae5-41caffaf767b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:55.197294 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f7a04-8e77-4806-8ae5-41caffaf767b None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:55.198277 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f7a04-8e77-4806-8ae5-41caffaf767b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:55.198854 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f7a04-8e77-4806-8ae5-41caffaf767b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:55.200482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f7a04-8e77-4806-8ae5-41caffaf767b None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:55.216568 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 403/786] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:55.222520 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e611e-5ae7-47e1-a42b-116624a2b545 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:55.250919 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:55.333754 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e611e-5ae7-47e1-a42b-116624a2b545 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:55.370638 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644911d9-de08-4520-b01e-825fb338c1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:55.371453 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644911d9-de08-4520-b01e-825fb338c1d3 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:55.371732 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644911d9-de08-4520-b01e-825fb338c1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:55.372003 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644911d9-de08-4520-b01e-825fb338c1d3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:55.380491 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644911d9-de08-4520-b01e-825fb338c1d3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:55.381979 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644911d9-de08-4520-b01e-825fb338c1d3 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:55.397504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-644911d9-de08-4520-b01e-825fb338c1d3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 15 17:24:55.397504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:55.397504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:55.397504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:55.397504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:55.397504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:55.397504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:55.397504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:55.397504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:55.397504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:55.397504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:55.397504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:55.397504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 17:24:55.397504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 17:24:55.397504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 17:24:55.397504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 17:24:55.398518 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:55.398518 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:55.398518 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 17:24:55.398518 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:24:55.398518 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 17:24:55.398518 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:24:55.398518 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:55.398518 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:55.398518 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:55.398518 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:55.398518 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:55.398518 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:55.398518 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:55.398518 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:55.398518 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:55.398518 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:55.398518 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:55.398518 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:55.399441 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:55.399441 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:55.399441 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 17:24:55.399441 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 17:24:55.399441 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 17:24:55.399441 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 17:24:55.399441 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 17:24:55.399441 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 17:24:55.399441 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 15 17:24:55.399441 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:55.399441 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 384/787] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jul 15 17:24:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:55.404987 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f7a04-8e77-4806-8ae5-41caffaf767b None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:55.423213 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ab933-06a3-4140-9931-4f71281fb281 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:55.423825 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ab933-06a3-4140-9931-4f71281fb281 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:55.424173 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ab933-06a3-4140-9931-4f71281fb281 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:55.429452 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 385/788] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 17:24:55.431135 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a4bdf-419d-4a4c-885b-485ed1221033 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:55.431507 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a4bdf-419d-4a4c-885b-485ed1221033 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:55.431848 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a4bdf-419d-4a4c-885b-485ed1221033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:55.450608 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-9c2a4bdf-419d-4a4c-885b-485ed1221033 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:55.451943 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-9c2a4bdf-419d-4a4c-885b-485ed1221033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:55.519841 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f7a04-8e77-4806-8ae5-41caffaf767b None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:55.524544 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 386/789] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:24:55.556158 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e91c8-9f8c-4ba4-9e6a-cf28f357362e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:55.556825 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e91c8-9f8c-4ba4-9e6a-cf28f357362e None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:55.557102 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e91c8-9f8c-4ba4-9e6a-cf28f357362e None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:55.557369 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e91c8-9f8c-4ba4-9e6a-cf28f357362e None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:55.558252 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e91c8-9f8c-4ba4-9e6a-cf28f357362e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:55.558601 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e91c8-9f8c-4ba4-9e6a-cf28f357362e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:55.559901 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a4bdf-419d-4a4c-885b-485ed1221033 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:55.560433 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e91c8-9f8c-4ba4-9e6a-cf28f357362e None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:55.576937 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:55.590182 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 404/790] 10.222.0.27 () {56 vars in 1135 bytes} [Fri Jul 15 17:24:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:55.596011 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e91c8-9f8c-4ba4-9e6a-cf28f357362e None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:55.665017 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:55.667435 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a4bdf-419d-4a4c-885b-485ed1221033 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:55.704871 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151742e0-49c8-480d-86d0-57259ebd3277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:55.706035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151742e0-49c8-480d-86d0-57259ebd3277 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:55.706405 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151742e0-49c8-480d-86d0-57259ebd3277 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:55.706682 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151742e0-49c8-480d-86d0-57259ebd3277 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:55.717709 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151742e0-49c8-480d-86d0-57259ebd3277 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:24:55.725833 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-151742e0-49c8-480d-86d0-57259ebd3277 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 17:24:55.725833 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:55.725833 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:55.725833 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:55.725833 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:55.725833 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:55.725833 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:55.725833 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:55.725833 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:55.725833 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:55.725833 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:55.725833 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:55.725833 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:24:55.725833 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:24:55.725833 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:24:55.725833 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:24:55.726745 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:24:55.726745 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:24:55.726745 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:24:55.726745 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:24:55.726745 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:55.726745 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:55.726745 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:55.726745 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:55.726745 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:55.726745 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:55.726745 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:55.726745 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:55.726745 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:55.726745 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:55.726745 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:55.726745 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:55.727592 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:55.727592 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:55.727592 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:55.727592 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:55.727592 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:24:55.727592 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:24:55.727592 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:24:55.727592 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:24:55.727592 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:24:55.727592 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:24:55.727592 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 17:24:55.727592 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:55.727592 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 387/791] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Jul 15 17:24:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:55.738910 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151742e0-49c8-480d-86d0-57259ebd3277 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:55.762162 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e91c8-9f8c-4ba4-9e6a-cf28f357362e None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:55.798866 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10da6b5-068f-4d54-847b-e531a1b5f561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:55.799674 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10da6b5-068f-4d54-847b-e531a1b5f561 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:55.799952 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10da6b5-068f-4d54-847b-e531a1b5f561 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:55.800384 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10da6b5-068f-4d54-847b-e531a1b5f561 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:55.814998 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10da6b5-068f-4d54-847b-e531a1b5f561 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:55.817209 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10da6b5-068f-4d54-847b-e531a1b5f561 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:55.834050 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:55.842995 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-a10da6b5-068f-4d54-847b-e531a1b5f561 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:55.842995 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:55.842995 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:55.842995 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:55.842995 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:55.842995 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:55.842995 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:55.842995 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:55.842995 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:55.842995 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:55.842995 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:55.842995 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:55.842995 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:55.842995 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:55.842995 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:55.844217 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:55.844217 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:55.844217 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:55.844217 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:55.844217 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:55.844217 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:55.844217 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:55.844217 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:55.844217 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:55.844217 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:55.844217 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:55.844217 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:55.844217 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:55.844217 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:55.844217 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:55.844217 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:55.844217 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:55.845574 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:55.845574 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:55.845574 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:55.845574 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:55.845574 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 405/792] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 17:24:55.848466 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e58322-70d1-4843-8ac1-6108eecea54d None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:55.848466 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e58322-70d1-4843-8ac1-6108eecea54d None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:55.848466 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e58322-70d1-4843-8ac1-6108eecea54d None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:55.849185 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 406/793] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:55.852622 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e58322-70d1-4843-8ac1-6108eecea54d None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:55.869255 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151742e0-49c8-480d-86d0-57259ebd3277 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:55.914283 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64600aa0-4c8c-4fa8-a5be-1c9ad983fc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:55.914954 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64600aa0-4c8c-4fa8-a5be-1c9ad983fc2f None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:55.915279 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64600aa0-4c8c-4fa8-a5be-1c9ad983fc2f None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:55.915993 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64600aa0-4c8c-4fa8-a5be-1c9ad983fc2f None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:55.916800 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64600aa0-4c8c-4fa8-a5be-1c9ad983fc2f None admin] RBAC: Adding query filter params (name=service) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:55.917381 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64600aa0-4c8c-4fa8-a5be-1c9ad983fc2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:55.918968 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64600aa0-4c8c-4fa8-a5be-1c9ad983fc2f None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:55.930595 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 388/794] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Jul 15 17:24:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:55.932109 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb15db-84a2-4fae-bc1f-a7f0d3bf4c2a None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:55.932548 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb15db-84a2-4fae-bc1f-a7f0d3bf4c2a None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:55.932873 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb15db-84a2-4fae-bc1f-a7f0d3bf4c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:55.956162 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-b3cb15db-84a2-4fae-bc1f-a7f0d3bf4c2a None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:55.957351 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-b3cb15db-84a2-4fae-bc1f-a7f0d3bf4c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:55.960216 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:55.975299 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e58322-70d1-4843-8ac1-6108eecea54d None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:56.010881 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed6dd75-932c-434c-9812-37267a58b646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:56.011658 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6dd75-932c-434c-9812-37267a58b646 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:56.012042 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6dd75-932c-434c-9812-37267a58b646 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:56.012375 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6dd75-932c-434c-9812-37267a58b646 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:56.013215 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed6dd75-932c-434c-9812-37267a58b646 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:56.013578 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed6dd75-932c-434c-9812-37267a58b646 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:56.015077 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed6dd75-932c-434c-9812-37267a58b646 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:56.027085 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 407/795] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:56.027970 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed6dd75-932c-434c-9812-37267a58b646 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:56.038626 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 389/796] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:24:56.039467 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb15db-84a2-4fae-bc1f-a7f0d3bf4c2a None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:56.115284 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:56.157320 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb15db-84a2-4fae-bc1f-a7f0d3bf4c2a None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:56.157737 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed6dd75-932c-434c-9812-37267a58b646 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:56.194203 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed7126-6be7-4df3-9658-394f573fef3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:56.195564 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed7126-6be7-4df3-9658-394f573fef3d None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:56.195909 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed7126-6be7-4df3-9658-394f573fef3d None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:56.196252 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed7126-6be7-4df3-9658-394f573fef3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:56.198842 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee85da0-743f-4788-bc50-a7a9c3bf8c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:56.200038 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee85da0-743f-4788-bc50-a7a9c3bf8c9f None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:56.200433 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee85da0-743f-4788-bc50-a7a9c3bf8c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:56.200837 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee85da0-743f-4788-bc50-a7a9c3bf8c9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:56.208921 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed7126-6be7-4df3-9658-394f573fef3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:56.209556 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee85da0-743f-4788-bc50-a7a9c3bf8c9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:56.210907 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed7126-6be7-4df3-9658-394f573fef3d None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:56.211147 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee85da0-743f-4788-bc50-a7a9c3bf8c9f None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:56.223018 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:56.231700 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-6ee85da0-743f-4788-bc50-a7a9c3bf8c9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:24:56.231700 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:56.231700 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:56.231700 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:56.231700 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:56.231700 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:56.231700 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:56.231700 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:56.231700 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:56.231700 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:56.231700 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:56.231700 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:56.231700 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 17:24:56.231700 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 17:24:56.231700 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 17:24:56.233605 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 17:24:56.233605 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:56.233605 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:56.233605 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:56.233605 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:56.233605 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:56.233605 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:56.233605 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:56.233605 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:56.233605 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:56.233605 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:56.233605 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:56.233605 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:56.233605 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:56.233605 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:56.233605 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:56.233605 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:56.234784 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 17:24:56.234784 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 17:24:56.234784 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 17:24:56.234784 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 17:24:56.234784 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 17:24:56.234784 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 17:24:56.234784 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:24:56.234784 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:56.234784 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 390/797] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:24:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:56.234784 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee85da0-743f-4788-bc50-a7a9c3bf8c9f None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:56.239890 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-0aed7126-6be7-4df3-9658-394f573fef3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:56.239890 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:56.239890 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:56.239890 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:56.239890 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:56.239890 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:56.239890 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:56.239890 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:56.239890 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:56.239890 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:56.239890 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:56.239890 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:56.239890 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:56.239890 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:56.239890 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:56.240789 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:56.240789 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:56.240789 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:56.240789 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:56.240789 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:56.240789 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:56.240789 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:56.240789 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:56.240789 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:56.240789 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:56.240789 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:56.240789 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:56.240789 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:56.240789 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:56.240789 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:56.240789 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:56.240789 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:56.241699 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:56.241699 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:56.241699 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:56.241699 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:56.249828 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 408/798] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:56.249828 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed7126-6be7-4df3-9658-394f573fef3d None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:56.352108 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee85da0-743f-4788-bc50-a7a9c3bf8c9f None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:56.364113 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed7126-6be7-4df3-9658-394f573fef3d None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:56.385666 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:56.398755 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6fe84-b741-4df4-95ef-3c3dca4cb2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:56.400428 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6fe84-b741-4df4-95ef-3c3dca4cb2fb None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:56.400920 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6fe84-b741-4df4-95ef-3c3dca4cb2fb None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:56.401372 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6fe84-b741-4df4-95ef-3c3dca4cb2fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:56.405373 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb211e6-c3ff-49f7-aef2-c57d0784f508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:56.406564 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb211e6-c3ff-49f7-aef2-c57d0784f508 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:56.407106 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb211e6-c3ff-49f7-aef2-c57d0784f508 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:56.407981 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb211e6-c3ff-49f7-aef2-c57d0784f508 None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:56.409538 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb211e6-c3ff-49f7-aef2-c57d0784f508 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:56.410396 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb211e6-c3ff-49f7-aef2-c57d0784f508 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:56.413728 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb211e6-c3ff-49f7-aef2-c57d0784f508 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:56.414148 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6fe84-b741-4df4-95ef-3c3dca4cb2fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:24:56.423072 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-81f6fe84-b741-4df4-95ef-3c3dca4cb2fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:24:56.423072 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:56.423072 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:56.423072 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:56.423072 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:56.423072 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:56.423072 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:56.423072 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:56.423072 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:56.423072 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:56.423072 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:56.423072 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:56.423072 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:24:56.423072 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:24:56.423072 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:24:56.423072 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:24:56.423995 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:24:56.423995 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:24:56.423995 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:24:56.423995 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:24:56.423995 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:56.423995 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:56.423995 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:56.423995 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:56.423995 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:56.423995 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:56.423995 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:56.423995 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:56.423995 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:56.423995 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:56.423995 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:56.423995 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:56.424833 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:56.424833 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:56.424833 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:56.424833 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:56.424833 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:24:56.424833 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:24:56.424833 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:24:56.424833 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:24:56.424833 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:24:56.424833 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:24:56.424833 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:24:56.424833 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:56.432814 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 391/799] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jul 15 17:24:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:56.432814 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6fe84-b741-4df4-95ef-3c3dca4cb2fb None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:56.438931 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 409/800] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jul 15 17:24:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:56.439873 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb211e6-c3ff-49f7-aef2-c57d0784f508 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:56.505974 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:56.541322 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6fe84-b741-4df4-95ef-3c3dca4cb2fb None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:56.550729 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb211e6-c3ff-49f7-aef2-c57d0784f508 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:56.577011 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de060a8-37c4-4be2-b398-aa96d9e283bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:56.577678 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de060a8-37c4-4be2-b398-aa96d9e283bd None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:56.578004 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de060a8-37c4-4be2-b398-aa96d9e283bd None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:56.578263 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de060a8-37c4-4be2-b398-aa96d9e283bd None admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:56.578966 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de060a8-37c4-4be2-b398-aa96d9e283bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:56.579268 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de060a8-37c4-4be2-b398-aa96d9e283bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:56.581242 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de060a8-37c4-4be2-b398-aa96d9e283bd None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:56.590179 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f970a-569b-4b84-8b17-ba23b4caa8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:56.591270 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f970a-569b-4b84-8b17-ba23b4caa8e0 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:56.591734 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f970a-569b-4b84-8b17-ba23b4caa8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:56.592183 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f970a-569b-4b84-8b17-ba23b4caa8e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:56.593153 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632f970a-569b-4b84-8b17-ba23b4caa8e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:56.593838 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632f970a-569b-4b84-8b17-ba23b4caa8e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:56.598658 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 392/801] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:56.598658 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de060a8-37c4-4be2-b398-aa96d9e283bd None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:56.600639 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632f970a-569b-4b84-8b17-ba23b4caa8e0 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:56.616210 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 410/802] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:24:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:56.617433 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f970a-569b-4b84-8b17-ba23b4caa8e0 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:56.650352 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:56.717496 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de060a8-37c4-4be2-b398-aa96d9e283bd None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:56.729844 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f970a-569b-4b84-8b17-ba23b4caa8e0 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:56.752999 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a401646-9afa-45d6-8d0c-7d4cdf5c3fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:56.753408 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:56.754623 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a401646-9afa-45d6-8d0c-7d4cdf5c3fea None admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:56.754978 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a401646-9afa-45d6-8d0c-7d4cdf5c3fea None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:56.755653 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a401646-9afa-45d6-8d0c-7d4cdf5c3fea None admin] PATH_INFO: `/v3/projects/19cc5221b8074f48b5f73dc9c4289b03/users/9dea565b75784465a8ea073883261d7b/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:56.758276 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a401646-9afa-45d6-8d0c-7d4cdf5c3fea None admin] RBAC: Authorizing `identity:create_grant(project_id=19cc5221b8074f48b5f73dc9c4289b03, user_id=9dea565b75784465a8ea073883261d7b, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:56.760134 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a401646-9afa-45d6-8d0c-7d4cdf5c3fea None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:56.768101 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec32aa6-bb95-41e8-9657-778df75d7a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:56.769026 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec32aa6-bb95-41e8-9657-778df75d7a68 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:56.769329 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec32aa6-bb95-41e8-9657-778df75d7a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:56.769583 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec32aa6-bb95-41e8-9657-778df75d7a68 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:56.777527 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 393/803] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Jul 15 17:24:56 2022] PUT /identity/v3/projects/19cc5221b8074f48b5f73dc9c4289b03/users/9dea565b75784465a8ea073883261d7b/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:24:56.778073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec32aa6-bb95-41e8-9657-778df75d7a68 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:56.778907 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a401646-9afa-45d6-8d0c-7d4cdf5c3fea None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:56.779658 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec32aa6-bb95-41e8-9657-778df75d7a68 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:56.797732 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-2ec32aa6-bb95-41e8-9657-778df75d7a68 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 17:24:56.797732 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:56.797732 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:56.797732 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:56.797732 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:56.797732 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:56.797732 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:56.797732 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:56.797732 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:56.797732 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:56.797732 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:56.797732 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:56.797732 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 17:24:56.797732 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 17:24:56.797732 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 17:24:56.797732 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 17:24:56.798786 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:56.798786 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:56.798786 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 17:24:56.798786 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:24:56.798786 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 17:24:56.798786 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:24:56.798786 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:56.798786 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:56.798786 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:56.798786 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:56.798786 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:56.798786 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:56.798786 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:56.798786 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:56.798786 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:56.798786 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:56.798786 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:56.798786 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:56.799766 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:56.799766 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:56.799766 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 17:24:56.799766 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 17:24:56.799766 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 17:24:56.799766 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 17:24:56.799766 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 17:24:56.799766 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 17:24:56.799766 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 17:24:56.799766 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:56.799766 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 411/804] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Jul 15 17:24:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:56.800875 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd109c-b469-4a0e-9477-cc5f2750ab33 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:56.800875 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd109c-b469-4a0e-9477-cc5f2750ab33 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:56.801163 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd109c-b469-4a0e-9477-cc5f2750ab33 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:56.806705 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 412/805] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:56.807529 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd109c-b469-4a0e-9477-cc5f2750ab33 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:56.914595 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a401646-9afa-45d6-8d0c-7d4cdf5c3fea None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:56.923323 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:56.946599 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd109c-b469-4a0e-9477-cc5f2750ab33 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:56.961736 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29727be5-d69f-457a-8e15-f91f824e49a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:56.962603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29727be5-d69f-457a-8e15-f91f824e49a7 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:56.962882 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29727be5-d69f-457a-8e15-f91f824e49a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:56.963154 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29727be5-d69f-457a-8e15-f91f824e49a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:56.974751 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29727be5-d69f-457a-8e15-f91f824e49a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:56.976204 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29727be5-d69f-457a-8e15-f91f824e49a7 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:56.986145 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8382c-97e1-4e39-a47c-b121ae624082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:56.987172 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8382c-97e1-4e39-a47c-b121ae624082 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:56.987622 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8382c-97e1-4e39-a47c-b121ae624082 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:56.988061 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8382c-97e1-4e39-a47c-b121ae624082 None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:56.989095 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b8382c-97e1-4e39-a47c-b121ae624082 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:56.989580 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b8382c-97e1-4e39-a47c-b121ae624082 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:56.991499 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b8382c-97e1-4e39-a47c-b121ae624082 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:56.995713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-29727be5-d69f-457a-8e15-f91f824e49a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:56.995713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:56.995713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:56.995713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:56.995713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:56.995713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:56.995713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:56.995713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:56.995713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:56.995713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:56.995713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:56.995713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:56.995713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:56.995713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:56.995713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:56.996607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:56.996607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:56.996607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:56.996607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:56.996607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:56.996607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:56.996607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:56.996607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:56.996607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:56.996607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:56.996607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:56.996607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:56.996607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:56.996607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:56.996607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:56.996607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:56.996607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:56.997656 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:56.997656 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:56.997656 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:56.997656 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:56.997656 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 394/806] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:56.999269 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504312d0-4dcf-446e-8fa7-09aee34bfec9 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:56.999550 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504312d0-4dcf-446e-8fa7-09aee34bfec9 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:56.999824 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504312d0-4dcf-446e-8fa7-09aee34bfec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:57.018682 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 413/807] 10.222.0.27 () {56 vars in 1149 bytes} [Fri Jul 15 17:24:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:57.019531 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8382c-97e1-4e39-a47c-b121ae624082 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:57.020581 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-504312d0-4dcf-446e-8fa7-09aee34bfec9 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:57.021900 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-504312d0-4dcf-446e-8fa7-09aee34bfec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:57.081243 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:57.096176 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 395/808] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:24:57.097034 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504312d0-4dcf-446e-8fa7-09aee34bfec9 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:57.148083 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8382c-97e1-4e39-a47c-b121ae624082 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:57.184954 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:57.188198 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23cf53-2322-420b-b9ad-6c310a979b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:57.188873 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23cf53-2322-420b-b9ad-6c310a979b36 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:57.189218 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23cf53-2322-420b-b9ad-6c310a979b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:57.189511 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23cf53-2322-420b-b9ad-6c310a979b36 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:57.190561 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc23cf53-2322-420b-b9ad-6c310a979b36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:57.190866 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc23cf53-2322-420b-b9ad-6c310a979b36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:57.193304 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc23cf53-2322-420b-b9ad-6c310a979b36 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:57.197675 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504312d0-4dcf-446e-8fa7-09aee34bfec9 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:57.207439 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 414/809] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:57.208427 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23cf53-2322-420b-b9ad-6c310a979b36 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:57.238417 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0737d-3df7-43f2-b81f-7f04eb89d543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:57.239225 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0737d-3df7-43f2-b81f-7f04eb89d543 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:57.239553 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0737d-3df7-43f2-b81f-7f04eb89d543 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:57.239831 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0737d-3df7-43f2-b81f-7f04eb89d543 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:57.250655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d0737d-3df7-43f2-b81f-7f04eb89d543 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:57.252097 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d0737d-3df7-43f2-b81f-7f04eb89d543 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:57.270709 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-16d0737d-3df7-43f2-b81f-7f04eb89d543 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:57.270709 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:57.270709 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:57.270709 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:57.270709 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:57.270709 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:57.270709 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:57.270709 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:57.270709 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:57.270709 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:57.270709 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:57.270709 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:57.270709 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:57.270709 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:57.270709 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:57.272832 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:57.272832 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:57.272832 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:57.272832 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:57.272832 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:57.272832 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:57.272832 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:57.272832 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:57.272832 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:57.272832 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:57.272832 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:57.272832 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:57.272832 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:57.272832 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:57.272832 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:57.272832 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:57.272832 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:57.274909 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:57.274909 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:57.274909 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:57.274909 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:57.281810 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 396/810] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:57.281810 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0737d-3df7-43f2-b81f-7f04eb89d543 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:57.331243 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:57.335011 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23cf53-2322-420b-b9ad-6c310a979b36 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:57.374937 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2e8f4-71c0-469d-bb6c-4e555cbd995c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:57.375757 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2e8f4-71c0-469d-bb6c-4e555cbd995c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:57.376035 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2e8f4-71c0-469d-bb6c-4e555cbd995c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:57.376322 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2e8f4-71c0-469d-bb6c-4e555cbd995c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:57.376961 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e2e8f4-71c0-469d-bb6c-4e555cbd995c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:57.378445 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e2e8f4-71c0-469d-bb6c-4e555cbd995c None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:57.387751 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0737d-3df7-43f2-b81f-7f04eb89d543 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:57.392555 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-15e2e8f4-71c0-469d-bb6c-4e555cbd995c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 17:24:57.392555 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:57.392555 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 17:24:57.392555 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 17:24:57.392555 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 17:24:57.392555 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 17:24:57.392555 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 17:24:57.392555 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:24:57.392555 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 17:24:57.392555 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:57.392555 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 17:24:57.392555 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:57.392555 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:57.392555 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:57.392555 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:57.392555 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:57.393512 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:57.393512 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:57.393512 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:57.393512 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:57.393512 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:57.393512 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:57.393512 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:57.393512 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 17:24:57.393512 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 17:24:57.393512 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 17:24:57.393512 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 17:24:57.393512 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:57.393512 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:57.393512 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:57.393512 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:57.393512 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:57.394397 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:57.394397 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:57.394397 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:57.394397 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:57.394397 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:57.394397 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:57.394397 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:57.394397 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:57.394397 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:57.394397 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:57.394397 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:57.394397 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 17:24:57.394397 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:24:57.394397 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 17:24:57.394397 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:57.398736 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 415/811] 10.222.0.27 () {56 vars in 1129 bytes} [Fri Jul 15 17:24:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:57.399597 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2e8f4-71c0-469d-bb6c-4e555cbd995c None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:57.428142 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84cbe8-1871-44ae-9cbb-970b80b6b45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:57.429333 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84cbe8-1871-44ae-9cbb-970b80b6b45a None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:57.429841 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84cbe8-1871-44ae-9cbb-970b80b6b45a None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:57.430305 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84cbe8-1871-44ae-9cbb-970b80b6b45a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:57.439940 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c84cbe8-1871-44ae-9cbb-970b80b6b45a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:57.441605 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c84cbe8-1871-44ae-9cbb-970b80b6b45a None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:57.444465 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:57.458511 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-7c84cbe8-1871-44ae-9cbb-970b80b6b45a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 17:24:57.458511 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:57.458511 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:57.458511 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:57.458511 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:57.458511 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:57.458511 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:57.458511 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:57.458511 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:57.458511 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:57.458511 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:57.458511 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:57.458511 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 17:24:57.458511 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 17:24:57.458511 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 17:24:57.458511 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 17:24:57.459690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:57.459690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:57.459690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 17:24:57.459690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:24:57.459690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 17:24:57.459690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:24:57.459690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:57.459690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:57.459690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:57.459690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:57.459690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:57.459690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:57.459690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:57.459690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:57.459690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:57.459690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:57.459690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:57.459690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:57.460876 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:57.460876 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:57.460876 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 17:24:57.460876 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 17:24:57.460876 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 17:24:57.460876 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 17:24:57.460876 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 17:24:57.460876 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 17:24:57.460876 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 17:24:57.460876 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:57.462795 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 397/812] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Jul 15 17:24:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:57.463690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84cbe8-1871-44ae-9cbb-970b80b6b45a None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:57.521516 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2e8f4-71c0-469d-bb6c-4e555cbd995c None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:57.558378 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1286b142-04df-4e20-a51c-511445a72120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:57.559061 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286b142-04df-4e20-a51c-511445a72120 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:57.559327 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286b142-04df-4e20-a51c-511445a72120 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:57.559700 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286b142-04df-4e20-a51c-511445a72120 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:57.561083 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1286b142-04df-4e20-a51c-511445a72120 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:57.561390 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1286b142-04df-4e20-a51c-511445a72120 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:57.562877 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1286b142-04df-4e20-a51c-511445a72120 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:57.565086 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84cbe8-1871-44ae-9cbb-970b80b6b45a None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:57.578099 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 416/813] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:57.578099 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1286b142-04df-4e20-a51c-511445a72120 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:57.602876 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb18d910-2bd6-44e4-a737-127634ddc2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:57.603543 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18d910-2bd6-44e4-a737-127634ddc2ed None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:57.603829 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18d910-2bd6-44e4-a737-127634ddc2ed None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:57.604090 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18d910-2bd6-44e4-a737-127634ddc2ed None admin] PATH_INFO: `/v3/services` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:57.604800 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb18d910-2bd6-44e4-a737-127634ddc2ed None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:57.605024 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:57.605136 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb18d910-2bd6-44e4-a737-127634ddc2ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:57.606758 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb18d910-2bd6-44e4-a737-127634ddc2ed None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:57.612498 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 398/814] 10.222.0.27 () {56 vars in 1124 bytes} [Fri Jul 15 17:24:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:57.618164 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cacb14f-df26-4902-9219-e4d1504711a8 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:57.618454 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cacb14f-df26-4902-9219-e4d1504711a8 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:57.618724 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cacb14f-df26-4902-9219-e4d1504711a8 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:57.621893 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 399/815] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:57.621893 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cacb14f-df26-4902-9219-e4d1504711a8 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:57.686338 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1286b142-04df-4e20-a51c-511445a72120 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:57.695045 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:57.722605 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2688b-fee5-41d5-bd6d-bd4ba8e56f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:57.723274 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2688b-fee5-41d5-bd6d-bd4ba8e56f85 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:57.723551 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2688b-fee5-41d5-bd6d-bd4ba8e56f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:57.723816 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2688b-fee5-41d5-bd6d-bd4ba8e56f85 None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:57.724638 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd2688b-fee5-41d5-bd6d-bd4ba8e56f85 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:57.724936 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd2688b-fee5-41d5-bd6d-bd4ba8e56f85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:57.726393 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd2688b-fee5-41d5-bd6d-bd4ba8e56f85 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:57.739421 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cacb14f-df26-4902-9219-e4d1504711a8 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:57.748107 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 417/816] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Jul 15 17:24:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:57.748107 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2688b-fee5-41d5-bd6d-bd4ba8e56f85 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:57.779304 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c31dc1-7167-4f25-866a-eb94e7becb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:57.780214 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c31dc1-7167-4f25-866a-eb94e7becb97 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:57.780520 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c31dc1-7167-4f25-866a-eb94e7becb97 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:57.780877 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c31dc1-7167-4f25-866a-eb94e7becb97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:57.787873 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c31dc1-7167-4f25-866a-eb94e7becb97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:57.789325 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c31dc1-7167-4f25-866a-eb94e7becb97 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:57.804116 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-12c31dc1-7167-4f25-866a-eb94e7becb97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:24:57.804116 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:57.804116 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:57.804116 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:57.804116 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:57.804116 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:57.804116 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:57.804116 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:57.804116 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:57.804116 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:57.804116 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:57.804116 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:57.804116 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 17:24:57.804116 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 17:24:57.804116 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 17:24:57.805033 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 17:24:57.805033 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:57.805033 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:57.805033 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:57.805033 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:57.805033 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:57.805033 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:57.805033 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:57.805033 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:57.805033 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:57.805033 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:57.805033 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:57.805033 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:57.805033 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:57.805033 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:57.805033 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:57.805033 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:57.806415 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 17:24:57.806415 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 17:24:57.806415 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 17:24:57.806415 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 17:24:57.806415 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 17:24:57.806415 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 17:24:57.806415 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:24:57.806415 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:57.806415 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 400/817] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:24:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:57.806904 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1e9a0-48c0-428f-8857-bf7e50901181 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:57.806995 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1e9a0-48c0-428f-8857-bf7e50901181 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:57.807277 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1e9a0-48c0-428f-8857-bf7e50901181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:57.824412 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-d0d1e9a0-48c0-428f-8857-bf7e50901181 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:57.825854 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-d0d1e9a0-48c0-428f-8857-bf7e50901181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:57.838060 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:57.857392 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2688b-fee5-41d5-bd6d-bd4ba8e56f85 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:57.891900 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1ac63-8553-4183-a3b9-ad69665ba419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:57.892563 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1ac63-8553-4183-a3b9-ad69665ba419 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:57.892841 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1ac63-8553-4183-a3b9-ad69665ba419 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:57.893114 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1ac63-8553-4183-a3b9-ad69665ba419 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:57.893942 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e1ac63-8553-4183-a3b9-ad69665ba419 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:57.894239 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e1ac63-8553-4183-a3b9-ad69665ba419 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:57.895600 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e1ac63-8553-4183-a3b9-ad69665ba419 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:57.898434 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 401/818] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:24:57.899606 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1e9a0-48c0-428f-8857-bf7e50901181 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:57.904370 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 418/819] 10.222.0.27 () {56 vars in 1124 bytes} [Fri Jul 15 17:24:57 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:57.905365 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1ac63-8553-4183-a3b9-ad69665ba419 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:57.963387 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:58.014657 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1e9a0-48c0-428f-8857-bf7e50901181 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:58.017613 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1ac63-8553-4183-a3b9-ad69665ba419 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:58.049816 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943bc44-5215-43bc-8bf8-a3b27915b865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:58.050473 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943bc44-5215-43bc-8bf8-a3b27915b865 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:58.050749 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943bc44-5215-43bc-8bf8-a3b27915b865 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:58.051017 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943bc44-5215-43bc-8bf8-a3b27915b865 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:58.053044 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5538d9-bc71-46d7-a336-8d00bc46ad49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:58.053642 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5538d9-bc71-46d7-a336-8d00bc46ad49 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:58.054008 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5538d9-bc71-46d7-a336-8d00bc46ad49 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:58.054283 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5538d9-bc71-46d7-a336-8d00bc46ad49 None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:58.055163 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5538d9-bc71-46d7-a336-8d00bc46ad49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:58.055489 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5538d9-bc71-46d7-a336-8d00bc46ad49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:58.056896 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5538d9-bc71-46d7-a336-8d00bc46ad49 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:58.069479 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 419/820] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jul 15 17:24:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:58.070668 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5538d9-bc71-46d7-a336-8d00bc46ad49 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:58.080076 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:58.131078 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1943bc44-5215-43bc-8bf8-a3b27915b865 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:58.132670 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1943bc44-5215-43bc-8bf8-a3b27915b865 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:58.175336 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5538d9-bc71-46d7-a336-8d00bc46ad49 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:58.188171 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:58.211367 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3fc0fe-f596-4b33-874c-07b071f8ef76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:58.212019 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3fc0fe-f596-4b33-874c-07b071f8ef76 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:58.212309 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3fc0fe-f596-4b33-874c-07b071f8ef76 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:58.212583 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3fc0fe-f596-4b33-874c-07b071f8ef76 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:58.213321 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3fc0fe-f596-4b33-874c-07b071f8ef76 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:58.214773 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3fc0fe-f596-4b33-874c-07b071f8ef76 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:58.242594 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 420/821] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Jul 15 17:24:58 2022] POST /identity/v3/endpoints => generated 346 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:24:58.242594 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3fc0fe-f596-4b33-874c-07b071f8ef76 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:58.242873 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 402/822] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:24:57 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 17:24:58.242873 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943bc44-5215-43bc-8bf8-a3b27915b865 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:58.327546 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:58.381953 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3fc0fe-f596-4b33-874c-07b071f8ef76 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:58.394069 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943bc44-5215-43bc-8bf8-a3b27915b865 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:58.426389 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb03ae-99bc-4a12-9932-f267dd635648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:58.427193 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb03ae-99bc-4a12-9932-f267dd635648 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:58.427470 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb03ae-99bc-4a12-9932-f267dd635648 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:58.427742 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb03ae-99bc-4a12-9932-f267dd635648 None admin] PATH_INFO: `/v3/services/network` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:58.428402 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afb03ae-99bc-4a12-9932-f267dd635648 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:58.429767 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afb03ae-99bc-4a12-9932-f267dd635648 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:58.441741 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-1afb03ae-99bc-4a12-9932-f267dd635648 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 17:24:58.441741 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:58.441741 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 17:24:58.441741 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 17:24:58.441741 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 17:24:58.441741 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 17:24:58.441741 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 17:24:58.441741 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:24:58.441741 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 17:24:58.441741 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:58.441741 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 17:24:58.441741 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:58.441741 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:58.441741 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:58.441741 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:58.441741 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:58.441741 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:58.442786 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:58.442786 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:58.442786 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:58.442786 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:58.442786 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:58.442786 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:58.442786 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 17:24:58.442786 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 17:24:58.442786 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 17:24:58.442786 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 17:24:58.442786 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:58.442786 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:58.442786 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:58.442786 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:58.442786 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:58.442786 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:58.443639 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:58.443639 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:58.443639 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:58.443639 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:58.443639 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:58.443639 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:58.443639 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:58.443639 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:58.443639 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:58.443639 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:58.443639 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 17:24:58.443639 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:24:58.443639 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 17:24:58.443639 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:58.443639 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 421/823] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:24:58 2022] GET /identity/v3/services/network => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:58.444438 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb03ae-99bc-4a12-9932-f267dd635648 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:58.447631 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55008b15-0c44-417b-b7ed-f3c4fd55b677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:58.448878 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55008b15-0c44-417b-b7ed-f3c4fd55b677 None admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:58.449160 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55008b15-0c44-417b-b7ed-f3c4fd55b677 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:58.449440 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55008b15-0c44-417b-b7ed-f3c4fd55b677 None admin] PATH_INFO: `/v3/projects/19cc5221b8074f48b5f73dc9c4289b03/users/b73d09bd7c1e4753a45cfdb00cc5abe9/roles/1a453be279744db09ef4e2fcf580beac` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:58.469972 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55008b15-0c44-417b-b7ed-f3c4fd55b677 None admin] RBAC: Authorizing `identity:create_grant(project_id=19cc5221b8074f48b5f73dc9c4289b03, user_id=b73d09bd7c1e4753a45cfdb00cc5abe9, role_id=1a453be279744db09ef4e2fcf580beac)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:58.472288 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55008b15-0c44-417b-b7ed-f3c4fd55b677 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:58.493744 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 403/824] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Jul 15 17:24:58 2022] PUT /identity/v3/projects/19cc5221b8074f48b5f73dc9c4289b03/users/b73d09bd7c1e4753a45cfdb00cc5abe9/roles/1a453be279744db09ef4e2fcf580beac => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:24:58.495694 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55008b15-0c44-417b-b7ed-f3c4fd55b677 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:58.502160 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:58.562974 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb03ae-99bc-4a12-9932-f267dd635648 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:58.627698 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:58.631075 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55008b15-0c44-417b-b7ed-f3c4fd55b677 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:58.675764 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa072e-6aea-4380-a4e5-e7ffa322d5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:58.677274 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa072e-6aea-4380-a4e5-e7ffa322d5fe None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:58.678127 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91094aa3-e146-460f-931d-7bc5ff097725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:58.679132 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91094aa3-e146-460f-931d-7bc5ff097725 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:58.679579 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa072e-6aea-4380-a4e5-e7ffa322d5fe None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:58.680001 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa072e-6aea-4380-a4e5-e7ffa322d5fe None admin] PATH_INFO: `/v3/services` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:58.680886 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa072e-6aea-4380-a4e5-e7ffa322d5fe None admin] RBAC: Adding query filter params (name=network) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:58.681347 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91094aa3-e146-460f-931d-7bc5ff097725 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:58.681761 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91094aa3-e146-460f-931d-7bc5ff097725 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:58.682933 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa072e-6aea-4380-a4e5-e7ffa322d5fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:58.684869 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa072e-6aea-4380-a4e5-e7ffa322d5fe None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:58.701931 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 404/825] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Jul 15 17:24:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:58.707741 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91094aa3-e146-460f-931d-7bc5ff097725 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:58.709593 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91094aa3-e146-460f-931d-7bc5ff097725 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:58.712905 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa072e-6aea-4380-a4e5-e7ffa322d5fe None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:58.745460 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-91094aa3-e146-460f-931d-7bc5ff097725 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:58.745460 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:58.745460 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:58.745460 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:58.745460 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:58.745460 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:58.745460 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:58.745460 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:58.745460 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:58.745460 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:58.745460 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:58.745460 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:58.745460 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:58.745460 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:58.745460 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:58.746593 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:58.746593 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:58.746593 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:58.746593 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:58.746593 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:58.746593 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:58.746593 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:58.746593 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:58.746593 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:58.746593 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:58.746593 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:58.746593 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:58.746593 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:58.746593 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:58.746593 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:58.746593 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:58.746593 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:58.747938 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:58.747938 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:58.747938 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:58.747938 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:58.750564 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 422/826] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:58.757496 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91094aa3-e146-460f-931d-7bc5ff097725 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:58.815812 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:58.858155 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa072e-6aea-4380-a4e5-e7ffa322d5fe None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:58.891195 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91094aa3-e146-460f-931d-7bc5ff097725 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:58.895231 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c94d2-23a5-4e25-806b-ba8e6ffe546c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:58.895908 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c94d2-23a5-4e25-806b-ba8e6ffe546c None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:58.896189 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c94d2-23a5-4e25-806b-ba8e6ffe546c None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:58.896468 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c94d2-23a5-4e25-806b-ba8e6ffe546c None admin] PATH_INFO: `/v3/services` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:58.897172 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c94d2-23a5-4e25-806b-ba8e6ffe546c None admin] RBAC: Adding query filter params (type=network) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:58.897477 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c94d2-23a5-4e25-806b-ba8e6ffe546c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:58.898977 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c94d2-23a5-4e25-806b-ba8e6ffe546c None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:58.904754 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 405/827] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Jul 15 17:24:58 2022] GET /identity/v3/services?type=network => generated 350 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:24:58.906058 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d03ab1-1163-4036-b410-bccfb3de5765 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:58.906345 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d03ab1-1163-4036-b410-bccfb3de5765 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:58.906620 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d03ab1-1163-4036-b410-bccfb3de5765 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:58.908102 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 406/828] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:24:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:24:58.913132 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba39547-7e07-40e8-8e64-416b48bd8b57 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:58.913419 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba39547-7e07-40e8-8e64-416b48bd8b57 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:58.913698 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba39547-7e07-40e8-8e64-416b48bd8b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:58.931645 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-9ba39547-7e07-40e8-8e64-416b48bd8b57 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:24:58.931836 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2d1c2-6b8b-4abb-8608-cf064a68d283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:58.932454 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2d1c2-6b8b-4abb-8608-cf064a68d283 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:58.932739 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2d1c2-6b8b-4abb-8608-cf064a68d283 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:58.932840 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-9ba39547-7e07-40e8-8e64-416b48bd8b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:24:58.933013 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2d1c2-6b8b-4abb-8608-cf064a68d283 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:58.933733 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b2d1c2-6b8b-4abb-8608-cf064a68d283 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:58.934108 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b2d1c2-6b8b-4abb-8608-cf064a68d283 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:58.935656 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b2d1c2-6b8b-4abb-8608-cf064a68d283 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:58.948587 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 423/829] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:58.949458 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2d1c2-6b8b-4abb-8608-cf064a68d283 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:58.988417 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:59.024246 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 407/830] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:24:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 17:24:59.025597 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba39547-7e07-40e8-8e64-416b48bd8b57 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:59.060598 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2d1c2-6b8b-4abb-8608-cf064a68d283 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:59.096988 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a64281-c890-4d2c-b68f-518247cab74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:59.097650 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a64281-c890-4d2c-b68f-518247cab74e None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:59.097967 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a64281-c890-4d2c-b68f-518247cab74e None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:59.098285 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a64281-c890-4d2c-b68f-518247cab74e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:59.099037 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a64281-c890-4d2c-b68f-518247cab74e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:59.100512 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a64281-c890-4d2c-b68f-518247cab74e None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:59.115838 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:59.127005 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 424/831] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Jul 15 17:24:58 2022] POST /identity/v3/endpoints => generated 327 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:24:59.128277 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a64281-c890-4d2c-b68f-518247cab74e None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:59.151325 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba39547-7e07-40e8-8e64-416b48bd8b57 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:59.211496 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4371d-df0e-41d0-a252-a774b637bdee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:59.212593 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4371d-df0e-41d0-a252-a774b637bdee None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:59.212889 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4371d-df0e-41d0-a252-a774b637bdee None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:59.213289 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4371d-df0e-41d0-a252-a774b637bdee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:59.226320 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c4371d-df0e-41d0-a252-a774b637bdee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:59.227906 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c4371d-df0e-41d0-a252-a774b637bdee None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:59.247742 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:59.256737 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-09c4371d-df0e-41d0-a252-a774b637bdee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:24:59.256737 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:59.256737 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:59.256737 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:59.256737 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:59.256737 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:59.256737 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:59.256737 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:59.256737 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:59.256737 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:59.256737 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:59.256737 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:59.256737 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 17:24:59.256737 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 17:24:59.256737 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 17:24:59.257942 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 17:24:59.257942 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:59.257942 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:59.257942 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:59.257942 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:59.257942 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:59.257942 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:59.257942 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:59.257942 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:59.257942 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:59.257942 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:59.257942 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:59.257942 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:59.257942 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:59.257942 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:59.257942 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:59.257942 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:59.259179 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 17:24:59.259179 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 17:24:59.259179 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 17:24:59.259179 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 17:24:59.259179 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 17:24:59.259179 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 17:24:59.259179 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:24:59.259179 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:24:59.259179 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 408/832] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:24:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:59.262305 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a64281-c890-4d2c-b68f-518247cab74e None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:59.265081 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4371d-df0e-41d0-a252-a774b637bdee None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:59.317290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57778189-51a8-46de-a0c2-100bdcf19e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:59.318150 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57778189-51a8-46de-a0c2-100bdcf19e70 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:59.318435 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57778189-51a8-46de-a0c2-100bdcf19e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:59.318708 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57778189-51a8-46de-a0c2-100bdcf19e70 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:59.340811 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57778189-51a8-46de-a0c2-100bdcf19e70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:24:59.348765 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-57778189-51a8-46de-a0c2-100bdcf19e70 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:24:59.348765 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:59.348765 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:59.348765 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:59.348765 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:59.348765 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:59.348765 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:59.348765 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:59.348765 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:59.348765 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:59.348765 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:59.348765 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:59.348765 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:24:59.348765 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:24:59.348765 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:24:59.348765 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:24:59.349693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:24:59.349693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:24:59.349693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:24:59.349693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:24:59.349693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:59.349693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:59.349693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:59.349693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:59.349693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:59.349693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:59.349693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:59.349693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:59.349693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:59.349693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:59.349693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:59.349693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:59.350570 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:59.350570 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:59.350570 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:59.350570 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:59.350570 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:24:59.350570 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:24:59.350570 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:24:59.350570 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:24:59.350570 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:24:59.350570 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:24:59.350570 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:24:59.350570 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:59.359051 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 425/833] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jul 15 17:24:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:59.366751 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57778189-51a8-46de-a0c2-100bdcf19e70 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:59.417138 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4371d-df0e-41d0-a252-a774b637bdee None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:59.435981 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:59.456861 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b08e34e-42a4-4b50-9252-fa48a252fd7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:59.457720 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08e34e-42a4-4b50-9252-fa48a252fd7a None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:59.458130 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08e34e-42a4-4b50-9252-fa48a252fd7a None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:59.458506 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08e34e-42a4-4b50-9252-fa48a252fd7a None admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:59.459406 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b08e34e-42a4-4b50-9252-fa48a252fd7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:59.459815 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b08e34e-42a4-4b50-9252-fa48a252fd7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:59.461341 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b08e34e-42a4-4b50-9252-fa48a252fd7a None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:59.480350 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 409/834] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jul 15 17:24:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:24:59.486284 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b08e34e-42a4-4b50-9252-fa48a252fd7a None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:59.534525 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57778189-51a8-46de-a0c2-100bdcf19e70 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:59.583904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41228f28-5bbb-4c43-b586-34aa92af88a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:59.585846 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41228f28-5bbb-4c43-b586-34aa92af88a7 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:59.586657 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41228f28-5bbb-4c43-b586-34aa92af88a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:59.587085 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41228f28-5bbb-4c43-b586-34aa92af88a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:59.588273 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41228f28-5bbb-4c43-b586-34aa92af88a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:59.588751 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41228f28-5bbb-4c43-b586-34aa92af88a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:59.591106 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41228f28-5bbb-4c43-b586-34aa92af88a7 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:59.603239 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 426/835] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:24:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:24:59.608728 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41228f28-5bbb-4c43-b586-34aa92af88a7 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:59.625413 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b08e34e-42a4-4b50-9252-fa48a252fd7a None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:59.633040 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:59.666795 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe1c41-e60e-4c96-8cb8-45bf4db403a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:59.667619 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe1c41-e60e-4c96-8cb8-45bf4db403a6 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:59.668005 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe1c41-e60e-4c96-8cb8-45bf4db403a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:59.668380 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe1c41-e60e-4c96-8cb8-45bf4db403a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:59.669557 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe1c41-e60e-4c96-8cb8-45bf4db403a6 None admin] RBAC: Adding query filter params (role.id=70d242b29ede4648b639c7ddae5eaead, scope.project.id=19cc5221b8074f48b5f73dc9c4289b03, user.id=f9d548c8199e4fdbbce7597bebd63421) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:59.670162 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe1c41-e60e-4c96-8cb8-45bf4db403a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:59.671718 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe1c41-e60e-4c96-8cb8-45bf4db403a6 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:59.685890 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 410/836] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jul 15 17:24:59 2022] GET /identity/v3/role_assignments?user.id=f9d548c8199e4fdbbce7597bebd63421&scope.project.id=19cc5221b8074f48b5f73dc9c4289b03&role.id=70d242b29ede4648b639c7ddae5eaead => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:24:59.739102 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41228f28-5bbb-4c43-b586-34aa92af88a7 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:59.776491 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d0ed7-5f99-4d94-9d39-5254e5219556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:59.777307 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d0ed7-5f99-4d94-9d39-5254e5219556 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:59.777587 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d0ed7-5f99-4d94-9d39-5254e5219556 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:59.777886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d0ed7-5f99-4d94-9d39-5254e5219556 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:59.790152 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d0ed7-5f99-4d94-9d39-5254e5219556 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:59.791624 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d0ed7-5f99-4d94-9d39-5254e5219556 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:59.811012 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-d46d0ed7-5f99-4d94-9d39-5254e5219556 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:59.811012 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:24:59.811012 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:24:59.811012 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:24:59.811012 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:24:59.811012 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:24:59.811012 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:24:59.811012 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:24:59.811012 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:24:59.811012 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:24:59.811012 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:24:59.811012 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:24:59.811012 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:24:59.811012 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:24:59.811012 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:24:59.811979 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:24:59.811979 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:24:59.811979 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:24:59.811979 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:24:59.811979 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:24:59.811979 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:24:59.811979 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:24:59.811979 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:24:59.811979 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:24:59.811979 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:24:59.811979 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:24:59.811979 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:24:59.811979 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:24:59.811979 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:24:59.811979 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:24:59.811979 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:24:59.811979 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:24:59.813137 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:24:59.813137 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:24:59.813137 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:24:59.813137 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:24:59.813137 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 427/837] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:24:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:24:59.817998 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe1c41-e60e-4c96-8cb8-45bf4db403a6 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:24:59.865257 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:24:59.926546 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe1c41-e60e-4c96-8cb8-45bf4db403a6 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:24:59.963881 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102290f-2500-4cff-88ad-ffad71be3c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:24:59.964555 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102290f-2500-4cff-88ad-ffad71be3c2e None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:24:59.964837 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102290f-2500-4cff-88ad-ffad71be3c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:24:59.965111 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102290f-2500-4cff-88ad-ffad71be3c2e None admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:24:59.965998 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d102290f-2500-4cff-88ad-ffad71be3c2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:24:59.966530 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d102290f-2500-4cff-88ad-ffad71be3c2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:24:59.968236 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d102290f-2500-4cff-88ad-ffad71be3c2e None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:24:59.982875 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 411/838] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:24:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:24:59.988497 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d0ed7-5f99-4d94-9d39-5254e5219556 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:00.055102 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:00.096492 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d0ed7-5f99-4d94-9d39-5254e5219556 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:00.133993 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b934d8a1-eb2d-4001-a89b-104dea1fca20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:00.135024 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934d8a1-eb2d-4001-a89b-104dea1fca20 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:00.135474 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934d8a1-eb2d-4001-a89b-104dea1fca20 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:00.135884 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934d8a1-eb2d-4001-a89b-104dea1fca20 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:00.144208 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934d8a1-eb2d-4001-a89b-104dea1fca20 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:00.145826 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934d8a1-eb2d-4001-a89b-104dea1fca20 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:00.160338 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-b934d8a1-eb2d-4001-a89b-104dea1fca20 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 15 17:25:00.160338 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:00.160338 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:00.160338 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:00.160338 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:00.160338 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:00.160338 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:00.160338 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:00.160338 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:00.160338 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:00.160338 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:00.160338 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:00.160338 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 17:25:00.160338 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 17:25:00.160338 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 17:25:00.160338 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 17:25:00.161517 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:00.161517 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:00.161517 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 17:25:00.161517 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:25:00.161517 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 17:25:00.161517 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:25:00.161517 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:00.161517 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:00.161517 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:00.161517 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:00.161517 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:00.161517 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:00.161517 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:00.161517 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:00.161517 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:00.161517 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:00.161517 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:00.161517 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:00.162727 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:00.162727 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:00.162727 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 17:25:00.162727 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 17:25:00.162727 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 17:25:00.162727 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 17:25:00.162727 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 17:25:00.162727 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 17:25:00.162727 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 15 17:25:00.162727 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:25:00.164944 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 428/839] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jul 15 17:24:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:25:00.170784 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102290f-2500-4cff-88ad-ffad71be3c2e None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:00.280238 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102290f-2500-4cff-88ad-ffad71be3c2e None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:00.282101 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:00.321928 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2134d835-5791-4f2b-a3d7-193e74103b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:00.322826 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134d835-5791-4f2b-a3d7-193e74103b18 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:00.323276 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134d835-5791-4f2b-a3d7-193e74103b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:00.323744 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134d835-5791-4f2b-a3d7-193e74103b18 None admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:00.324843 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2134d835-5791-4f2b-a3d7-193e74103b18 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:00.325365 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2134d835-5791-4f2b-a3d7-193e74103b18 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:00.327158 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2134d835-5791-4f2b-a3d7-193e74103b18 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:00.346342 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 412/840] 10.222.0.27 () {56 vars in 1135 bytes} [Fri Jul 15 17:25:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:00.354847 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b934d8a1-eb2d-4001-a89b-104dea1fca20 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:00.439223 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6e78a-e0f5-4c23-93f6-c3ef6a35b02b None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:00.439420 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6e78a-e0f5-4c23-93f6-c3ef6a35b02b None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:00.439685 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6e78a-e0f5-4c23-93f6-c3ef6a35b02b None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:00.441183 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 413/841] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 17:25:00.447477 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51d92c-0a54-4470-ac68-d1e0534e9e49 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:00.447755 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51d92c-0a54-4470-ac68-d1e0534e9e49 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:00.448022 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51d92c-0a54-4470-ac68-d1e0534e9e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:00.464967 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b934d8a1-eb2d-4001-a89b-104dea1fca20 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:00.469865 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-ad51d92c-0a54-4470-ac68-d1e0534e9e49 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:25:00.471049 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-ad51d92c-0a54-4470-ac68-d1e0534e9e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:25:00.490964 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:00.503245 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9dc68-3232-4083-b85a-234485dc76b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:00.504232 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9dc68-3232-4083-b85a-234485dc76b8 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:00.504717 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9dc68-3232-4083-b85a-234485dc76b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:00.505214 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9dc68-3232-4083-b85a-234485dc76b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:00.560274 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 414/842] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:25:00 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 17:25:00.581999 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad51d92c-0a54-4470-ac68-d1e0534e9e49 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:00.583418 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9dc68-3232-4083-b85a-234485dc76b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:00.585127 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9dc68-3232-4083-b85a-234485dc76b8 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:00.681475 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:00.694138 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad51d92c-0a54-4470-ac68-d1e0534e9e49 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:00.694771 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 429/843] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:25:00 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 17:25:00.699978 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9dc68-3232-4083-b85a-234485dc76b8 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:00.726656 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:00.732518 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca9d897-ee61-43b6-9d56-66197b177fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:00.733677 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9d897-ee61-43b6-9d56-66197b177fc1 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:00.734410 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9d897-ee61-43b6-9d56-66197b177fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:00.734983 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9d897-ee61-43b6-9d56-66197b177fc1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:00.735889 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca9d897-ee61-43b6-9d56-66197b177fc1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:00.737570 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca9d897-ee61-43b6-9d56-66197b177fc1 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:00.752900 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-9ca9d897-ee61-43b6-9d56-66197b177fc1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 17:25:00.752900 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:00.752900 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 17:25:00.752900 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 17:25:00.752900 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 17:25:00.752900 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 17:25:00.752900 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 17:25:00.752900 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:25:00.752900 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 17:25:00.752900 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:00.752900 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 17:25:00.752900 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:00.752900 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:00.752900 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:00.752900 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:00.752900 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:00.752900 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:00.754203 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:00.754203 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:00.754203 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:00.754203 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:00.754203 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:00.754203 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:00.754203 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 17:25:00.754203 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 17:25:00.754203 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 17:25:00.754203 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 17:25:00.754203 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:00.754203 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:00.754203 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:00.754203 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:00.754203 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:00.754203 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:00.755186 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:00.755186 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:00.755186 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:00.755186 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:00.755186 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:00.755186 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:00.755186 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:00.755186 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:00.755186 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:00.755186 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:00.755186 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 17:25:00.755186 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:25:00.755186 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 17:25:00.755186 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:00.761846 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 415/844] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Jul 15 17:25:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:25:00.763486 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca9d897-ee61-43b6-9d56-66197b177fc1 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:00.813302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9dc68-3232-4083-b85a-234485dc76b8 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:00.851059 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3016e34a-b9d5-4c92-94ee-8f2fedfd23b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:00.852163 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016e34a-b9d5-4c92-94ee-8f2fedfd23b3 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:00.852592 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016e34a-b9d5-4c92-94ee-8f2fedfd23b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:00.853016 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016e34a-b9d5-4c92-94ee-8f2fedfd23b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:00.864504 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3016e34a-b9d5-4c92-94ee-8f2fedfd23b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:00.866333 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3016e34a-b9d5-4c92-94ee-8f2fedfd23b3 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:00.886298 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca9d897-ee61-43b6-9d56-66197b177fc1 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:00.887418 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-3016e34a-b9d5-4c92-94ee-8f2fedfd23b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:25:00.887418 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:00.887418 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:00.887418 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:00.887418 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:00.887418 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:00.887418 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:00.887418 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:00.887418 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:00.887418 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:00.887418 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:00.887418 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:00.887418 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:25:00.887418 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:25:00.887418 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:25:00.888366 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:25:00.888366 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:00.888366 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:00.888366 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:00.888366 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:00.888366 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:00.888366 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:00.888366 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:00.888366 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:00.888366 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:00.888366 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:00.888366 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:00.888366 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:00.888366 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:00.888366 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:00.888366 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:00.888366 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:00.889481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:25:00.889481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:25:00.889481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:25:00.889481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:25:00.889481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 430/845] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:25:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 17:25:00.894672 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3016e34a-b9d5-4c92-94ee-8f2fedfd23b3 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:00.936456 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd2f32b-5f3e-47f5-a77b-74a7f34e0a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:00.937135 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2f32b-5f3e-47f5-a77b-74a7f34e0a0b None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:00.937416 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2f32b-5f3e-47f5-a77b-74a7f34e0a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:00.937689 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2f32b-5f3e-47f5-a77b-74a7f34e0a0b None admin] PATH_INFO: `/v3/services` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:00.938431 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd2f32b-5f3e-47f5-a77b-74a7f34e0a0b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:00.938735 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd2f32b-5f3e-47f5-a77b-74a7f34e0a0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:00.940095 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd2f32b-5f3e-47f5-a77b-74a7f34e0a0b None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:00.944788 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 416/846] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Jul 15 17:25:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:00.946030 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df19c1-51d2-470e-b310-f9a9fb6d039c None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:00.946315 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df19c1-51d2-470e-b310-f9a9fb6d039c None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:00.946590 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df19c1-51d2-470e-b310-f9a9fb6d039c None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:00.947988 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 417/847] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:25:00.950378 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df19c1-51d2-470e-b310-f9a9fb6d039c None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:00.970989 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:00.990672 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:01.014919 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3016e34a-b9d5-4c92-94ee-8f2fedfd23b3 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:01.054557 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a29a7-6151-4276-9bf2-1b5db3cdcd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:01.055391 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a29a7-6151-4276-9bf2-1b5db3cdcd29 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:01.055688 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a29a7-6151-4276-9bf2-1b5db3cdcd29 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:01.055983 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a29a7-6151-4276-9bf2-1b5db3cdcd29 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:01.056813 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a29a7-6151-4276-9bf2-1b5db3cdcd29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:01.057125 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a29a7-6151-4276-9bf2-1b5db3cdcd29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:01.058640 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a29a7-6151-4276-9bf2-1b5db3cdcd29 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:01.065356 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df19c1-51d2-470e-b310-f9a9fb6d039c None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:01.076217 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 431/848] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:25:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:01.076217 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee474c-21d4-4605-aae6-c93381aef25f None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:01.076217 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee474c-21d4-4605-aae6-c93381aef25f None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:01.076217 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee474c-21d4-4605-aae6-c93381aef25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:01.090411 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-6fee474c-21d4-4605-aae6-c93381aef25f None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:25:01.091643 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-6fee474c-21d4-4605-aae6-c93381aef25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:25:01.107503 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2337d8-3022-423c-81e1-04541f811575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:01.108288 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2337d8-3022-423c-81e1-04541f811575 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:01.108559 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2337d8-3022-423c-81e1-04541f811575 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:01.108836 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2337d8-3022-423c-81e1-04541f811575 None admin] PATH_INFO: `/v3/services` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:01.109553 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2337d8-3022-423c-81e1-04541f811575 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:01.109891 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2337d8-3022-423c-81e1-04541f811575 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:01.111253 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2337d8-3022-423c-81e1-04541f811575 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:01.115965 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 418/849] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Jul 15 17:25:00 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:25:01.116733 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2337d8-3022-423c-81e1-04541f811575 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:01.168685 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 432/850] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:25:01 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:25:01.192435 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fee474c-21d4-4605-aae6-c93381aef25f None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:01.237052 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:01.258109 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2337d8-3022-423c-81e1-04541f811575 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:01.279517 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:01.304060 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a44c45-7a9e-41bf-ad8d-4544892afb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:01.305237 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a44c45-7a9e-41bf-ad8d-4544892afb70 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:01.305715 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a44c45-7a9e-41bf-ad8d-4544892afb70 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:01.306221 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a44c45-7a9e-41bf-ad8d-4544892afb70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:01.313738 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a44c45-7a9e-41bf-ad8d-4544892afb70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:01.315605 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a44c45-7a9e-41bf-ad8d-4544892afb70 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:01.321830 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fee474c-21d4-4605-aae6-c93381aef25f None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:01.332472 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-a7a44c45-7a9e-41bf-ad8d-4544892afb70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:25:01.332472 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:01.332472 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:01.332472 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:01.332472 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:01.332472 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:01.332472 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:01.332472 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:01.332472 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:01.332472 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:01.332472 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:01.332472 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:01.332472 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 17:25:01.332472 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 17:25:01.332472 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 17:25:01.333367 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 17:25:01.333367 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:01.333367 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:01.333367 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:01.333367 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:01.333367 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:01.333367 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:01.333367 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:01.333367 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:01.333367 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:01.333367 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:01.333367 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:01.333367 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:01.333367 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:01.333367 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:01.333367 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:01.333367 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:01.334339 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 17:25:01.334339 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 17:25:01.334339 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 17:25:01.334339 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 17:25:01.334339 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 17:25:01.334339 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 17:25:01.334339 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:25:01.334339 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:01.336537 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 419/851] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:25:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:25:01.343787 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a44c45-7a9e-41bf-ad8d-4544892afb70 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:01.358611 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a43b5b-9dcd-48b7-b2cf-e3716bb266c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:01.359431 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a43b5b-9dcd-48b7-b2cf-e3716bb266c0 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:01.359714 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a43b5b-9dcd-48b7-b2cf-e3716bb266c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:01.359988 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a43b5b-9dcd-48b7-b2cf-e3716bb266c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:01.371267 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a43b5b-9dcd-48b7-b2cf-e3716bb266c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:25:01.379214 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-f9a43b5b-9dcd-48b7-b2cf-e3716bb266c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 17:25:01.379214 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:01.379214 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:01.379214 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:01.379214 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:01.379214 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:01.379214 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:01.379214 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:01.379214 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:01.379214 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:01.379214 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:01.379214 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:01.379214 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:25:01.379214 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:25:01.379214 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:25:01.379214 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:25:01.380369 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:25:01.380369 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:25:01.380369 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:25:01.380369 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:25:01.380369 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:01.380369 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:01.380369 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:01.380369 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:01.380369 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:01.380369 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:01.380369 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:01.380369 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:01.380369 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:01.380369 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:01.380369 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:01.380369 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:01.381722 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:01.381722 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:01.381722 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:01.381722 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:01.381722 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:25:01.381722 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:25:01.381722 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:25:01.381722 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:25:01.381722 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:25:01.381722 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:25:01.381722 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 17:25:01.381722 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:25:01.381722 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 433/852] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Jul 15 17:25:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 17:25:01.386065 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a43b5b-9dcd-48b7-b2cf-e3716bb266c0 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:01.464519 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a44c45-7a9e-41bf-ad8d-4544892afb70 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:01.494123 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a43b5b-9dcd-48b7-b2cf-e3716bb266c0 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:01.501956 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b31c7d-c9de-460d-ab55-7310c851b866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:01.502729 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b31c7d-c9de-460d-ab55-7310c851b866 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:01.503006 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b31c7d-c9de-460d-ab55-7310c851b866 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:01.503273 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b31c7d-c9de-460d-ab55-7310c851b866 None admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:01.504064 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b31c7d-c9de-460d-ab55-7310c851b866 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:01.504366 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b31c7d-c9de-460d-ab55-7310c851b866 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:01.505921 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b31c7d-c9de-460d-ab55-7310c851b866 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:01.524882 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 420/853] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jul 15 17:25:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:25:01.525773 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:01.527004 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b31c7d-c9de-460d-ab55-7310c851b866 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:01.530909 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:01.531523 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecce898-2e5d-4b95-8cdf-7dcb02b3b610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:01.532279 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecce898-2e5d-4b95-8cdf-7dcb02b3b610 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:01.533049 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecce898-2e5d-4b95-8cdf-7dcb02b3b610 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:01.533673 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecce898-2e5d-4b95-8cdf-7dcb02b3b610 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:01.535812 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecce898-2e5d-4b95-8cdf-7dcb02b3b610 None admin] RBAC: Adding query filter params (name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:01.536193 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecce898-2e5d-4b95-8cdf-7dcb02b3b610 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:01.537698 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecce898-2e5d-4b95-8cdf-7dcb02b3b610 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:01.547830 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 434/854] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Jul 15 17:25:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:01.552934 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecce898-2e5d-4b95-8cdf-7dcb02b3b610 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:01.640444 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b31c7d-c9de-460d-ab55-7310c851b866 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:01.676391 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40644185-ac5d-46c1-bc87-5b99fe8f0295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:01.677342 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40644185-ac5d-46c1-bc87-5b99fe8f0295 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:01.677825 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40644185-ac5d-46c1-bc87-5b99fe8f0295 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:01.678235 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40644185-ac5d-46c1-bc87-5b99fe8f0295 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:01.679197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40644185-ac5d-46c1-bc87-5b99fe8f0295 None admin] RBAC: Adding query filter params (role.id=70d242b29ede4648b639c7ddae5eaead, scope.project.id=19cc5221b8074f48b5f73dc9c4289b03, user.id=9dea565b75784465a8ea073883261d7b) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:01.679737 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40644185-ac5d-46c1-bc87-5b99fe8f0295 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:01.681348 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40644185-ac5d-46c1-bc87-5b99fe8f0295 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:01.694020 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecce898-2e5d-4b95-8cdf-7dcb02b3b610 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:01.694714 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 421/855] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jul 15 17:25:01 2022] GET /identity/v3/role_assignments?user.id=9dea565b75784465a8ea073883261d7b&scope.project.id=19cc5221b8074f48b5f73dc9c4289b03&role.id=70d242b29ede4648b639c7ddae5eaead => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:01.728280 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630777af-521a-4b6e-8d49-68b721a937de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:01.729102 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630777af-521a-4b6e-8d49-68b721a937de None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:01.729386 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630777af-521a-4b6e-8d49-68b721a937de None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:01.729669 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630777af-521a-4b6e-8d49-68b721a937de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:01.742178 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630777af-521a-4b6e-8d49-68b721a937de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:01.743665 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630777af-521a-4b6e-8d49-68b721a937de None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:01.764009 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-630777af-521a-4b6e-8d49-68b721a937de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:25:01.764009 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:01.764009 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:01.764009 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:01.764009 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:01.764009 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:01.764009 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:01.764009 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:01.764009 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:01.764009 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:01.764009 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:01.764009 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:01.764009 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:25:01.764009 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:25:01.764009 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:25:01.764933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:25:01.764933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:01.764933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:01.764933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:01.764933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:01.764933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:01.764933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:01.764933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:01.764933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:01.764933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:01.764933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:01.764933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:01.764933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:01.764933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:01.764933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:01.764933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:01.764933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:01.765846 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:25:01.765846 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:25:01.765846 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:25:01.765846 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:25:01.765846 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 435/856] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:25:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:25:01.771015 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40644185-ac5d-46c1-bc87-5b99fe8f0295 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:01.845006 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:01.882303 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40644185-ac5d-46c1-bc87-5b99fe8f0295 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:01.919304 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b9637-a39e-4927-a4eb-fe2aea01bab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:01.919988 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b9637-a39e-4927-a4eb-fe2aea01bab8 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:01.920265 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b9637-a39e-4927-a4eb-fe2aea01bab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:01.920542 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b9637-a39e-4927-a4eb-fe2aea01bab8 None admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:01.921269 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b9637-a39e-4927-a4eb-fe2aea01bab8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:01.921575 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b9637-a39e-4927-a4eb-fe2aea01bab8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:01.923001 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b9637-a39e-4927-a4eb-fe2aea01bab8 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:01.936654 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 422/857] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:25:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:01.942350 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630777af-521a-4b6e-8d49-68b721a937de None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:01.993238 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:02.020029 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d650387-f993-4af9-8737-ee0d217760de None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:02.020205 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d650387-f993-4af9-8737-ee0d217760de None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:02.020483 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d650387-f993-4af9-8737-ee0d217760de None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:02.022022 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 423/858] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:25:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 17:25:02.027298 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d3143-26ae-4383-bd46-b08ed483665c None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:02.027845 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d3143-26ae-4383-bd46-b08ed483665c None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:02.028359 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d3143-26ae-4383-bd46-b08ed483665c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:02.046889 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-9e3d3143-26ae-4383-bd46-b08ed483665c None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:25:02.048415 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-9e3d3143-26ae-4383-bd46-b08ed483665c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:25:02.062187 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630777af-521a-4b6e-8d49-68b721a937de None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:02.103416 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced48ca-ef9f-4eb4-991c-38c414191c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:02.104240 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced48ca-ef9f-4eb4-991c-38c414191c78 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:02.104513 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced48ca-ef9f-4eb4-991c-38c414191c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:02.104779 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced48ca-ef9f-4eb4-991c-38c414191c78 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:02.112969 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bced48ca-ef9f-4eb4-991c-38c414191c78 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:02.114389 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bced48ca-ef9f-4eb4-991c-38c414191c78 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:02.130123 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-bced48ca-ef9f-4eb4-991c-38c414191c78 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 17:25:02.130123 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:02.130123 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:02.130123 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:02.130123 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:02.130123 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:02.130123 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:02.130123 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:02.130123 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:02.130123 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:02.130123 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:02.130123 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:02.130123 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 17:25:02.130123 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 17:25:02.130123 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 17:25:02.130123 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 17:25:02.131155 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:02.131155 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:02.131155 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 17:25:02.131155 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:25:02.131155 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 17:25:02.131155 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:25:02.131155 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:02.131155 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:02.131155 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:02.131155 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:02.131155 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:02.131155 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:02.131155 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:02.131155 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:02.131155 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:02.131155 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:02.131155 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:02.131155 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:02.132170 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:02.132170 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:02.132170 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 17:25:02.132170 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 17:25:02.132170 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 17:25:02.132170 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 17:25:02.132170 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 17:25:02.132170 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 17:25:02.132170 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 17:25:02.132170 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:25:02.132170 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 436/859] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Jul 15 17:25:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:25:02.137220 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced48ca-ef9f-4eb4-991c-38c414191c78 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:02.142428 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 424/860] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:25:02 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 17:25:02.167997 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d3143-26ae-4383-bd46-b08ed483665c None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:02.240358 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:02.258140 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:02.262644 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced48ca-ef9f-4eb4-991c-38c414191c78 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:02.305523 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d3143-26ae-4383-bd46-b08ed483665c None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:02.318046 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b41819-a465-40cb-9565-d1166ae7b26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:02.318741 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b41819-a465-40cb-9565-d1166ae7b26a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:02.319020 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b41819-a465-40cb-9565-d1166ae7b26a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:02.319293 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b41819-a465-40cb-9565-d1166ae7b26a None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:02.320141 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b41819-a465-40cb-9565-d1166ae7b26a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:02.320447 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b41819-a465-40cb-9565-d1166ae7b26a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:02.321910 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b41819-a465-40cb-9565-d1166ae7b26a None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:02.342128 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 437/861] 10.222.0.27 () {56 vars in 1149 bytes} [Fri Jul 15 17:25:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:02.347340 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b41819-a465-40cb-9565-d1166ae7b26a None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:02.354142 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b473225-d0fc-4dec-84c9-096fdb9a2c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:02.355244 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b473225-d0fc-4dec-84c9-096fdb9a2c4a None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:02.355724 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b473225-d0fc-4dec-84c9-096fdb9a2c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:02.356678 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b473225-d0fc-4dec-84c9-096fdb9a2c4a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:02.357565 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b473225-d0fc-4dec-84c9-096fdb9a2c4a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:02.360080 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b473225-d0fc-4dec-84c9-096fdb9a2c4a None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:02.377746 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-9b473225-d0fc-4dec-84c9-096fdb9a2c4a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 17:25:02.377746 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:02.377746 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 17:25:02.377746 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 17:25:02.377746 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 17:25:02.377746 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 17:25:02.377746 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 17:25:02.377746 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:25:02.377746 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 17:25:02.377746 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:02.377746 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 17:25:02.377746 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:02.377746 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:02.377746 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:02.377746 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:02.377746 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:02.378830 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:02.378830 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:02.378830 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:02.378830 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:02.378830 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:02.378830 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:02.378830 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:02.378830 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 17:25:02.378830 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 17:25:02.378830 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 17:25:02.378830 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 17:25:02.378830 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:02.378830 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:02.378830 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:02.378830 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:02.378830 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:02.379676 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:02.379676 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:02.379676 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:02.379676 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:02.379676 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:02.379676 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:02.379676 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:02.379676 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:02.379676 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:02.379676 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:02.379676 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:02.379676 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 17:25:02.379676 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:25:02.379676 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 17:25:02.379676 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:02.384816 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 425/862] 10.222.0.27 () {56 vars in 1132 bytes} [Fri Jul 15 17:25:02 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:25:02.388495 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b473225-d0fc-4dec-84c9-096fdb9a2c4a None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:02.455966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b41819-a465-40cb-9565-d1166ae7b26a None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:02.491855 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4780d6b6-22db-49bb-ba9d-a6fcdb344d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:02.492934 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780d6b6-22db-49bb-ba9d-a6fcdb344d29 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:02.493406 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780d6b6-22db-49bb-ba9d-a6fcdb344d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:02.493901 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780d6b6-22db-49bb-ba9d-a6fcdb344d29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:02.496936 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b473225-d0fc-4dec-84c9-096fdb9a2c4a None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:02.518156 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:02.522457 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:02.534890 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d93ac3-757d-4df6-8663-9ab9433d580e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:02.535561 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d93ac3-757d-4df6-8663-9ab9433d580e None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:02.535844 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d93ac3-757d-4df6-8663-9ab9433d580e None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:02.536164 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d93ac3-757d-4df6-8663-9ab9433d580e None admin] PATH_INFO: `/v3/services` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:02.537619 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d93ac3-757d-4df6-8663-9ab9433d580e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:02.537949 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d93ac3-757d-4df6-8663-9ab9433d580e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:02.539451 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d93ac3-757d-4df6-8663-9ab9433d580e None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:02.549547 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 426/863] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Jul 15 17:25:02 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:25:02.550453 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d93ac3-757d-4df6-8663-9ab9433d580e None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:02.567637 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4780d6b6-22db-49bb-ba9d-a6fcdb344d29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:02.569432 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4780d6b6-22db-49bb-ba9d-a6fcdb344d29 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:02.658368 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d93ac3-757d-4df6-8663-9ab9433d580e None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:02.673272 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 438/864] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:25:02 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 17:25:02.674551 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4780d6b6-22db-49bb-ba9d-a6fcdb344d29 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:02.695405 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023bf557-e6c5-42c7-8bf5-19c52906f9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:02.695956 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bf557-e6c5-42c7-8bf5-19c52906f9e0 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:02.696036 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bf557-e6c5-42c7-8bf5-19c52906f9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:02.696318 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bf557-e6c5-42c7-8bf5-19c52906f9e0 None admin] PATH_INFO: `/v3/services` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:02.697029 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023bf557-e6c5-42c7-8bf5-19c52906f9e0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:02.697336 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023bf557-e6c5-42c7-8bf5-19c52906f9e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:02.698729 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023bf557-e6c5-42c7-8bf5-19c52906f9e0 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:02.710011 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 427/865] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Jul 15 17:25:02 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:02.738420 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:02.784694 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4780d6b6-22db-49bb-ba9d-a6fcdb344d29 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:02.821830 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548c296-7f32-4501-ad50-8e1cf705a3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:02.822567 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548c296-7f32-4501-ad50-8e1cf705a3ed None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:02.822842 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548c296-7f32-4501-ad50-8e1cf705a3ed None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:02.823109 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548c296-7f32-4501-ad50-8e1cf705a3ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:02.835414 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6548c296-7f32-4501-ad50-8e1cf705a3ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:02.836949 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6548c296-7f32-4501-ad50-8e1cf705a3ed None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:02.856439 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-6548c296-7f32-4501-ad50-8e1cf705a3ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:25:02.856439 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:02.856439 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:02.856439 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:02.856439 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:02.856439 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:02.856439 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:02.856439 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:02.856439 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:02.856439 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:02.856439 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:02.856439 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:02.856439 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:25:02.856439 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:25:02.856439 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:25:02.857402 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:25:02.857402 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:02.857402 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:02.857402 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:02.857402 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:02.857402 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:02.857402 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:02.857402 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:02.857402 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:02.857402 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:02.857402 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:02.857402 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:02.857402 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:02.857402 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:02.857402 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:02.857402 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:02.857402 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:02.858372 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:25:02.858372 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:25:02.858372 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:25:02.858372 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:25:02.858372 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 439/866] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:25:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:25:02.864020 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023bf557-e6c5-42c7-8bf5-19c52906f9e0 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:02.932675 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:02.978719 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023bf557-e6c5-42c7-8bf5-19c52906f9e0 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:03.018040 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf41ed5-8b13-4046-b568-3ba5df653758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:03.019097 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf41ed5-8b13-4046-b568-3ba5df653758 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:03.019524 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf41ed5-8b13-4046-b568-3ba5df653758 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:03.019980 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf41ed5-8b13-4046-b568-3ba5df653758 None admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:03.020925 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf41ed5-8b13-4046-b568-3ba5df653758 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:03.021371 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf41ed5-8b13-4046-b568-3ba5df653758 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:03.022901 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf41ed5-8b13-4046-b568-3ba5df653758 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:03.035709 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 428/867] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:25:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:03.040916 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548c296-7f32-4501-ad50-8e1cf705a3ed None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:03.142589 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548c296-7f32-4501-ad50-8e1cf705a3ed None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:03.153376 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:03.177807 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a2cd46-0f01-4cb1-a7a2-09f310100ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:03.178612 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2cd46-0f01-4cb1-a7a2-09f310100ddf None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:03.178889 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2cd46-0f01-4cb1-a7a2-09f310100ddf None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:03.179160 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2cd46-0f01-4cb1-a7a2-09f310100ddf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:03.184474 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7327103-6731-4dfe-8e62-f303ad8cf9cc None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:03.184819 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7327103-6731-4dfe-8e62-f303ad8cf9cc None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:03.185104 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7327103-6731-4dfe-8e62-f303ad8cf9cc None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:03.186721 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a2cd46-0f01-4cb1-a7a2-09f310100ddf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:03.186901 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 429/868] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:25:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 17:25:03.188163 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a2cd46-0f01-4cb1-a7a2-09f310100ddf None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:03.191834 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a5ab4-6033-4227-9e8a-ab909693d74e None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:03.192119 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a5ab4-6033-4227-9e8a-ab909693d74e None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:03.192395 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a5ab4-6033-4227-9e8a-ab909693d74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:03.204032 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-83a2cd46-0f01-4cb1-a7a2-09f310100ddf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:25:03.204032 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:03.204032 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:03.204032 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:03.204032 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:03.204032 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:03.204032 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:03.204032 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:03.204032 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:03.204032 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:03.204032 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:03.204032 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:03.204032 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 17:25:03.204032 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 17:25:03.204032 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 17:25:03.205153 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 17:25:03.205153 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:03.205153 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:03.205153 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:03.205153 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:03.205153 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:03.205153 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:03.205153 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:03.205153 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:03.205153 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:03.205153 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:03.205153 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:03.205153 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:03.205153 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:03.205153 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:03.205153 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:03.205153 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:03.206637 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 17:25:03.206637 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 17:25:03.206637 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 17:25:03.206637 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 17:25:03.206637 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 17:25:03.206637 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 17:25:03.206637 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:25:03.206637 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:25:03.209628 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 440/869] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:25:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:25:03.210909 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-d64a5ab4-6033-4227-9e8a-ab909693d74e None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:25:03.211482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a2cd46-0f01-4cb1-a7a2-09f310100ddf None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:03.212322 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-d64a5ab4-6033-4227-9e8a-ab909693d74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:25:03.290248 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 430/870] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:25:03 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 17:25:03.308046 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a5ab4-6033-4227-9e8a-ab909693d74e None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:03.322533 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a2cd46-0f01-4cb1-a7a2-09f310100ddf None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:03.348005 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:03.368352 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e574d-a1aa-4535-abd6-c334655b29b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:03.369105 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e574d-a1aa-4535-abd6-c334655b29b3 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:03.369605 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e574d-a1aa-4535-abd6-c334655b29b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:03.370977 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e574d-a1aa-4535-abd6-c334655b29b3 None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:03.371838 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e574d-a1aa-4535-abd6-c334655b29b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:03.372960 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e574d-a1aa-4535-abd6-c334655b29b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:03.375095 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e574d-a1aa-4535-abd6-c334655b29b3 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:03.392488 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 441/871] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jul 15 17:25:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:25:03.394150 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e574d-a1aa-4535-abd6-c334655b29b3 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:03.427129 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a5ab4-6033-4227-9e8a-ab909693d74e None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:03.438228 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:03.471184 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eadcb0-4223-4b9a-ace2-f8a0711c5f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:03.471882 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eadcb0-4223-4b9a-ace2-f8a0711c5f6d None admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:03.472159 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eadcb0-4223-4b9a-ace2-f8a0711c5f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:03.472863 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eadcb0-4223-4b9a-ace2-f8a0711c5f6d None admin] PATH_INFO: `/v3/services` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:03.473589 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eadcb0-4223-4b9a-ace2-f8a0711c5f6d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:03.475338 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eadcb0-4223-4b9a-ace2-f8a0711c5f6d None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:03.494079 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 431/872] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Jul 15 17:25:03 2022] POST /identity/v3/services => generated 251 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:25:03.507068 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e574d-a1aa-4535-abd6-c334655b29b3 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:03.554427 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53e198-d93f-4a4b-bfe1-1e8683fbfc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:03.555255 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53e198-d93f-4a4b-bfe1-1e8683fbfc26 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:03.555686 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53e198-d93f-4a4b-bfe1-1e8683fbfc26 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:03.556058 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53e198-d93f-4a4b-bfe1-1e8683fbfc26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:03.557002 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53e198-d93f-4a4b-bfe1-1e8683fbfc26 None admin] RBAC: Adding query filter params (role.id=1a453be279744db09ef4e2fcf580beac, scope.project.id=19cc5221b8074f48b5f73dc9c4289b03, user.id=b73d09bd7c1e4753a45cfdb00cc5abe9) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:03.557406 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53e198-d93f-4a4b-bfe1-1e8683fbfc26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:03.558980 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53e198-d93f-4a4b-bfe1-1e8683fbfc26 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:03.566720 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 442/873] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jul 15 17:25:03 2022] GET /identity/v3/role_assignments?user.id=b73d09bd7c1e4753a45cfdb00cc5abe9&scope.project.id=19cc5221b8074f48b5f73dc9c4289b03&role.id=1a453be279744db09ef4e2fcf580beac => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:25:03.842096 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0217a-c4a1-4b26-a2e9-47d0bccd16e1 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:03.842630 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0217a-c4a1-4b26-a2e9-47d0bccd16e1 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:03.842630 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0217a-c4a1-4b26-a2e9-47d0bccd16e1 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:03.844285 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 432/874] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:25:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:25:03.849948 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2d780-dcda-424d-9263-38f352d1564c None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:03.850383 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2d780-dcda-424d-9263-38f352d1564c None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:03.850494 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2d780-dcda-424d-9263-38f352d1564c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:03.867971 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-81f2d780-dcda-424d-9263-38f352d1564c None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:25:03.869165 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-81f2d780-dcda-424d-9263-38f352d1564c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:25:03.943374 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 443/875] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:25:03 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:25:03.965583 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0217a-c4a1-4b26-a2e9-47d0bccd16e1 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:04.067772 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:04.073162 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0217a-c4a1-4b26-a2e9-47d0bccd16e1 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:04.111201 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed1e14-4706-4762-bdc5-8c5196855bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:04.111985 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed1e14-4706-4762-bdc5-8c5196855bb7 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:04.112299 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed1e14-4706-4762-bdc5-8c5196855bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:04.112585 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed1e14-4706-4762-bdc5-8c5196855bb7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:04.113240 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed1e14-4706-4762-bdc5-8c5196855bb7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:04.114648 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed1e14-4706-4762-bdc5-8c5196855bb7 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:04.127295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-06ed1e14-4706-4762-bdc5-8c5196855bb7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 17:25:04.127295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:04.127295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 17:25:04.127295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 17:25:04.127295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 17:25:04.127295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 17:25:04.127295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 17:25:04.127295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:25:04.127295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 17:25:04.127295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:04.127295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 17:25:04.127295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:04.127295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:04.127295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:04.127295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:04.127295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:04.127295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:04.129572 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:04.129572 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:04.129572 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:04.129572 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:04.129572 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:04.129572 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:04.129572 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 17:25:04.129572 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 17:25:04.129572 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 17:25:04.129572 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 17:25:04.129572 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:04.129572 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:04.129572 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:04.129572 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:04.129572 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:04.129572 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:04.131619 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:04.131619 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:04.131619 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:04.131619 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:04.131619 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:04.131619 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:04.131619 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:04.131619 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:04.131619 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:04.131619 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:04.131619 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 17:25:04.131619 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:25:04.131619 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 17:25:04.131619 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:04.136286 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 433/876] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Jul 15 17:25:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:25:04.136463 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2d780-dcda-424d-9263-38f352d1564c None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:04.163463 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:04.241005 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2d780-dcda-424d-9263-38f352d1564c None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:04.275965 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d52e8d-6e1d-4b28-a71a-b621a9244afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:04.276640 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d52e8d-6e1d-4b28-a71a-b621a9244afc None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:04.276924 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d52e8d-6e1d-4b28-a71a-b621a9244afc None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:04.277199 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d52e8d-6e1d-4b28-a71a-b621a9244afc None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:04.277992 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d52e8d-6e1d-4b28-a71a-b621a9244afc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:04.278454 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d52e8d-6e1d-4b28-a71a-b621a9244afc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:04.279895 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d52e8d-6e1d-4b28-a71a-b621a9244afc None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:04.289894 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 444/877] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Jul 15 17:25:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:25:04.292306 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed1e14-4706-4762-bdc5-8c5196855bb7 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:04.402411 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed1e14-4706-4762-bdc5-8c5196855bb7 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:04.438652 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec61259a-d30c-4790-9260-0b579e4c0740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:04.439327 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec61259a-d30c-4790-9260-0b579e4c0740 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:04.439679 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec61259a-d30c-4790-9260-0b579e4c0740 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:04.439952 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec61259a-d30c-4790-9260-0b579e4c0740 None admin] PATH_INFO: `/v3/services` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:04.440711 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec61259a-d30c-4790-9260-0b579e4c0740 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:04.441018 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec61259a-d30c-4790-9260-0b579e4c0740 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:04.442476 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec61259a-d30c-4790-9260-0b579e4c0740 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:04.447561 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 434/878] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Jul 15 17:25:04 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:04.836334 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26943bd-aa51-48d9-9c1d-5094714c9086 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:04.836646 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26943bd-aa51-48d9-9c1d-5094714c9086 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:04.837156 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26943bd-aa51-48d9-9c1d-5094714c9086 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:04.838914 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 445/879] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:25:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:25:04.844213 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97833f10-fe1d-4809-abda-ee9f9b24be39 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:04.844661 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97833f10-fe1d-4809-abda-ee9f9b24be39 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:04.844758 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97833f10-fe1d-4809-abda-ee9f9b24be39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:04.862519 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-97833f10-fe1d-4809-abda-ee9f9b24be39 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:25:04.863714 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-97833f10-fe1d-4809-abda-ee9f9b24be39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:25:04.884215 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:04.932590 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 435/880] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:25:04 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:25:04.955194 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26943bd-aa51-48d9-9c1d-5094714c9086 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:05.039793 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:05.057666 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26943bd-aa51-48d9-9c1d-5094714c9086 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:05.093034 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a937857f-a6b7-4ea8-a86a-08ab60fb39c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:05.093631 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937857f-a6b7-4ea8-a86a-08ab60fb39c7 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:05.093956 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937857f-a6b7-4ea8-a86a-08ab60fb39c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:05.094233 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937857f-a6b7-4ea8-a86a-08ab60fb39c7 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:05.094969 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a937857f-a6b7-4ea8-a86a-08ab60fb39c7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:05.096341 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a937857f-a6b7-4ea8-a86a-08ab60fb39c7 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:05.114608 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 446/881] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Jul 15 17:25:04 2022] POST /identity/v3/services => generated 269 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:25:05.711818 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368b574-e469-4ad5-9175-e208011bb821 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:05.712102 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362fdf95-1808-4787-84d2-a4d91318b78d None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:05.712197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368b574-e469-4ad5-9175-e208011bb821 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:05.712273 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362fdf95-1808-4787-84d2-a4d91318b78d None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:05.712343 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368b574-e469-4ad5-9175-e208011bb821 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:05.712413 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362fdf95-1808-4787-84d2-a4d91318b78d None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:05.713989 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 447/883] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:25:05.714097 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 436/883] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:25:05.718923 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb55925-72bb-4097-8835-b0eae4641faa None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:05.719048 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db152e28-52d4-4390-9371-9cc7f2000ea9 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:05.719218 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb55925-72bb-4097-8835-b0eae4641faa None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:05.719329 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db152e28-52d4-4390-9371-9cc7f2000ea9 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:05.719495 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb55925-72bb-4097-8835-b0eae4641faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:05.719588 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db152e28-52d4-4390-9371-9cc7f2000ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:05.737025 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-dfb55925-72bb-4097-8835-b0eae4641faa None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:25:05.737964 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-db152e28-52d4-4390-9371-9cc7f2000ea9 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:25:05.738865 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-dfb55925-72bb-4097-8835-b0eae4641faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:25:05.739136 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-db152e28-52d4-4390-9371-9cc7f2000ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:25:05.814997 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 448/884] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:25:05 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:25:05.815777 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 437/885] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:25:05 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:25:05.837884 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db152e28-52d4-4390-9371-9cc7f2000ea9 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:05.838652 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb55925-72bb-4097-8835-b0eae4641faa None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:05.908421 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:05.927038 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:05.949327 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db152e28-52d4-4390-9371-9cc7f2000ea9 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:05.954408 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb55925-72bb-4097-8835-b0eae4641faa None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:05.997748 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b60a9-69b2-4606-a1f4-20bc23fd0cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:05.998573 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b60a9-69b2-4606-a1f4-20bc23fd0cd2 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:05.998856 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b60a9-69b2-4606-a1f4-20bc23fd0cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:05.999131 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b60a9-69b2-4606-a1f4-20bc23fd0cd2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:05.999861 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b60a9-69b2-4606-a1f4-20bc23fd0cd2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:06.001215 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b60a9-69b2-4606-a1f4-20bc23fd0cd2 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:06.001502 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ef833-6bd9-40c7-bf73-d20f31804960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:06.002569 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ef833-6bd9-40c7-bf73-d20f31804960 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:06.003343 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ef833-6bd9-40c7-bf73-d20f31804960 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:06.004192 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ef833-6bd9-40c7-bf73-d20f31804960 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:06.013708 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-031b60a9-69b2-4606-a1f4-20bc23fd0cd2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 17:25:06.013708 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:06.013708 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 17:25:06.013708 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 17:25:06.013708 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 17:25:06.013708 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 17:25:06.013708 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 17:25:06.013708 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:25:06.013708 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 17:25:06.013708 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:25:06.013708 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 17:25:06.013708 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:25:06.013708 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:06.013708 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:06.013708 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:06.013708 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:06.013708 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:06.014767 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:06.014767 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:06.014767 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:06.014767 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:06.014767 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:06.014767 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:06.014767 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 17:25:06.014767 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 17:25:06.014767 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 17:25:06.014767 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 17:25:06.014767 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:06.014767 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:06.014767 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:06.014767 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:06.014767 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:06.014767 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:06.016245 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:06.016245 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:06.016245 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:06.016245 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:06.016245 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:06.016245 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:06.016245 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:06.016245 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:06.016245 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:06.016245 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:06.016245 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 17:25:06.016245 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:25:06.016245 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 17:25:06.016245 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:25:06.016245 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 449/886] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Jul 15 17:25:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:25:06.019312 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ef833-6bd9-40c7-bf73-d20f31804960 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:25:06.020616 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b60a9-69b2-4606-a1f4-20bc23fd0cd2 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:06.029935 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-be4ef833-6bd9-40c7-bf73-d20f31804960 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 17:25:06.029935 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:06.029935 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:06.029935 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:06.029935 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:06.029935 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:06.029935 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:06.029935 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:06.029935 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:06.029935 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:06.029935 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:06.029935 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:06.029935 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:25:06.029935 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:25:06.029935 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:25:06.029935 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:25:06.030872 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:25:06.030872 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:25:06.030872 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:25:06.030872 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:25:06.030872 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:06.030872 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:06.030872 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:06.030872 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:06.030872 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:06.030872 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:06.030872 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:06.030872 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:06.030872 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:06.030872 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:06.030872 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:06.030872 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:06.031799 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:06.031799 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:06.031799 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:06.031799 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:06.031799 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:25:06.031799 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:25:06.031799 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:25:06.031799 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:25:06.031799 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:25:06.031799 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:25:06.031799 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 17:25:06.031799 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:06.034608 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 438/887] 10.222.0.27 () {56 vars in 1120 bytes} [Fri Jul 15 17:25:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 17:25:06.040106 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ef833-6bd9-40c7-bf73-d20f31804960 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:06.135866 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b60a9-69b2-4606-a1f4-20bc23fd0cd2 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:06.175078 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b963542-4bb8-4c5e-8c73-b7f05841da7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:06.176199 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b963542-4bb8-4c5e-8c73-b7f05841da7f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:06.176690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b963542-4bb8-4c5e-8c73-b7f05841da7f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:06.177216 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b963542-4bb8-4c5e-8c73-b7f05841da7f None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:06.178289 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b963542-4bb8-4c5e-8c73-b7f05841da7f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:06.178799 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b963542-4bb8-4c5e-8c73-b7f05841da7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:06.179924 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ef833-6bd9-40c7-bf73-d20f31804960 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:06.180656 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b963542-4bb8-4c5e-8c73-b7f05841da7f None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:06.182365 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:06.188665 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 450/888] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Jul 15 17:25:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:06.193867 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b963542-4bb8-4c5e-8c73-b7f05841da7f None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:06.224031 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373bf02-6b9b-4059-a5a1-1e9dd504b9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:06.224928 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373bf02-6b9b-4059-a5a1-1e9dd504b9cc None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:06.225204 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373bf02-6b9b-4059-a5a1-1e9dd504b9cc None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:06.225472 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373bf02-6b9b-4059-a5a1-1e9dd504b9cc None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:06.226722 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373bf02-6b9b-4059-a5a1-1e9dd504b9cc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:06.227044 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373bf02-6b9b-4059-a5a1-1e9dd504b9cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:06.228938 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373bf02-6b9b-4059-a5a1-1e9dd504b9cc None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:06.242959 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 439/889] 10.222.0.27 () {56 vars in 1115 bytes} [Fri Jul 15 17:25:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:06.245809 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373bf02-6b9b-4059-a5a1-1e9dd504b9cc None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:06.294010 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:06.306082 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b963542-4bb8-4c5e-8c73-b7f05841da7f None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:06.343357 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d4df6-388a-4818-97fd-75a60dce7bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:06.344125 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d4df6-388a-4818-97fd-75a60dce7bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:06.344411 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d4df6-388a-4818-97fd-75a60dce7bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:06.344684 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d4df6-388a-4818-97fd-75a60dce7bc9 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:06.345398 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d4df6-388a-4818-97fd-75a60dce7bc9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:06.345698 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d4df6-388a-4818-97fd-75a60dce7bc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:06.347101 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d4df6-388a-4818-97fd-75a60dce7bc9 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:06.347319 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373bf02-6b9b-4059-a5a1-1e9dd504b9cc None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:06.352990 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 451/890] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Jul 15 17:25:06 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:06.358926 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d4df6-388a-4818-97fd-75a60dce7bc9 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:06.382076 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ce022-20c9-475a-a38a-dd79be013587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:06.382965 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ce022-20c9-475a-a38a-dd79be013587 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:06.383307 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ce022-20c9-475a-a38a-dd79be013587 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:06.383636 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ce022-20c9-475a-a38a-dd79be013587 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:06.394837 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ce022-20c9-475a-a38a-dd79be013587 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:06.396357 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ce022-20c9-475a-a38a-dd79be013587 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:06.414202 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-c58ce022-20c9-475a-a38a-dd79be013587 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:25:06.414202 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:06.414202 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:06.414202 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:06.414202 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:06.414202 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:06.414202 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:06.414202 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:06.414202 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:06.414202 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:06.414202 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:06.414202 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:06.414202 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:25:06.414202 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:25:06.414202 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:25:06.415164 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:25:06.415164 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:06.415164 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:06.415164 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:06.415164 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:06.415164 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:06.415164 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:06.415164 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:06.415164 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:06.415164 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:06.415164 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:06.415164 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:06.415164 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:06.415164 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:06.415164 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:06.415164 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:06.415164 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:06.416071 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:25:06.416071 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:25:06.416071 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:25:06.416071 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:06.420603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 440/891] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:25:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 17:25:06.421550 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ce022-20c9-475a-a38a-dd79be013587 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:06.441117 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:06.480437 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:06.496363 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d4df6-388a-4818-97fd-75a60dce7bc9 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:06.529069 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ce022-20c9-475a-a38a-dd79be013587 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:06.542114 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a4ca2-184d-484b-ad65-83d05f1c9bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:06.542884 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a4ca2-184d-484b-ad65-83d05f1c9bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:06.543229 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a4ca2-184d-484b-ad65-83d05f1c9bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:06.543439 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a4ca2-184d-484b-ad65-83d05f1c9bd8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:06.544709 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a4ca2-184d-484b-ad65-83d05f1c9bd8 None admin] RBAC: Adding query filter params (interface=public, service_id=3613e48f92094a679ad13442b5b911a4, region_id=RegionOne) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:06.544981 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a4ca2-184d-484b-ad65-83d05f1c9bd8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:06.546390 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a4ca2-184d-484b-ad65-83d05f1c9bd8 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:06.553964 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 452/892] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Jul 15 17:25:06 2022] GET /identity/v3/endpoints?service_id=3613e48f92094a679ad13442b5b911a4&interface=public®ion_id=RegionOne => generated 194 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:06.559796 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93430efc-8691-4a1a-b016-2980b707a243 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:06.560151 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93430efc-8691-4a1a-b016-2980b707a243 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:06.560428 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93430efc-8691-4a1a-b016-2980b707a243 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:06.565567 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 453/893] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:25:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:25:06.565567 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93430efc-8691-4a1a-b016-2980b707a243 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:06.568323 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37251d4b-9bf9-401b-8d76-f217fe0b2c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:06.569000 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37251d4b-9bf9-401b-8d76-f217fe0b2c9f None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:06.569273 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37251d4b-9bf9-401b-8d76-f217fe0b2c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:06.569551 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37251d4b-9bf9-401b-8d76-f217fe0b2c9f None admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:06.570314 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37251d4b-9bf9-401b-8d76-f217fe0b2c9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:06.570620 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37251d4b-9bf9-401b-8d76-f217fe0b2c9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:06.571986 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37251d4b-9bf9-401b-8d76-f217fe0b2c9f None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:06.584740 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 441/894] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:25:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:06.585988 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73a88c-2a87-45b5-974f-d9dffbb2c5d1 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:06.586096 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73a88c-2a87-45b5-974f-d9dffbb2c5d1 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:06.586376 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73a88c-2a87-45b5-974f-d9dffbb2c5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:06.603818 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-ac73a88c-2a87-45b5-974f-d9dffbb2c5d1 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:25:06.605116 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-ac73a88c-2a87-45b5-974f-d9dffbb2c5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:25:06.673765 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 442/895] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:25:06 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:25:06.674313 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93430efc-8691-4a1a-b016-2980b707a243 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:06.674622 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac73a88c-2a87-45b5-974f-d9dffbb2c5d1 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:06.715315 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:06.724594 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:06.726909 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2194538e-e192-4c02-bec8-0257546dbc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:06.727651 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194538e-e192-4c02-bec8-0257546dbc45 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:06.727933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194538e-e192-4c02-bec8-0257546dbc45 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:06.728466 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194538e-e192-4c02-bec8-0257546dbc45 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:06.728918 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2194538e-e192-4c02-bec8-0257546dbc45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:06.730314 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2194538e-e192-4c02-bec8-0257546dbc45 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:06.745818 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 454/896] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Jul 15 17:25:06 2022] GET /identity/v3/services => generated 1268 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:25:06.745818 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2194538e-e192-4c02-bec8-0257546dbc45 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:06.799371 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac73a88c-2a87-45b5-974f-d9dffbb2c5d1 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:06.841575 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3115b5-8121-4966-87ad-de82bc3528f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:06.842599 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3115b5-8121-4966-87ad-de82bc3528f4 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:06.842956 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3115b5-8121-4966-87ad-de82bc3528f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:06.843302 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3115b5-8121-4966-87ad-de82bc3528f4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:06.853582 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3115b5-8121-4966-87ad-de82bc3528f4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:06.855475 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3115b5-8121-4966-87ad-de82bc3528f4 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:06.873863 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2194538e-e192-4c02-bec8-0257546dbc45 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:06.875959 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-fc3115b5-8121-4966-87ad-de82bc3528f4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 17:25:06.875959 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:06.875959 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:06.875959 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:06.875959 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:06.875959 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:06.875959 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:06.875959 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:06.875959 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:06.875959 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:06.875959 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:06.875959 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:06.875959 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 17:25:06.875959 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 17:25:06.875959 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 17:25:06.875959 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 17:25:06.877035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:06.877035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:06.877035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 17:25:06.877035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:25:06.877035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 17:25:06.877035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:25:06.877035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:06.877035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:06.877035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:06.877035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:06.877035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:06.877035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:06.877035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:06.877035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:06.877035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:06.877035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:06.877035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:06.877035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:06.878023 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:06.878023 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:06.878023 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 17:25:06.878023 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 17:25:06.878023 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 17:25:06.878023 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 17:25:06.878023 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 17:25:06.878023 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 17:25:06.878023 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 17:25:06.878023 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:06.878822 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 443/897] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Jul 15 17:25:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:25:06.884772 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3115b5-8121-4966-87ad-de82bc3528f4 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:06.916296 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59647737-87ba-4351-a70b-beef3189655a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:06.916970 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59647737-87ba-4351-a70b-beef3189655a None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:06.917252 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59647737-87ba-4351-a70b-beef3189655a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:06.917526 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59647737-87ba-4351-a70b-beef3189655a None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:06.918304 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59647737-87ba-4351-a70b-beef3189655a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:06.919937 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59647737-87ba-4351-a70b-beef3189655a None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:06.937142 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 455/898] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Jul 15 17:25:06 2022] POST /identity/v3/services => generated 241 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:25:07.007688 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3115b5-8121-4966-87ad-de82bc3528f4 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:07.017841 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:07.056152 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3dd65a-34b1-4843-9eb7-2f7996209ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:07.057152 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3dd65a-34b1-4843-9eb7-2f7996209ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:07.057654 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3dd65a-34b1-4843-9eb7-2f7996209ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:07.058130 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3dd65a-34b1-4843-9eb7-2f7996209ac9 None admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:07.059610 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3dd65a-34b1-4843-9eb7-2f7996209ac9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:07.060164 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3dd65a-34b1-4843-9eb7-2f7996209ac9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:07.061879 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3dd65a-34b1-4843-9eb7-2f7996209ac9 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:07.083385 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 444/899] 10.222.0.27 () {56 vars in 1149 bytes} [Fri Jul 15 17:25:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:25:07.093812 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59647737-87ba-4351-a70b-beef3189655a None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:07.151326 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:07.201379 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542d1a4-573e-44ef-8d87-02b491f3db66 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:07.201864 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542d1a4-573e-44ef-8d87-02b491f3db66 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:07.202142 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542d1a4-573e-44ef-8d87-02b491f3db66 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:07.204365 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 445/900] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:25:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 17:25:07.209840 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82abdd-70e7-489b-960c-fcc47d13949a None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:07.210389 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82abdd-70e7-489b-960c-fcc47d13949a None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:07.210888 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82abdd-70e7-489b-960c-fcc47d13949a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:07.213450 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59647737-87ba-4351-a70b-beef3189655a None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:07.227889 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-ae82abdd-70e7-489b-960c-fcc47d13949a None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:25:07.229446 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-ae82abdd-70e7-489b-960c-fcc47d13949a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:25:07.250666 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d415cc-a070-489e-9d1d-3568a44bed88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:07.251361 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d415cc-a070-489e-9d1d-3568a44bed88 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:07.251643 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d415cc-a070-489e-9d1d-3568a44bed88 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:07.251918 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d415cc-a070-489e-9d1d-3568a44bed88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:07.305908 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 446/901] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:25:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 17:25:07.324391 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82abdd-70e7-489b-960c-fcc47d13949a None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:07.335944 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d415cc-a070-489e-9d1d-3568a44bed88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:07.337616 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d415cc-a070-489e-9d1d-3568a44bed88 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:07.405718 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:07.425671 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:07.436383 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82abdd-70e7-489b-960c-fcc47d13949a None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:07.472866 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54588c2-7ee6-4559-8f20-8d4849362e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:07.473871 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54588c2-7ee6-4559-8f20-8d4849362e03 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:07.474182 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54588c2-7ee6-4559-8f20-8d4849362e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:07.474523 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54588c2-7ee6-4559-8f20-8d4849362e03 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:07.475250 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54588c2-7ee6-4559-8f20-8d4849362e03 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:07.476781 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54588c2-7ee6-4559-8f20-8d4849362e03 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:07.477308 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 456/902] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:25:07 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 17:25:07.485838 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d415cc-a070-489e-9d1d-3568a44bed88 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:07.493404 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-c54588c2-7ee6-4559-8f20-8d4849362e03 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 17:25:07.493404 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:07.493404 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 17:25:07.493404 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 17:25:07.493404 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 17:25:07.493404 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 17:25:07.493404 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 17:25:07.493404 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:25:07.493404 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 17:25:07.493404 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:07.493404 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 17:25:07.493404 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:07.493404 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:07.493404 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:07.493404 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:07.493404 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:07.494389 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:07.494389 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:07.494389 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:07.494389 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:07.494389 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:07.494389 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:07.494389 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:07.494389 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 17:25:07.494389 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 17:25:07.494389 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 17:25:07.494389 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 17:25:07.494389 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:07.494389 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:07.494389 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:07.494389 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:07.494389 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:07.495219 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:07.495219 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:07.495219 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:07.495219 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:07.495219 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:07.495219 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:07.495219 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:07.495219 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:07.495219 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:07.495219 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:07.495219 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:07.495219 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 17:25:07.495219 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:25:07.495219 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 17:25:07.495219 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:07.495219 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 447/903] 10.222.0.27 () {56 vars in 1132 bytes} [Fri Jul 15 17:25:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 17:25:07.501041 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54588c2-7ee6-4559-8f20-8d4849362e03 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:07.605934 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54588c2-7ee6-4559-8f20-8d4849362e03 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:07.616258 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d415cc-a070-489e-9d1d-3568a44bed88 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:07.640309 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0a2dc-c5f2-4fc7-a350-5377f53a15c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:07.640985 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0a2dc-c5f2-4fc7-a350-5377f53a15c8 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:07.641268 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0a2dc-c5f2-4fc7-a350-5377f53a15c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:07.641592 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0a2dc-c5f2-4fc7-a350-5377f53a15c8 None admin] PATH_INFO: `/v3/services` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:07.642333 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b0a2dc-c5f2-4fc7-a350-5377f53a15c8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:07.642639 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b0a2dc-c5f2-4fc7-a350-5377f53a15c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:07.644065 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b0a2dc-c5f2-4fc7-a350-5377f53a15c8 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:07.653412 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 448/904] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Jul 15 17:25:07 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:07.655546 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0a2dc-c5f2-4fc7-a350-5377f53a15c8 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:07.656460 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2c37b-6303-441c-852d-67542e837f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:07.657256 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2c37b-6303-441c-852d-67542e837f6e None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:07.657531 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2c37b-6303-441c-852d-67542e837f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:07.657825 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2c37b-6303-441c-852d-67542e837f6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:07.669139 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d2c37b-6303-441c-852d-67542e837f6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:07.670429 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d2c37b-6303-441c-852d-67542e837f6e None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:07.678135 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:07.692102 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-e5d2c37b-6303-441c-852d-67542e837f6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:25:07.692102 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:07.692102 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:07.692102 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:07.692102 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:07.692102 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:07.692102 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:07.692102 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:07.692102 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:07.692102 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:07.692102 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:07.692102 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:07.692102 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:25:07.692102 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:25:07.692102 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:25:07.693096 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:25:07.693096 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:07.693096 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:07.693096 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:07.693096 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:07.693096 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:07.693096 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:07.693096 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:07.693096 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:07.693096 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:07.693096 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:07.693096 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:07.693096 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:07.693096 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:07.693096 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:07.693096 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:07.693096 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:07.694137 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:25:07.694137 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:25:07.694137 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:25:07.694137 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:25:07.700486 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 457/905] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:25:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 17:25:07.701552 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2c37b-6303-441c-852d-67542e837f6e None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:07.704634 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:07.768571 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0a2dc-c5f2-4fc7-a350-5377f53a15c8 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:07.805555 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b989f4-33a1-4533-9e67-762194a739f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:07.806362 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b989f4-33a1-4533-9e67-762194a739f9 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:07.806713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b989f4-33a1-4533-9e67-762194a739f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:07.807063 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b989f4-33a1-4533-9e67-762194a739f9 None admin] PATH_INFO: `/v3/services` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:07.807842 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b989f4-33a1-4533-9e67-762194a739f9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:07.808217 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b989f4-33a1-4533-9e67-762194a739f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:07.809845 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b989f4-33a1-4533-9e67-762194a739f9 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:07.810927 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2c37b-6303-441c-852d-67542e837f6e None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:07.820207 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 449/906] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Jul 15 17:25:07 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:07.821566 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b989f4-33a1-4533-9e67-762194a739f9 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:07.846926 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df282ebd-c5ab-4bd9-8150-38f2d9771c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:07.847865 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df282ebd-c5ab-4bd9-8150-38f2d9771c6c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:07.848351 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df282ebd-c5ab-4bd9-8150-38f2d9771c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:07.848803 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df282ebd-c5ab-4bd9-8150-38f2d9771c6c None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:07.849727 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df282ebd-c5ab-4bd9-8150-38f2d9771c6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:07.850249 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df282ebd-c5ab-4bd9-8150-38f2d9771c6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:07.851790 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df282ebd-c5ab-4bd9-8150-38f2d9771c6c None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:07.868808 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 458/907] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:25:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:07.869969 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df282ebd-c5ab-4bd9-8150-38f2d9771c6c None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:07.909410 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:07.931357 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b989f4-33a1-4533-9e67-762194a739f9 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:07.934135 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:07.970823 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8619a4fd-5f80-4945-8e77-1a89be7534ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:07.971492 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619a4fd-5f80-4945-8e77-1a89be7534ec None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:07.971828 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619a4fd-5f80-4945-8e77-1a89be7534ec None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:07.972044 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619a4fd-5f80-4945-8e77-1a89be7534ec None admin] PATH_INFO: `/v3/endpoints` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:07.972838 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8619a4fd-5f80-4945-8e77-1a89be7534ec None admin] RBAC: Adding query filter params (interface=public, service_id=cd9d007d4f00456584602663f27bb2a1, region_id=RegionOne) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:07.973147 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8619a4fd-5f80-4945-8e77-1a89be7534ec None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:07.974743 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8619a4fd-5f80-4945-8e77-1a89be7534ec None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:07.977496 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df282ebd-c5ab-4bd9-8150-38f2d9771c6c None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:07.985275 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 450/908] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Jul 15 17:25:07 2022] GET /identity/v3/endpoints?service_id=cd9d007d4f00456584602663f27bb2a1&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:07.986645 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8619a4fd-5f80-4945-8e77-1a89be7534ec None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:08.012955 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b01c49f-07fa-4a3f-a48d-b3afa172ffb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:08.014170 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01c49f-07fa-4a3f-a48d-b3afa172ffb2 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:08.014662 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01c49f-07fa-4a3f-a48d-b3afa172ffb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:08.015127 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01c49f-07fa-4a3f-a48d-b3afa172ffb2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:08.022423 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b01c49f-07fa-4a3f-a48d-b3afa172ffb2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:08.024154 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b01c49f-07fa-4a3f-a48d-b3afa172ffb2 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:08.039547 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-8b01c49f-07fa-4a3f-a48d-b3afa172ffb2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:25:08.039547 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:08.039547 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:08.039547 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:08.039547 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:08.039547 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:08.039547 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:08.039547 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:08.039547 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:08.039547 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:08.039547 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:08.039547 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:08.039547 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 17:25:08.039547 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 17:25:08.039547 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 17:25:08.040468 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 17:25:08.040468 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:08.040468 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:08.040468 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:08.040468 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:08.040468 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:08.040468 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:08.040468 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:08.040468 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:08.040468 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:08.040468 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:08.040468 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:08.040468 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:08.040468 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:08.040468 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:08.040468 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:08.040468 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:08.041367 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 17:25:08.041367 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 17:25:08.041367 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 17:25:08.041367 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 17:25:08.041367 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 17:25:08.041367 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 17:25:08.041367 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:25:08.041367 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:25:08.048459 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 459/909] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:25:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:25:08.049516 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b01c49f-07fa-4a3f-a48d-b3afa172ffb2 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:08.102655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8619a4fd-5f80-4945-8e77-1a89be7534ec None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:08.139938 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed727c74-92c6-4011-8fe1-1ad497c4c36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:08.140415 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed727c74-92c6-4011-8fe1-1ad497c4c36f None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:08.140702 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed727c74-92c6-4011-8fe1-1ad497c4c36f None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:08.140980 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed727c74-92c6-4011-8fe1-1ad497c4c36f None admin] PATH_INFO: `/v3/services` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:08.141664 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed727c74-92c6-4011-8fe1-1ad497c4c36f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:08.143110 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed727c74-92c6-4011-8fe1-1ad497c4c36f None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:08.153220 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b01c49f-07fa-4a3f-a48d-b3afa172ffb2 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:08.158090 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 451/910] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Jul 15 17:25:07 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 17:25:08.182564 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:08.196211 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c8f6e-4f74-4a50-b2f0-f88be82c8aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:08.197245 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c8f6e-4f74-4a50-b2f0-f88be82c8aff None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:08.197719 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c8f6e-4f74-4a50-b2f0-f88be82c8aff None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:08.198255 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c8f6e-4f74-4a50-b2f0-f88be82c8aff None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:08.199247 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c8f6e-4f74-4a50-b2f0-f88be82c8aff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:08.199750 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c8f6e-4f74-4a50-b2f0-f88be82c8aff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:08.201533 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c8f6e-4f74-4a50-b2f0-f88be82c8aff None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:08.216067 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 460/911] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jul 15 17:25:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:08.222486 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed727c74-92c6-4011-8fe1-1ad497c4c36f None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:08.240363 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:08.345223 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed727c74-92c6-4011-8fe1-1ad497c4c36f None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:08.382723 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dfd56e-2bf1-4428-b56f-20143abf0771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:08.383385 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dfd56e-2bf1-4428-b56f-20143abf0771 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:08.383667 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dfd56e-2bf1-4428-b56f-20143abf0771 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:08.383943 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dfd56e-2bf1-4428-b56f-20143abf0771 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:08.384774 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dfd56e-2bf1-4428-b56f-20143abf0771 None admin] RBAC: Adding query filter params (role.id=d0e262213cce48f4950efc71e4e127f8, scope.project.id=19cc5221b8074f48b5f73dc9c4289b03, user.id=b73d09bd7c1e4753a45cfdb00cc5abe9) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:08.385086 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dfd56e-2bf1-4428-b56f-20143abf0771 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:08.386564 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dfd56e-2bf1-4428-b56f-20143abf0771 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:08.392889 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 452/912] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jul 15 17:25:08 2022] GET /identity/v3/role_assignments?user.id=b73d09bd7c1e4753a45cfdb00cc5abe9&scope.project.id=19cc5221b8074f48b5f73dc9c4289b03&role.id=d0e262213cce48f4950efc71e4e127f8 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:08.856923 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e5aba-635d-464a-a15f-28c6fdc47b5c None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:08.857316 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e5aba-635d-464a-a15f-28c6fdc47b5c None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:08.857526 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e5aba-635d-464a-a15f-28c6fdc47b5c None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:08.859159 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 461/913] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:25:08.864485 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f61642-d6bf-4253-adee-a9d7bec149a4 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:08.864779 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f61642-d6bf-4253-adee-a9d7bec149a4 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:08.865061 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f61642-d6bf-4253-adee-a9d7bec149a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:08.882229 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-74f61642-d6bf-4253-adee-a9d7bec149a4 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:25:08.883432 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-74f61642-d6bf-4253-adee-a9d7bec149a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:25:08.953301 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 453/914] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:25:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:25:08.975792 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e5aba-635d-464a-a15f-28c6fdc47b5c None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:09.077756 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e5aba-635d-464a-a15f-28c6fdc47b5c None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:09.111112 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69cdb27-81c2-4ec3-b861-ca74068c4d95 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:09.111617 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69cdb27-81c2-4ec3-b861-ca74068c4d95 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:09.111617 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69cdb27-81c2-4ec3-b861-ca74068c4d95 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:09.113390 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 454/915] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 17:25:09.115792 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063edd64-2cdd-4fe8-8a8b-1d011a4a3aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:09.116657 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063edd64-2cdd-4fe8-8a8b-1d011a4a3aba None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:09.117257 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063edd64-2cdd-4fe8-8a8b-1d011a4a3aba None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:09.117545 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063edd64-2cdd-4fe8-8a8b-1d011a4a3aba None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:09.118285 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063edd64-2cdd-4fe8-8a8b-1d011a4a3aba None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:09.118621 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc67dd-1151-4400-8efd-d868e9e658c3 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:09.118980 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc67dd-1151-4400-8efd-d868e9e658c3 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:09.119332 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc67dd-1151-4400-8efd-d868e9e658c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:09.119653 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063edd64-2cdd-4fe8-8a8b-1d011a4a3aba None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:09.132232 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:09.133195 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-063edd64-2cdd-4fe8-8a8b-1d011a4a3aba None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 17:25:09.133195 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:09.133195 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 17:25:09.133195 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 17:25:09.133195 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 17:25:09.133195 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 17:25:09.133195 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 17:25:09.133195 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:25:09.133195 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 17:25:09.133195 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:25:09.133195 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 17:25:09.133195 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:25:09.133195 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:09.133195 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:09.133195 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:09.133195 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:09.133195 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:09.134669 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:09.134669 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:09.134669 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:09.134669 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:09.134669 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:09.134669 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:09.134669 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 17:25:09.134669 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 17:25:09.134669 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 17:25:09.134669 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 17:25:09.134669 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:09.134669 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:09.134669 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:09.134669 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:09.134669 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:09.134669 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:09.135493 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:09.135493 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:09.135493 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:09.135493 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:09.135493 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:09.135493 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:09.135493 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:09.135493 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:09.135493 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:09.135493 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:09.135493 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 17:25:09.135493 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:25:09.135493 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 17:25:09.135493 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:25:09.135493 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 462/916] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Jul 15 17:25:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:25:09.141477 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063edd64-2cdd-4fe8-8a8b-1d011a4a3aba None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:09.144498 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-83cc67dd-1151-4400-8efd-d868e9e658c3 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:25:09.146729 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-83cc67dd-1151-4400-8efd-d868e9e658c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:25:09.194787 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:09.241811 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 455/917] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:25:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 17:25:09.261200 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc67dd-1151-4400-8efd-d868e9e658c3 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:09.262517 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063edd64-2cdd-4fe8-8a8b-1d011a4a3aba None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:09.297441 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a294f33-51b0-4711-96d5-ca852e76d085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:09.297884 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a294f33-51b0-4711-96d5-ca852e76d085 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:09.298169 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a294f33-51b0-4711-96d5-ca852e76d085 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:09.298450 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a294f33-51b0-4711-96d5-ca852e76d085 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:09.299155 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a294f33-51b0-4711-96d5-ca852e76d085 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:09.299460 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a294f33-51b0-4711-96d5-ca852e76d085 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:09.300828 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a294f33-51b0-4711-96d5-ca852e76d085 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:09.316847 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 463/918] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Jul 15 17:25:09 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:09.322120 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a294f33-51b0-4711-96d5-ca852e76d085 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:09.366941 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc67dd-1151-4400-8efd-d868e9e658c3 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:09.404417 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed800e8-1725-405b-87e4-e72f73194c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:09.405630 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed800e8-1725-405b-87e4-e72f73194c51 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:09.406126 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed800e8-1725-405b-87e4-e72f73194c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:09.407070 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed800e8-1725-405b-87e4-e72f73194c51 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:09.407928 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed800e8-1725-405b-87e4-e72f73194c51 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:09.410196 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed800e8-1725-405b-87e4-e72f73194c51 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:09.412705 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:09.425901 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-8ed800e8-1725-405b-87e4-e72f73194c51 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 17:25:09.425901 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:09.425901 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 17:25:09.425901 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 17:25:09.425901 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 17:25:09.425901 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 17:25:09.425901 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 17:25:09.425901 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:25:09.425901 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 17:25:09.425901 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:09.425901 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 17:25:09.425901 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:09.425901 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:09.425901 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:09.425901 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:09.425901 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:09.425901 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:09.427852 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:09.427852 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:09.427852 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:09.427852 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:09.427852 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:09.427852 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:09.427852 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 17:25:09.427852 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 17:25:09.427852 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 17:25:09.427852 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 17:25:09.427852 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:09.427852 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:09.427852 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:09.427852 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:09.427852 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:09.427852 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:09.429504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:09.429504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:09.429504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:09.429504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:09.429504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:09.429504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:09.429504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:09.429504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:09.429504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:09.429504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:09.429504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 17:25:09.429504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:25:09.429504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 17:25:09.429504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:09.432267 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 456/919] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Jul 15 17:25:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:25:09.433241 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed800e8-1725-405b-87e4-e72f73194c51 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:09.447290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a294f33-51b0-4711-96d5-ca852e76d085 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:09.463127 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:09.502378 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a709a2-8128-4f64-9fdf-f49930a5fbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:09.503403 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a709a2-8128-4f64-9fdf-f49930a5fbcb None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:09.503751 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a709a2-8128-4f64-9fdf-f49930a5fbcb None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:09.504097 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a709a2-8128-4f64-9fdf-f49930a5fbcb None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:09.504937 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a709a2-8128-4f64-9fdf-f49930a5fbcb None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:09.505308 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a709a2-8128-4f64-9fdf-f49930a5fbcb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:09.507044 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a709a2-8128-4f64-9fdf-f49930a5fbcb None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:09.518011 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 464/920] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Jul 15 17:25:09 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:25:09.521300 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a709a2-8128-4f64-9fdf-f49930a5fbcb None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:09.558051 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed800e8-1725-405b-87e4-e72f73194c51 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:09.603401 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda1038-ba41-4619-8264-00a2c02aa145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:09.604065 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda1038-ba41-4619-8264-00a2c02aa145 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:09.604342 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda1038-ba41-4619-8264-00a2c02aa145 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:09.604607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda1038-ba41-4619-8264-00a2c02aa145 None admin] PATH_INFO: `/v3/services` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:09.605387 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda1038-ba41-4619-8264-00a2c02aa145 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:09.605594 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda1038-ba41-4619-8264-00a2c02aa145 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:09.607388 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda1038-ba41-4619-8264-00a2c02aa145 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:09.617099 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 457/921] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Jul 15 17:25:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:09.618156 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda1038-ba41-4619-8264-00a2c02aa145 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:09.642740 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a709a2-8128-4f64-9fdf-f49930a5fbcb None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:09.679555 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a76c3ae-8a90-47ee-b55a-62d69b73b0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:09.680363 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76c3ae-8a90-47ee-b55a-62d69b73b0ff None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:09.680738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76c3ae-8a90-47ee-b55a-62d69b73b0ff None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:09.681107 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76c3ae-8a90-47ee-b55a-62d69b73b0ff None admin] PATH_INFO: `/v3/endpoints` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:09.682092 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a76c3ae-8a90-47ee-b55a-62d69b73b0ff None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:09.683487 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a76c3ae-8a90-47ee-b55a-62d69b73b0ff None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:09.692403 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:09.709811 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 465/922] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Jul 15 17:25:09 2022] POST /identity/v3/endpoints => generated 346 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:25:09.742487 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda1038-ba41-4619-8264-00a2c02aa145 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:09.785659 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536fb6a-3be6-4ced-b6c7-91578653bd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:09.786362 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536fb6a-3be6-4ced-b6c7-91578653bd2b None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:09.786638 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536fb6a-3be6-4ced-b6c7-91578653bd2b None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:09.786904 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536fb6a-3be6-4ced-b6c7-91578653bd2b None admin] PATH_INFO: `/v3/services` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:09.787601 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5536fb6a-3be6-4ced-b6c7-91578653bd2b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:09.787896 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5536fb6a-3be6-4ced-b6c7-91578653bd2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:09.789272 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5536fb6a-3be6-4ced-b6c7-91578653bd2b None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:09.795504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 458/923] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Jul 15 17:25:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:25:09.801481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a76c3ae-8a90-47ee-b55a-62d69b73b0ff None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:09.837073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:09.914119 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a76c3ae-8a90-47ee-b55a-62d69b73b0ff None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:09.948922 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a3a21-73f6-4d17-ac0f-3dc437bdcb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:09.950123 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a3a21-73f6-4d17-ac0f-3dc437bdcb62 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:09.950623 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a3a21-73f6-4d17-ac0f-3dc437bdcb62 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:09.951183 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a3a21-73f6-4d17-ac0f-3dc437bdcb62 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:09.952158 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a3a21-73f6-4d17-ac0f-3dc437bdcb62 None admin] RBAC: Adding query filter params (interface=public, service_id=d54ce557594b4404823df3914f405c55, region_id=RegionOne) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:09.952464 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a3a21-73f6-4d17-ac0f-3dc437bdcb62 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:09.953855 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a3a21-73f6-4d17-ac0f-3dc437bdcb62 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:09.959927 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 466/924] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Jul 15 17:25:09 2022] GET /identity/v3/endpoints?service_id=d54ce557594b4404823df3914f405c55&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:09.965570 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536fb6a-3be6-4ced-b6c7-91578653bd2b None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:10.068789 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536fb6a-3be6-4ced-b6c7-91578653bd2b None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:10.092769 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:10.104509 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9269146-d1a5-41a4-ab61-b1b1b6075a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:10.105193 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9269146-d1a5-41a4-ab61-b1b1b6075a88 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:10.105472 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9269146-d1a5-41a4-ab61-b1b1b6075a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:10.105747 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9269146-d1a5-41a4-ab61-b1b1b6075a88 None admin] PATH_INFO: `/v3/services` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:10.106536 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9269146-d1a5-41a4-ab61-b1b1b6075a88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:10.107907 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9269146-d1a5-41a4-ab61-b1b1b6075a88 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:10.118147 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 459/925] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Jul 15 17:25:09 2022] GET /identity/v3/services => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:25:10.288280 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7dfd10-30bb-4293-8c33-85027a1bd8bf None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:10.288817 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7dfd10-30bb-4293-8c33-85027a1bd8bf None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:10.288817 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7dfd10-30bb-4293-8c33-85027a1bd8bf None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:10.290356 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 467/926] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:25:10.296200 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec75fd-0118-4e2b-a3c0-c999d0a998bf None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:10.296492 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec75fd-0118-4e2b-a3c0-c999d0a998bf None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:10.296769 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec75fd-0118-4e2b-a3c0-c999d0a998bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:10.324934 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-40ec75fd-0118-4e2b-a3c0-c999d0a998bf None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:25:10.326492 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-40ec75fd-0118-4e2b-a3c0-c999d0a998bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:25:10.393960 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 460/927] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:25:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:25:10.416223 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7dfd10-30bb-4293-8c33-85027a1bd8bf None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:10.457770 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3139b3-ab65-44c2-af20-f4b8594f71e0 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:10.458427 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3139b3-ab65-44c2-af20-f4b8594f71e0 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:10.458905 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3139b3-ab65-44c2-af20-f4b8594f71e0 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:10.460812 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 461/928] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:25:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:25:10.466689 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3073b-3bd3-4f14-a156-c6e1a3639f8c None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:10.467259 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3073b-3bd3-4f14-a156-c6e1a3639f8c None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:10.467768 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3073b-3bd3-4f14-a156-c6e1a3639f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:10.487073 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-c7c3073b-3bd3-4f14-a156-c6e1a3639f8c None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:25:10.489533 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-c7c3073b-3bd3-4f14-a156-c6e1a3639f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:25:10.521829 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:10.531675 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7dfd10-30bb-4293-8c33-85027a1bd8bf None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:10.570441 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41030f4c-ef8a-4b82-9443-f05f4036be5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:10.571227 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41030f4c-ef8a-4b82-9443-f05f4036be5c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:10.571499 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41030f4c-ef8a-4b82-9443-f05f4036be5c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:10.571815 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41030f4c-ef8a-4b82-9443-f05f4036be5c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:10.572566 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41030f4c-ef8a-4b82-9443-f05f4036be5c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:10.574097 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41030f4c-ef8a-4b82-9443-f05f4036be5c None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:10.587729 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-41030f4c-ef8a-4b82-9443-f05f4036be5c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 17:25:10.587729 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:10.587729 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 17:25:10.587729 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 17:25:10.587729 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 17:25:10.587729 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 17:25:10.587729 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 17:25:10.587729 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:25:10.587729 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 17:25:10.587729 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:25:10.587729 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 17:25:10.587729 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:25:10.587729 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:10.587729 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:10.587729 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:10.587729 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:10.588737 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:10.588737 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:10.588737 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:10.588737 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:10.588737 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:10.588737 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:10.588737 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:10.588737 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 17:25:10.588737 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 17:25:10.588737 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 17:25:10.588737 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 17:25:10.588737 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:10.588737 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:10.588737 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:10.588737 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:10.588737 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:10.590065 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:10.590065 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:10.590065 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:10.590065 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:10.590065 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:10.590065 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:10.590065 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:10.590065 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:10.590065 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:10.590065 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:10.590065 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:10.590065 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 17:25:10.590065 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:25:10.590065 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 17:25:10.590065 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:25:10.590065 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 468/930] 10.222.0.27 () {56 vars in 1132 bytes} [Fri Jul 15 17:25:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:25:10.591276 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 462/930] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:25:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 17:25:10.594897 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41030f4c-ef8a-4b82-9443-f05f4036be5c None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:10.614001 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3073b-3bd3-4f14-a156-c6e1a3639f8c None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:10.672897 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:10.709060 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41030f4c-ef8a-4b82-9443-f05f4036be5c None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:10.728734 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3073b-3bd3-4f14-a156-c6e1a3639f8c None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:10.753148 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b47db-0523-41be-be36-fd2d733aab32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:10.753926 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b47db-0523-41be-be36-fd2d733aab32 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:10.754209 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b47db-0523-41be-be36-fd2d733aab32 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:10.754478 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b47db-0523-41be-be36-fd2d733aab32 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:10.755336 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645b47db-0523-41be-be36-fd2d733aab32 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:10.755625 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645b47db-0523-41be-be36-fd2d733aab32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:10.757045 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645b47db-0523-41be-be36-fd2d733aab32 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:10.762804 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 469/931] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Jul 15 17:25:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:10.770893 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b47db-0523-41be-be36-fd2d733aab32 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:10.774911 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91404418-827e-47ec-b062-cd8f1687b20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:10.775744 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91404418-827e-47ec-b062-cd8f1687b20b None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:10.776019 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91404418-827e-47ec-b062-cd8f1687b20b None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:10.776291 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91404418-827e-47ec-b062-cd8f1687b20b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:10.787556 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91404418-827e-47ec-b062-cd8f1687b20b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:25:10.796608 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-91404418-827e-47ec-b062-cd8f1687b20b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 17:25:10.796608 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:10.796608 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:10.796608 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:10.796608 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:10.796608 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:10.796608 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:10.796608 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:10.796608 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:10.796608 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:10.796608 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:10.796608 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:10.796608 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:25:10.796608 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:25:10.796608 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:25:10.796608 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:25:10.797583 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:25:10.797583 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:25:10.797583 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:25:10.797583 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:25:10.797583 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:10.797583 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:10.797583 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:10.797583 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:10.797583 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:10.797583 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:10.797583 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:10.797583 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:10.797583 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:10.797583 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:10.797583 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:10.797583 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:10.798833 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:10.798833 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:10.798833 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:10.798833 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:10.798833 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:25:10.798833 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:25:10.798833 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:25:10.798833 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:25:10.798833 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:25:10.798833 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:25:10.798833 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 17:25:10.798833 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:10.798833 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 463/932] 10.222.0.27 () {56 vars in 1120 bytes} [Fri Jul 15 17:25:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 17:25:10.802987 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:10.804283 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91404418-827e-47ec-b062-cd8f1687b20b None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:10.888818 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b47db-0523-41be-be36-fd2d733aab32 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:10.912569 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91404418-827e-47ec-b062-cd8f1687b20b None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:10.919970 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:10.929845 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d7415-8b43-44e7-838e-2b6b181b27f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:10.930992 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d7415-8b43-44e7-838e-2b6b181b27f3 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:10.931481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d7415-8b43-44e7-838e-2b6b181b27f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:10.931978 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d7415-8b43-44e7-838e-2b6b181b27f3 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:10.933021 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26d7415-8b43-44e7-838e-2b6b181b27f3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:10.933591 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26d7415-8b43-44e7-838e-2b6b181b27f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:10.935633 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26d7415-8b43-44e7-838e-2b6b181b27f3 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:10.948048 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 470/933] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Jul 15 17:25:10 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:25:10.949561 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d7415-8b43-44e7-838e-2b6b181b27f3 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:10.952085 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dceb99-93a5-4637-8562-c3f55d5fb30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:10.952838 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dceb99-93a5-4637-8562-c3f55d5fb30c None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:10.953189 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dceb99-93a5-4637-8562-c3f55d5fb30c None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:10.953649 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dceb99-93a5-4637-8562-c3f55d5fb30c None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:10.954416 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dceb99-93a5-4637-8562-c3f55d5fb30c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:10.954785 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dceb99-93a5-4637-8562-c3f55d5fb30c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:10.956553 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dceb99-93a5-4637-8562-c3f55d5fb30c None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:10.969858 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 464/934] 10.222.0.27 () {56 vars in 1115 bytes} [Fri Jul 15 17:25:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:10.971192 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dceb99-93a5-4637-8562-c3f55d5fb30c None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:11.045535 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:11.064897 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d7415-8b43-44e7-838e-2b6b181b27f3 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:11.072589 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dceb99-93a5-4637-8562-c3f55d5fb30c None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:11.102367 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f53d3-2858-4f65-a937-fd7c04542479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:11.103403 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f53d3-2858-4f65-a937-fd7c04542479 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:11.103897 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f53d3-2858-4f65-a937-fd7c04542479 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:11.104472 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f53d3-2858-4f65-a937-fd7c04542479 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:11.105434 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f53d3-2858-4f65-a937-fd7c04542479 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:11.107493 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f53d3-2858-4f65-a937-fd7c04542479 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:11.109271 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9fb0b-95cf-4965-9a95-a6117bbc9ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:11.110185 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9fb0b-95cf-4965-9a95-a6117bbc9ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:11.110523 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9fb0b-95cf-4965-9a95-a6117bbc9ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:11.110883 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9fb0b-95cf-4965-9a95-a6117bbc9ff7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:11.122472 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9fb0b-95cf-4965-9a95-a6117bbc9ff7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:11.124169 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9fb0b-95cf-4965-9a95-a6117bbc9ff7 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:11.138541 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 471/935] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Jul 15 17:25:10 2022] POST /identity/v3/endpoints => generated 347 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:25:11.148945 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-c0f9fb0b-95cf-4965-9a95-a6117bbc9ff7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:25:11.148945 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:11.148945 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:11.148945 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:11.148945 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:11.148945 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:11.148945 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:11.148945 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:11.148945 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:11.148945 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:11.148945 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:11.148945 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:11.148945 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:25:11.148945 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:25:11.148945 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:25:11.149989 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:25:11.149989 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:11.149989 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:11.149989 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:11.149989 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:11.149989 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:11.149989 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:11.149989 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:11.149989 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:11.149989 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:11.149989 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:11.149989 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:11.149989 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:11.149989 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:11.149989 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:11.149989 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:11.149989 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:11.150883 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:25:11.150883 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:25:11.150883 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:25:11.150883 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:11.155436 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 465/936] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:25:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 17:25:11.156996 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f53d3-2858-4f65-a937-fd7c04542479 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:11.275973 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f53d3-2858-4f65-a937-fd7c04542479 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:11.319471 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2ea59-b135-4a56-89a3-c5f15f08fe4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:11.321461 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2ea59-b135-4a56-89a3-c5f15f08fe4d None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:11.321989 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2ea59-b135-4a56-89a3-c5f15f08fe4d None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:11.322483 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2ea59-b135-4a56-89a3-c5f15f08fe4d None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:11.323433 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb2ea59-b135-4a56-89a3-c5f15f08fe4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:11.323952 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb2ea59-b135-4a56-89a3-c5f15f08fe4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:11.325547 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb2ea59-b135-4a56-89a3-c5f15f08fe4d None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:11.338821 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:11.339431 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 472/937] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:25:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:25:11.346041 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9fb0b-95cf-4965-9a95-a6117bbc9ff7 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:11.370933 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:11.454863 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9fb0b-95cf-4965-9a95-a6117bbc9ff7 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:11.490200 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0faef7-4a2c-473b-b785-7aae55e0d2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:11.491023 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0faef7-4a2c-473b-b785-7aae55e0d2b1 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:11.491305 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0faef7-4a2c-473b-b785-7aae55e0d2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:11.491582 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0faef7-4a2c-473b-b785-7aae55e0d2b1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:11.499454 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0faef7-4a2c-473b-b785-7aae55e0d2b1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:11.500903 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0faef7-4a2c-473b-b785-7aae55e0d2b1 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:11.515766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-ac0faef7-4a2c-473b-b785-7aae55e0d2b1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 17:25:11.515766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:11.515766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:11.515766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:11.515766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:11.515766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:11.515766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:11.515766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:11.515766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:11.515766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:11.515766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:11.515766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:11.515766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 17:25:11.515766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 17:25:11.515766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 17:25:11.515766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 17:25:11.516751 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:11.516751 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:11.516751 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 17:25:11.516751 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:25:11.516751 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 17:25:11.516751 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:25:11.516751 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:11.516751 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:11.516751 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:11.516751 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:11.516751 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:11.516751 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:11.516751 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:11.516751 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:11.516751 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:11.516751 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:11.516751 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:11.516751 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:11.517724 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:11.517724 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:11.517724 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 17:25:11.517724 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 17:25:11.517724 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 17:25:11.517724 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 17:25:11.517724 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 17:25:11.517724 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 17:25:11.517724 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 17:25:11.517724 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:11.517724 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 466/938] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Jul 15 17:25:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:25:11.524784 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2ea59-b135-4a56-89a3-c5f15f08fe4d None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:11.630656 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2ea59-b135-4a56-89a3-c5f15f08fe4d None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:11.665582 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b45442-28ad-4f42-b706-539db80bfd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:11.666717 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b45442-28ad-4f42-b706-539db80bfd4b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:11.667270 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b45442-28ad-4f42-b706-539db80bfd4b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:11.667751 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b45442-28ad-4f42-b706-539db80bfd4b None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:11.668859 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b45442-28ad-4f42-b706-539db80bfd4b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:11.669480 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b45442-28ad-4f42-b706-539db80bfd4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:11.671171 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b45442-28ad-4f42-b706-539db80bfd4b None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:11.693930 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 473/939] 10.222.0.27 () {56 vars in 1149 bytes} [Fri Jul 15 17:25:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:11.696180 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0faef7-4a2c-473b-b785-7aae55e0d2b1 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:11.787411 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:11.806274 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0faef7-4a2c-473b-b785-7aae55e0d2b1 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:11.831886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d79352-9913-43a5-8835-4a5903883bcd None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:11.832622 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d79352-9913-43a5-8835-4a5903883bcd None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:11.833456 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d79352-9913-43a5-8835-4a5903883bcd None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:11.835601 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 474/940] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:25:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 17:25:11.841096 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0cf17-bd08-4645-92e6-736bb27f5da5 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:11.841438 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0cf17-bd08-4645-92e6-736bb27f5da5 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:11.841656 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0cf17-bd08-4645-92e6-736bb27f5da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:11.845578 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603d0aa-3d0b-4b06-a1a3-5576c19ff12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:11.846836 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603d0aa-3d0b-4b06-a1a3-5576c19ff12b None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:11.846836 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603d0aa-3d0b-4b06-a1a3-5576c19ff12b None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:11.847039 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603d0aa-3d0b-4b06-a1a3-5576c19ff12b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:11.860517 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603d0aa-3d0b-4b06-a1a3-5576c19ff12b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:11.862005 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603d0aa-3d0b-4b06-a1a3-5576c19ff12b None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:11.863094 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-92b0cf17-bd08-4645-92e6-736bb27f5da5 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:25:11.864686 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-92b0cf17-bd08-4645-92e6-736bb27f5da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:25:11.883039 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-6603d0aa-3d0b-4b06-a1a3-5576c19ff12b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:25:11.883039 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:11.883039 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:11.883039 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:11.883039 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:11.883039 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:11.883039 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:11.883039 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:11.883039 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:11.883039 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:11.883039 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:11.883039 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:11.883039 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:25:11.883039 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:25:11.883039 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:25:11.884055 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:25:11.884055 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:11.884055 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:11.884055 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:11.884055 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:11.884055 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:11.884055 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:11.884055 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:11.884055 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:11.884055 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:11.884055 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:11.884055 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:11.884055 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:11.884055 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:11.884055 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:11.884055 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:11.884055 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:11.885014 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:25:11.885014 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:25:11.885014 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:25:11.885014 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:11.885014 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 467/941] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:25:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:25:11.890268 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603d0aa-3d0b-4b06-a1a3-5576c19ff12b None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:11.930195 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:11.950178 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 475/942] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:25:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:25:11.967700 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0cf17-bd08-4645-92e6-736bb27f5da5 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:12.013579 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603d0aa-3d0b-4b06-a1a3-5576c19ff12b None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:12.055373 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:12.062971 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23091daa-9764-4303-ad99-ea9edfe929c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:12.063646 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23091daa-9764-4303-ad99-ea9edfe929c8 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:12.063921 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23091daa-9764-4303-ad99-ea9edfe929c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:12.064189 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23091daa-9764-4303-ad99-ea9edfe929c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:12.065151 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23091daa-9764-4303-ad99-ea9edfe929c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:12.065457 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23091daa-9764-4303-ad99-ea9edfe929c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:12.067252 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23091daa-9764-4303-ad99-ea9edfe929c8 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:12.082442 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0cf17-bd08-4645-92e6-736bb27f5da5 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:12.085853 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 468/943] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:25:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:12.089009 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23091daa-9764-4303-ad99-ea9edfe929c8 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:12.125274 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302576d-b303-49b0-92a8-d1a4d55e4831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:12.125977 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302576d-b303-49b0-92a8-d1a4d55e4831 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:12.126255 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302576d-b303-49b0-92a8-d1a4d55e4831 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:12.126525 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302576d-b303-49b0-92a8-d1a4d55e4831 None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:12.127235 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3302576d-b303-49b0-92a8-d1a4d55e4831 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:12.128748 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3302576d-b303-49b0-92a8-d1a4d55e4831 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:12.130281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: WARNING keystone.server.flask.common [None req-3302576d-b303-49b0-92a8-d1a4d55e4831 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 15 17:25:12.149176 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.sql.core [None req-3302576d-b303-49b0-92a8-d1a4d55e4831 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 15 17:25:12.149176 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 15 17:25:12.149176 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [parameters: {'id': '4b1514abc5184fd7993024feddb3079d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 15 17:25:12.149176 dv-cinder-836973-11-smb devstack@keystone.service[80149]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80149) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 15 17:25:12.163841 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-3302576d-b303-49b0-92a8-d1a4d55e4831 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4b1514abc5184fd7993024feddb3079d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4b1514abc5184fd7993024feddb3079d. Jul 15 17:25:12.163841 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:12.163841 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 15 17:25:12.163841 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 15 17:25:12.163841 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 15 17:25:12.163841 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 15 17:25:12.163841 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 15 17:25:12.163841 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application result = self._query(query) Jul 15 17:25:12.163841 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 15 17:25:12.163841 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application conn.query(q) Jul 15 17:25:12.163841 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 15 17:25:12.163841 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 15 17:25:12.163841 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 15 17:25:12.164690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application result.read() Jul 15 17:25:12.164690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 15 17:25:12.164690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 15 17:25:12.164690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 15 17:25:12.164690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 15 17:25:12.164690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 15 17:25:12.164690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 15 17:25:12.164690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 15 17:25:12.164690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 15 17:25:12.164690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 15 17:25:12.164690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:25:12.164690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 15 17:25:12.164690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:25:12.164690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:12.164690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 15 17:25:12.164690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 15 17:25:12.164690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 15 17:25:12.164690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 15 17:25:12.165669 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 15 17:25:12.165669 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application next(self.gen) Jul 15 17:25:12.165669 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 15 17:25:12.165669 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application yield resource Jul 15 17:25:12.165669 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 15 17:25:12.165669 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application next(self.gen) Jul 15 17:25:12.165669 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 15 17:25:12.165669 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self.session.rollback() Jul 15 17:25:12.165669 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 15 17:25:12.165669 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self.force_reraise() Jul 15 17:25:12.165669 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 15 17:25:12.165669 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise self.value Jul 15 17:25:12.165669 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 15 17:25:12.165669 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 15 17:25:12.165669 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 15 17:25:12.165669 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application session.commit() Jul 15 17:25:12.165669 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 15 17:25:12.166606 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 15 17:25:12.166606 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 15 17:25:12.166606 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._prepare_impl() Jul 15 17:25:12.166606 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 15 17:25:12.166606 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self.session.flush() Jul 15 17:25:12.166606 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 15 17:25:12.166606 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._flush(objects) Jul 15 17:25:12.166606 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 15 17:25:12.166606 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 15 17:25:12.166606 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 15 17:25:12.166606 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application compat.raise_( Jul 15 17:25:12.166606 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 15 17:25:12.166606 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception Jul 15 17:25:12.166606 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 15 17:25:12.166606 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application flush_context.execute() Jul 15 17:25:12.166606 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 15 17:25:12.166606 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rec.execute(self) Jul 15 17:25:12.167540 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 15 17:25:12.167540 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 15 17:25:12.167540 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 15 17:25:12.167540 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 15 17:25:12.167540 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 15 17:25:12.167540 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 15 17:25:12.167540 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 15 17:25:12.167540 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 15 17:25:12.167540 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 15 17:25:12.167540 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 15 17:25:12.167540 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 15 17:25:12.167540 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 15 17:25:12.167540 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 15 17:25:12.167540 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 15 17:25:12.167540 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 15 17:25:12.168336 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 15 17:25:12.168336 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 15 17:25:12.168336 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception Jul 15 17:25:12.168336 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 15 17:25:12.168336 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 15 17:25:12.168336 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 15 17:25:12.168336 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 15 17:25:12.168336 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 15 17:25:12.168336 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application result = self._query(query) Jul 15 17:25:12.168336 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 15 17:25:12.168336 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application conn.query(q) Jul 15 17:25:12.168336 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 15 17:25:12.168336 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 15 17:25:12.168336 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 15 17:25:12.168336 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application result.read() Jul 15 17:25:12.168336 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 15 17:25:12.168336 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 15 17:25:12.169271 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 15 17:25:12.169271 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 15 17:25:12.169271 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 15 17:25:12.169271 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 15 17:25:12.169271 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 15 17:25:12.169271 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 15 17:25:12.169271 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 15 17:25:12.169271 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 15 17:25:12.169271 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [parameters: {'id': '4b1514abc5184fd7993024feddb3079d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 15 17:25:12.169271 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 15 17:25:12.169271 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:25:12.169271 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 17:25:12.169271 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:25:12.169271 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:12.169271 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 15 17:25:12.171599 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 15 17:25:12.171599 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 15 17:25:12.171599 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 15 17:25:12.171599 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 15 17:25:12.171599 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:25:12.171599 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 17:25:12.171599 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:25:12.171599 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:12.171599 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:12.171599 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:12.171599 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:12.171599 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:12.171599 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:12.171599 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:12.171599 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:12.171599 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:12.171599 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:12.173714 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:12.173714 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 15 17:25:12.173714 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 15 17:25:12.173714 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:12.173714 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:12.173714 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 15 17:25:12.173714 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 15 17:25:12.173714 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4b1514abc5184fd7993024feddb3079d. Jul 15 17:25:12.173714 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:25:12.173714 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 476/944] 10.222.0.27 () {60 vars in 1140 bytes} [Fri Jul 15 17:25:11 2022] POST /identity/v3/projects => generated 262 bytes in 203 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:25:12.173714 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302576d-b303-49b0-92a8-d1a4d55e4831 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:12.221767 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23091daa-9764-4303-ad99-ea9edfe929c8 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:12.228910 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:12.264957 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d76cc-96a1-4b7d-941e-e7c79b24e8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:12.265961 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d76cc-96a1-4b7d-941e-e7c79b24e8b5 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:12.266722 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d76cc-96a1-4b7d-941e-e7c79b24e8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:12.266722 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d76cc-96a1-4b7d-941e-e7c79b24e8b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:12.273879 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d76cc-96a1-4b7d-941e-e7c79b24e8b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:12.275341 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d76cc-96a1-4b7d-941e-e7c79b24e8b5 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:12.289517 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-758d76cc-96a1-4b7d-941e-e7c79b24e8b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:25:12.289517 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:12.289517 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:12.289517 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:12.289517 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:12.289517 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:12.289517 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:12.289517 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:12.289517 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:12.289517 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:12.289517 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:12.289517 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:12.289517 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 17:25:12.289517 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 17:25:12.289517 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 17:25:12.290636 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 17:25:12.290636 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:12.290636 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:12.290636 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:12.290636 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:12.290636 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:12.290636 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:12.290636 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:12.290636 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:12.290636 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:12.290636 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:12.290636 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:12.290636 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:12.290636 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:12.290636 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:12.290636 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:12.290636 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:12.291551 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 17:25:12.291551 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 17:25:12.291551 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 17:25:12.291551 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 17:25:12.291551 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 17:25:12.291551 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 17:25:12.291551 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:25:12.291551 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:12.291551 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 469/945] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:25:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:25:12.292094 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0810f5-5dbd-44a0-86f6-341c46090f1a None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:12.292970 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0810f5-5dbd-44a0-86f6-341c46090f1a None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:12.292970 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0810f5-5dbd-44a0-86f6-341c46090f1a None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:12.294475 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 470/946] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:25:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:25:12.298860 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0810f5-5dbd-44a0-86f6-341c46090f1a None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:12.311853 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302576d-b303-49b0-92a8-d1a4d55e4831 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:12.352217 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa46c6-1cc7-4d3f-977b-9110fc7ab99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:12.353010 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa46c6-1cc7-4d3f-977b-9110fc7ab99f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:12.353284 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa46c6-1cc7-4d3f-977b-9110fc7ab99f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:12.353545 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa46c6-1cc7-4d3f-977b-9110fc7ab99f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:12.360770 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa46c6-1cc7-4d3f-977b-9110fc7ab99f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:12.361198 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:12.362497 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa46c6-1cc7-4d3f-977b-9110fc7ab99f None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:12.378440 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-6baa46c6-1cc7-4d3f-977b-9110fc7ab99f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:25:12.378440 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:12.378440 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:12.378440 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:12.378440 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:12.378440 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:12.378440 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:12.378440 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:12.378440 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:12.378440 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:12.378440 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:12.378440 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:12.378440 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 17:25:12.378440 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 17:25:12.378440 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 17:25:12.379438 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 17:25:12.379438 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:12.379438 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:12.379438 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:12.379438 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:12.379438 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:12.379438 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:12.379438 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:12.379438 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:12.379438 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:12.379438 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:12.379438 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:12.379438 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:12.379438 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:12.379438 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:12.379438 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:12.379438 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:12.380320 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 17:25:12.380320 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 17:25:12.380320 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 17:25:12.380320 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 17:25:12.380320 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 17:25:12.380320 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 17:25:12.380320 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:25:12.380320 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:25:12.380320 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 477/947] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:25:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:25:12.381500 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc2cba-3794-40c2-beac-3bbdfefa2d1e None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:12.381500 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc2cba-3794-40c2-beac-3bbdfefa2d1e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:12.381646 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc2cba-3794-40c2-beac-3bbdfefa2d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:12.400328 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-cdbc2cba-3794-40c2-beac-3bbdfefa2d1e None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:25:12.402066 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-cdbc2cba-3794-40c2-beac-3bbdfefa2d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:25:12.419469 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0810f5-5dbd-44a0-86f6-341c46090f1a None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:12.462613 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ce4ca-60d8-4710-bff3-b9afc726988a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:12.463965 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ce4ca-60d8-4710-bff3-b9afc726988a None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:12.464524 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ce4ca-60d8-4710-bff3-b9afc726988a None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:12.465041 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ce4ca-60d8-4710-bff3-b9afc726988a None admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:12.466790 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ce4ca-60d8-4710-bff3-b9afc726988a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:12.467412 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ce4ca-60d8-4710-bff3-b9afc726988a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:12.469097 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ce4ca-60d8-4710-bff3-b9afc726988a None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:12.471043 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 478/948] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:25:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:25:12.471878 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc2cba-3794-40c2-beac-3bbdfefa2d1e None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:12.489813 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 471/949] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jul 15 17:25:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:12.493664 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ce4ca-60d8-4710-bff3-b9afc726988a None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:12.509489 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:12.579474 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc2cba-3794-40c2-beac-3bbdfefa2d1e None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:12.602303 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ce4ca-60d8-4710-bff3-b9afc726988a None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:12.613683 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc32c2c-09ed-49c9-9740-6ed35b13c4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:12.614396 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc32c2c-09ed-49c9-9740-6ed35b13c4ed None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:12.614673 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc32c2c-09ed-49c9-9740-6ed35b13c4ed None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:12.614964 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc32c2c-09ed-49c9-9740-6ed35b13c4ed None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:12.615697 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc32c2c-09ed-49c9-9740-6ed35b13c4ed None admin] RBAC: Adding query filter params (name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:12.615997 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc32c2c-09ed-49c9-9740-6ed35b13c4ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:12.617411 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc32c2c-09ed-49c9-9740-6ed35b13c4ed None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:12.618735 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:12.645810 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 479/950] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Jul 15 17:25:12 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:12.645810 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc32c2c-09ed-49c9-9740-6ed35b13c4ed None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:12.655909 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a241a-caf3-483a-81c9-02f9bd6bb22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:12.656957 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a241a-caf3-483a-81c9-02f9bd6bb22e None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:12.657638 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a241a-caf3-483a-81c9-02f9bd6bb22e None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:12.658019 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a241a-caf3-483a-81c9-02f9bd6bb22e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:12.659198 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a241a-caf3-483a-81c9-02f9bd6bb22e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:12.660757 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a241a-caf3-483a-81c9-02f9bd6bb22e None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:12.678542 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-b69a241a-caf3-483a-81c9-02f9bd6bb22e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 17:25:12.678542 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:12.678542 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 17:25:12.678542 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 17:25:12.678542 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 17:25:12.678542 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 17:25:12.678542 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 17:25:12.678542 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:25:12.678542 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 17:25:12.678542 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:12.678542 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 17:25:12.678542 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:12.678542 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:12.678542 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:12.678542 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:12.678542 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:12.678542 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:12.679657 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:12.679657 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:12.679657 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:12.679657 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:12.679657 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:12.679657 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:12.679657 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 17:25:12.679657 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 17:25:12.679657 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 17:25:12.679657 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 17:25:12.679657 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:12.679657 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:12.679657 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:12.679657 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:12.679657 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:12.679657 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:12.680504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:12.680504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:12.680504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:12.680504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:12.680504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:12.680504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:12.680504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:12.680504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:12.680504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:12.680504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:12.680504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 17:25:12.680504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:25:12.680504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 17:25:12.680504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:12.685835 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 472/951] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Jul 15 17:25:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 17:25:12.686799 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a241a-caf3-483a-81c9-02f9bd6bb22e None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:12.744663 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:12.755713 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc32c2c-09ed-49c9-9740-6ed35b13c4ed None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:12.799099 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049e647-d78b-4d51-b7f7-63fddf802d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:12.800028 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049e647-d78b-4d51-b7f7-63fddf802d99 None admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:12.800718 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049e647-d78b-4d51-b7f7-63fddf802d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:12.800993 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049e647-d78b-4d51-b7f7-63fddf802d99 None admin] PATH_INFO: `/v3/projects/19cc5221b8074f48b5f73dc9c4289b03/users/b73d09bd7c1e4753a45cfdb00cc5abe9/roles/d0e262213cce48f4950efc71e4e127f8` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:12.803878 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3049e647-d78b-4d51-b7f7-63fddf802d99 None admin] RBAC: Authorizing `identity:create_grant(project_id=19cc5221b8074f48b5f73dc9c4289b03, user_id=b73d09bd7c1e4753a45cfdb00cc5abe9, role_id=d0e262213cce48f4950efc71e4e127f8)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:12.806125 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3049e647-d78b-4d51-b7f7-63fddf802d99 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:12.827084 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a241a-caf3-483a-81c9-02f9bd6bb22e None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:12.827909 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 480/952] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Jul 15 17:25:12 2022] PUT /identity/v3/projects/19cc5221b8074f48b5f73dc9c4289b03/users/b73d09bd7c1e4753a45cfdb00cc5abe9/roles/d0e262213cce48f4950efc71e4e127f8 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:25:12.870326 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a272b08-bb95-4bf9-acdf-ed9222cb9dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:12.870926 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a272b08-bb95-4bf9-acdf-ed9222cb9dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:12.871210 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a272b08-bb95-4bf9-acdf-ed9222cb9dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:12.871489 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a272b08-bb95-4bf9-acdf-ed9222cb9dc4 None admin] PATH_INFO: `/v3/services` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:12.872355 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a272b08-bb95-4bf9-acdf-ed9222cb9dc4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:12.872664 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a272b08-bb95-4bf9-acdf-ed9222cb9dc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:12.874084 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a272b08-bb95-4bf9-acdf-ed9222cb9dc4 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:12.880690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 473/953] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Jul 15 17:25:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:12.886456 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049e647-d78b-4d51-b7f7-63fddf802d99 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:13.003263 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049e647-d78b-4d51-b7f7-63fddf802d99 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:13.038900 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ba49a-5b07-4c7d-b668-20ff86da5e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:13.039568 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ba49a-5b07-4c7d-b668-20ff86da5e84 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:13.039851 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ba49a-5b07-4c7d-b668-20ff86da5e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:13.040163 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ba49a-5b07-4c7d-b668-20ff86da5e84 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:13.040870 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ba49a-5b07-4c7d-b668-20ff86da5e84 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:13.041165 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ba49a-5b07-4c7d-b668-20ff86da5e84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:13.042598 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ba49a-5b07-4c7d-b668-20ff86da5e84 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:13.048479 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 481/954] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Jul 15 17:25:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:13.054140 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a272b08-bb95-4bf9-acdf-ed9222cb9dc4 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:13.101493 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:13.162445 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a272b08-bb95-4bf9-acdf-ed9222cb9dc4 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:13.197933 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a051a2-6735-4f91-8b7e-40ea3c7fd1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:13.198595 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a051a2-6735-4f91-8b7e-40ea3c7fd1f6 None admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:13.198870 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a051a2-6735-4f91-8b7e-40ea3c7fd1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:13.199193 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a051a2-6735-4f91-8b7e-40ea3c7fd1f6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:13.200004 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a051a2-6735-4f91-8b7e-40ea3c7fd1f6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:13.201415 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a051a2-6735-4f91-8b7e-40ea3c7fd1f6 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:13.225491 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 474/955] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Jul 15 17:25:13 2022] POST /identity/v3/endpoints => generated 349 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:25:13.322541 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676f25a-b6a8-4b8a-a3ac-30e53bd4ada1 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:13.322886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676f25a-b6a8-4b8a-a3ac-30e53bd4ada1 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:13.323096 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676f25a-b6a8-4b8a-a3ac-30e53bd4ada1 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:13.324822 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 482/956] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:25:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:25:13.330954 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954053bb-1b46-469e-96b7-29ab9ac713d4 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:13.331266 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954053bb-1b46-469e-96b7-29ab9ac713d4 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:13.331533 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954053bb-1b46-469e-96b7-29ab9ac713d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:13.349813 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-954053bb-1b46-469e-96b7-29ab9ac713d4 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:25:13.351057 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-954053bb-1b46-469e-96b7-29ab9ac713d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:25:13.430454 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 475/957] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:25:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:25:13.452091 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676f25a-b6a8-4b8a-a3ac-30e53bd4ada1 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:13.472627 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:13.561111 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676f25a-b6a8-4b8a-a3ac-30e53bd4ada1 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:13.597873 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c2f73-e52c-4270-84e7-f598937f70b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:13.598841 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c2f73-e52c-4270-84e7-f598937f70b6 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:13.599116 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c2f73-e52c-4270-84e7-f598937f70b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:13.599397 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c2f73-e52c-4270-84e7-f598937f70b6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:13.600036 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c2f73-e52c-4270-84e7-f598937f70b6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:13.601393 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c2f73-e52c-4270-84e7-f598937f70b6 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:13.613463 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-de5c2f73-e52c-4270-84e7-f598937f70b6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 17:25:13.613463 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:13.613463 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 17:25:13.613463 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 17:25:13.613463 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 17:25:13.613463 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 17:25:13.613463 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 17:25:13.613463 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:25:13.613463 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 17:25:13.613463 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:25:13.613463 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 17:25:13.613463 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:25:13.613463 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:13.613463 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:13.613463 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:13.613463 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:13.613463 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:13.614600 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:13.614600 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:13.614600 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:13.614600 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:13.614600 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:13.614600 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:13.614600 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 17:25:13.614600 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 17:25:13.614600 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 17:25:13.614600 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 17:25:13.614600 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:13.614600 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:13.614600 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:13.614600 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:13.614600 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:13.614600 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:13.615661 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:13.615661 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:13.615661 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:13.615661 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:13.615661 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:13.615661 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:13.615661 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:13.615661 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:13.615661 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:13.615661 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:13.615661 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 17:25:13.615661 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:25:13.615661 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 17:25:13.615661 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:25:13.615661 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 483/958] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:25:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:25:13.620637 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954053bb-1b46-469e-96b7-29ab9ac713d4 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:13.645847 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:13.721541 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954053bb-1b46-469e-96b7-29ab9ac713d4 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:13.756064 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b5e6b-d584-4b38-9c0e-e8ccc28adc02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:13.756735 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b5e6b-d584-4b38-9c0e-e8ccc28adc02 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:13.757013 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b5e6b-d584-4b38-9c0e-e8ccc28adc02 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:13.757283 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b5e6b-d584-4b38-9c0e-e8ccc28adc02 None admin] PATH_INFO: `/v3/services` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:13.758021 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b5e6b-d584-4b38-9c0e-e8ccc28adc02 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:13.758325 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b5e6b-d584-4b38-9c0e-e8ccc28adc02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:13.759686 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b5e6b-d584-4b38-9c0e-e8ccc28adc02 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:13.765171 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 476/959] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Jul 15 17:25:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:13.770912 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c2f73-e52c-4270-84e7-f598937f70b6 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:13.853273 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:13.873765 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c2f73-e52c-4270-84e7-f598937f70b6 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:13.908252 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a1be8-b453-4297-8ac7-57a001ae1f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:13.909040 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a1be8-b453-4297-8ac7-57a001ae1f90 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:13.909388 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a1be8-b453-4297-8ac7-57a001ae1f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:13.909729 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a1be8-b453-4297-8ac7-57a001ae1f90 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:13.910570 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a1be8-b453-4297-8ac7-57a001ae1f90 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:13.910944 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a1be8-b453-4297-8ac7-57a001ae1f90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:13.912431 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a1be8-b453-4297-8ac7-57a001ae1f90 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:13.918289 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 484/960] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Jul 15 17:25:13 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:14.828052 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9465ac-6454-4ede-9bec-311ba6d1e9b3 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:14.828615 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9465ac-6454-4ede-9bec-311ba6d1e9b3 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:14.828615 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9465ac-6454-4ede-9bec-311ba6d1e9b3 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:14.830706 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 477/961] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:25:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:25:14.835961 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b589c4-9c75-4524-a07d-20dd55354e6f None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:14.836350 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b589c4-9c75-4524-a07d-20dd55354e6f None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:14.836513 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b589c4-9c75-4524-a07d-20dd55354e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:14.853904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-b3b589c4-9c75-4524-a07d-20dd55354e6f None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:25:14.855121 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b3b589c4-9c75-4524-a07d-20dd55354e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:25:14.929673 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 485/962] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:25:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:25:14.953456 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9465ac-6454-4ede-9bec-311ba6d1e9b3 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:14.958584 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647bf91-0a64-4b08-8f43-48422fc3d087 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:14.958870 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647bf91-0a64-4b08-8f43-48422fc3d087 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:14.959144 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647bf91-0a64-4b08-8f43-48422fc3d087 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:14.960759 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 486/963] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:25:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 17:25:14.967097 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ffc333-38da-4bf6-848c-cc5ab8551427 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:14.967664 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ffc333-38da-4bf6-848c-cc5ab8551427 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:14.967949 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ffc333-38da-4bf6-848c-cc5ab8551427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:14.985878 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-00ffc333-38da-4bf6-848c-cc5ab8551427 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:25:14.987073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-00ffc333-38da-4bf6-848c-cc5ab8551427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:25:15.065819 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 487/964] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:25:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:25:15.069364 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:15.087329 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9465ac-6454-4ede-9bec-311ba6d1e9b3 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:15.088875 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ffc333-38da-4bf6-848c-cc5ab8551427 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:15.093292 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:15.141133 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588fecba-2e3d-424d-9b81-5728903c2a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:15.142445 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588fecba-2e3d-424d-9b81-5728903c2a77 None admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:15.143210 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588fecba-2e3d-424d-9b81-5728903c2a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:15.143719 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588fecba-2e3d-424d-9b81-5728903c2a77 None admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:15.145041 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588fecba-2e3d-424d-9b81-5728903c2a77 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:15.146712 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588fecba-2e3d-424d-9b81-5728903c2a77 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:15.149064 dv-cinder-836973-11-smb devstack@keystone.service[80150]: WARNING keystone.server.flask.common [None req-588fecba-2e3d-424d-9b81-5728903c2a77 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 15 17:25:15.167426 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.sql.core [None req-588fecba-2e3d-424d-9b81-5728903c2a77 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 15 17:25:15.167426 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 15 17:25:15.167426 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [parameters: {'user_id': 'c1cc3902ed7f47c1b0c8560a2fd08051', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 15 17:25:15.167426 dv-cinder-836973-11-smb devstack@keystone.service[80150]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80150) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 15 17:25:15.189577 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-588fecba-2e3d-424d-9b81-5728903c2a77 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 15 17:25:15.189577 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:15.189577 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 15 17:25:15.189577 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 15 17:25:15.189577 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 15 17:25:15.189577 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 15 17:25:15.189577 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 15 17:25:15.189577 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application result = self._query(query) Jul 15 17:25:15.189577 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 15 17:25:15.189577 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application conn.query(q) Jul 15 17:25:15.189577 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 15 17:25:15.189577 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 15 17:25:15.189577 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 15 17:25:15.189577 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application result.read() Jul 15 17:25:15.189577 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 15 17:25:15.190580 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 15 17:25:15.190580 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 15 17:25:15.190580 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 15 17:25:15.190580 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 15 17:25:15.190580 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 15 17:25:15.190580 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 15 17:25:15.190580 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 15 17:25:15.190580 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 15 17:25:15.190580 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:15.190580 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 15 17:25:15.190580 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:15.190580 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:15.190580 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 15 17:25:15.190580 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 15 17:25:15.190580 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 15 17:25:15.190580 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 15 17:25:15.190580 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 15 17:25:15.190580 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application next(self.gen) Jul 15 17:25:15.191619 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 15 17:25:15.191619 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application yield resource Jul 15 17:25:15.191619 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 15 17:25:15.191619 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application next(self.gen) Jul 15 17:25:15.191619 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 15 17:25:15.191619 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application self.session.rollback() Jul 15 17:25:15.191619 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 15 17:25:15.191619 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application self.force_reraise() Jul 15 17:25:15.191619 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 15 17:25:15.191619 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise self.value Jul 15 17:25:15.191619 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 15 17:25:15.191619 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 15 17:25:15.191619 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 15 17:25:15.191619 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application session.commit() Jul 15 17:25:15.191619 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 15 17:25:15.191619 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 15 17:25:15.191619 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 15 17:25:15.192519 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application self._prepare_impl() Jul 15 17:25:15.192519 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 15 17:25:15.192519 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application self.session.flush() Jul 15 17:25:15.192519 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 15 17:25:15.192519 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application self._flush(objects) Jul 15 17:25:15.192519 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 15 17:25:15.192519 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 15 17:25:15.192519 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 15 17:25:15.192519 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application compat.raise_( Jul 15 17:25:15.192519 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 15 17:25:15.192519 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception Jul 15 17:25:15.192519 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 15 17:25:15.192519 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application flush_context.execute() Jul 15 17:25:15.192519 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 15 17:25:15.192519 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rec.execute(self) Jul 15 17:25:15.192519 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 15 17:25:15.192519 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 15 17:25:15.193432 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 15 17:25:15.193432 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 15 17:25:15.193432 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 15 17:25:15.193432 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 15 17:25:15.193432 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 15 17:25:15.193432 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 15 17:25:15.193432 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 15 17:25:15.193432 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 15 17:25:15.193432 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 15 17:25:15.193432 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 15 17:25:15.193432 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 15 17:25:15.193432 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 15 17:25:15.193432 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 15 17:25:15.193432 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 15 17:25:15.193432 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 15 17:25:15.193432 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception Jul 15 17:25:15.194362 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 15 17:25:15.194362 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 15 17:25:15.194362 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 15 17:25:15.194362 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 15 17:25:15.194362 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 15 17:25:15.194362 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application result = self._query(query) Jul 15 17:25:15.194362 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 15 17:25:15.194362 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application conn.query(q) Jul 15 17:25:15.194362 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 15 17:25:15.194362 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 15 17:25:15.194362 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 15 17:25:15.194362 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application result.read() Jul 15 17:25:15.194362 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 15 17:25:15.194362 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 15 17:25:15.194362 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 15 17:25:15.194362 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 15 17:25:15.195197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 15 17:25:15.195197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 15 17:25:15.195197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 15 17:25:15.195197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 15 17:25:15.195197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 15 17:25:15.195197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 15 17:25:15.195197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [parameters: {'user_id': 'c1cc3902ed7f47c1b0c8560a2fd08051', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 15 17:25:15.195197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 15 17:25:15.195197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:15.195197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 17:25:15.195197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:15.195197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:15.195197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:15.195197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:15.195197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:15.195983 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:15.195983 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:15.195983 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:15.195983 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:15.195983 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:15.195983 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:15.195983 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:15.195983 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 15 17:25:15.195983 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 15 17:25:15.195983 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:15.195983 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:15.195983 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 17:25:15.195983 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:25:15.195983 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 17:25:15.195983 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:25:15.195983 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 15 17:25:15.195983 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 15 17:25:15.196920 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 15 17:25:15.196920 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 15 17:25:15.196920 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 15 17:25:15.196920 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 15 17:25:15.196920 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 15 17:25:15.196920 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:15.201858 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 478/965] 10.222.0.27 () {60 vars in 1131 bytes} [Fri Jul 15 17:25:14 2022] POST /identity/v3/users => generated 160 bytes in 242 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:25:15.203321 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588fecba-2e3d-424d-9b81-5728903c2a77 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:15.212139 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ffc333-38da-4bf6-848c-cc5ab8551427 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:15.256005 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccfdaf-2dfe-486d-90d9-ddcbef1d51d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:15.256831 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccfdaf-2dfe-486d-90d9-ddcbef1d51d2 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:15.257112 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccfdaf-2dfe-486d-90d9-ddcbef1d51d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:15.257383 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccfdaf-2dfe-486d-90d9-ddcbef1d51d2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:15.270424 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cccfdaf-2dfe-486d-90d9-ddcbef1d51d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:25:15.281084 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-2cccfdaf-2dfe-486d-90d9-ddcbef1d51d2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 17:25:15.281084 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:15.281084 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:15.281084 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:15.281084 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:15.281084 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:15.281084 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:15.281084 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:15.281084 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:15.281084 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:15.281084 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:15.281084 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:15.281084 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:25:15.281084 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:25:15.281084 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:25:15.281084 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:25:15.282103 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:25:15.282103 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:25:15.282103 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:25:15.282103 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:25:15.282103 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:15.282103 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:15.282103 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:15.282103 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:15.282103 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:15.282103 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:15.282103 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:15.282103 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:15.282103 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:15.282103 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:15.282103 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:15.282103 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:15.282962 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:15.282962 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:15.282962 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:15.282962 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:15.282962 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:25:15.282962 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:25:15.282962 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:25:15.282962 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:25:15.282962 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:25:15.282962 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:25:15.282962 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 17:25:15.282962 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:25:15.285845 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 488/966] 10.222.0.27 () {56 vars in 1120 bytes} [Fri Jul 15 17:25:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 17:25:15.289213 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccfdaf-2dfe-486d-90d9-ddcbef1d51d2 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:15.339681 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588fecba-2e3d-424d-9b81-5728903c2a77 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:15.370711 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:15.375487 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e935fc3c-78fc-40c0-aaa9-8b33f0d49784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:15.376305 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935fc3c-78fc-40c0-aaa9-8b33f0d49784 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:15.376588 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935fc3c-78fc-40c0-aaa9-8b33f0d49784 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:15.376871 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935fc3c-78fc-40c0-aaa9-8b33f0d49784 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:15.384294 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e935fc3c-78fc-40c0-aaa9-8b33f0d49784 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:15.385959 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e935fc3c-78fc-40c0-aaa9-8b33f0d49784 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:15.401207 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-e935fc3c-78fc-40c0-aaa9-8b33f0d49784 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 17:25:15.401207 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:15.401207 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:15.401207 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:15.401207 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:15.401207 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:15.401207 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:15.401207 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:15.401207 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:15.401207 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:15.401207 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:15.401207 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:15.401207 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 17:25:15.401207 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 17:25:15.401207 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 17:25:15.401207 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 17:25:15.402508 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:15.402508 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:15.402508 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 17:25:15.402508 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:25:15.402508 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 17:25:15.402508 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:25:15.402508 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:15.402508 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:15.402508 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:15.402508 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:15.402508 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:15.402508 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:15.402508 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:15.402508 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:15.402508 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:15.402508 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:15.402508 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:15.402508 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:15.403860 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:15.403860 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:15.403860 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 17:25:15.403860 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 17:25:15.403860 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 17:25:15.403860 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 17:25:15.403860 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 17:25:15.403860 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 17:25:15.403860 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 17:25:15.403860 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:15.407391 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 479/967] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:25:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 17:25:15.408716 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99657995-0f4e-4f98-9e75-18a75b7f2b34 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:15.409010 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99657995-0f4e-4f98-9e75-18a75b7f2b34 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:15.409288 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99657995-0f4e-4f98-9e75-18a75b7f2b34 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:15.416218 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 480/968] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:25:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:25:15.416218 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99657995-0f4e-4f98-9e75-18a75b7f2b34 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:15.420204 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccfdaf-2dfe-486d-90d9-ddcbef1d51d2 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:15.430441 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:15.457082 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e4353-244f-4dda-bcd2-142002485fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:15.457755 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e4353-244f-4dda-bcd2-142002485fdf None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:15.458088 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e4353-244f-4dda-bcd2-142002485fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:15.458331 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e4353-244f-4dda-bcd2-142002485fdf None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:15.459079 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e4353-244f-4dda-bcd2-142002485fdf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:15.459383 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e4353-244f-4dda-bcd2-142002485fdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:15.460762 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e4353-244f-4dda-bcd2-142002485fdf None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:15.470765 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 489/969] 10.222.0.27 () {56 vars in 1115 bytes} [Fri Jul 15 17:25:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:15.472634 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14698c48-b20c-4839-aba9-cec07d8303fb None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:15.473170 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14698c48-b20c-4839-aba9-cec07d8303fb None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:15.474086 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14698c48-b20c-4839-aba9-cec07d8303fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:15.492207 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-14698c48-b20c-4839-aba9-cec07d8303fb None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:25:15.493401 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-14698c48-b20c-4839-aba9-cec07d8303fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:25:15.536562 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99657995-0f4e-4f98-9e75-18a75b7f2b34 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:15.565111 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 490/970] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:25:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:25:15.566132 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14698c48-b20c-4839-aba9-cec07d8303fb None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:15.581553 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4160e3-9160-40b6-8c93-a33db74943b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:15.582785 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4160e3-9160-40b6-8c93-a33db74943b0 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:15.583302 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4160e3-9160-40b6-8c93-a33db74943b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:15.583792 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4160e3-9160-40b6-8c93-a33db74943b0 None admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:15.584812 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4160e3-9160-40b6-8c93-a33db74943b0 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:15.585326 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4160e3-9160-40b6-8c93-a33db74943b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:15.587208 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4160e3-9160-40b6-8c93-a33db74943b0 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:15.625255 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 481/971] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Jul 15 17:25:15 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:15.626425 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4160e3-9160-40b6-8c93-a33db74943b0 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:15.635220 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:15.698508 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14698c48-b20c-4839-aba9-cec07d8303fb None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:15.725848 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:15.742865 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb85380-3bb3-43b4-91c8-6e6a159cdb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:15.744218 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb85380-3bb3-43b4-91c8-6e6a159cdb11 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:15.744714 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb85380-3bb3-43b4-91c8-6e6a159cdb11 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:15.745170 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb85380-3bb3-43b4-91c8-6e6a159cdb11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:15.757763 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb85380-3bb3-43b4-91c8-6e6a159cdb11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:15.759693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb85380-3bb3-43b4-91c8-6e6a159cdb11 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:15.771443 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4160e3-9160-40b6-8c93-a33db74943b0 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:15.782251 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-bcb85380-3bb3-43b4-91c8-6e6a159cdb11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:25:15.782251 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:15.782251 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:15.782251 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:15.782251 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:15.782251 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:15.782251 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:15.782251 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:15.782251 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:15.782251 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:15.782251 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:15.782251 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:15.782251 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:25:15.782251 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:25:15.782251 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:25:15.783392 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:25:15.783392 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:15.783392 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:15.783392 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:15.783392 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:15.783392 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:15.783392 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:15.783392 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:15.783392 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:15.783392 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:15.783392 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:15.783392 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:15.783392 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:15.783392 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:15.783392 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:15.783392 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:15.783392 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:15.784527 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:25:15.784527 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:25:15.784527 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:25:15.784527 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:25:15.786700 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 491/972] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:25:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:25:15.792711 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb85380-3bb3-43b4-91c8-6e6a159cdb11 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:15.814512 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03ac7f-5349-414a-bd69-cb77caa5c9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:15.816325 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03ac7f-5349-414a-bd69-cb77caa5c9ab None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:15.816920 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03ac7f-5349-414a-bd69-cb77caa5c9ab None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:15.817197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03ac7f-5349-414a-bd69-cb77caa5c9ab None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:15.817922 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03ac7f-5349-414a-bd69-cb77caa5c9ab None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:15.819314 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03ac7f-5349-414a-bd69-cb77caa5c9ab None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:15.833267 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-7a03ac7f-5349-414a-bd69-cb77caa5c9ab None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 17:25:15.833267 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:15.833267 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 17:25:15.833267 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 17:25:15.833267 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 17:25:15.833267 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 17:25:15.833267 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 17:25:15.833267 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:25:15.833267 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 17:25:15.833267 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:15.833267 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 17:25:15.833267 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:15.833267 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:15.833267 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:15.833267 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:15.833267 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:15.833267 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:15.834916 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:15.834916 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:15.834916 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:15.834916 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:15.834916 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:15.834916 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:15.834916 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 17:25:15.834916 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 17:25:15.834916 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 17:25:15.834916 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 17:25:15.834916 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:15.834916 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:15.834916 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:15.834916 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:15.834916 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:15.834916 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:15.835741 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:15.835741 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:15.835741 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:15.835741 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:15.835741 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:15.835741 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:15.835741 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:15.835741 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:15.835741 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:15.835741 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:15.835741 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 17:25:15.835741 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:25:15.835741 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 17:25:15.835741 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:15.835741 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 482/973] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Jul 15 17:25:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:25:15.840857 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03ac7f-5349-414a-bd69-cb77caa5c9ab None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:15.929100 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb85380-3bb3-43b4-91c8-6e6a159cdb11 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:15.938869 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:15.953677 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03ac7f-5349-414a-bd69-cb77caa5c9ab None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:15.964109 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac0a63-b3de-4ffc-9856-6fe58cdeac12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:15.964774 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac0a63-b3de-4ffc-9856-6fe58cdeac12 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:15.965051 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac0a63-b3de-4ffc-9856-6fe58cdeac12 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:15.965549 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac0a63-b3de-4ffc-9856-6fe58cdeac12 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:15.966297 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac0a63-b3de-4ffc-9856-6fe58cdeac12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:15.966595 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac0a63-b3de-4ffc-9856-6fe58cdeac12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:15.967943 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac0a63-b3de-4ffc-9856-6fe58cdeac12 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:15.979607 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 492/974] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:15.980855 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10ca1b-c78f-42f0-9523-2f0e349287f5 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:15.981401 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10ca1b-c78f-42f0-9523-2f0e349287f5 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:15.981668 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10ca1b-c78f-42f0-9523-2f0e349287f5 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:15.982914 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 493/975] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:25:15.985189 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10ca1b-c78f-42f0-9523-2f0e349287f5 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:15.987199 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:15.992858 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f8189-599f-4d1f-9f51-7d732057e9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:15.993548 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f8189-599f-4d1f-9f51-7d732057e9a2 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:15.993861 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f8189-599f-4d1f-9f51-7d732057e9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:15.994136 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f8189-599f-4d1f-9f51-7d732057e9a2 None admin] PATH_INFO: `/v3/services` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:15.994848 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62f8189-599f-4d1f-9f51-7d732057e9a2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:15.995149 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62f8189-599f-4d1f-9f51-7d732057e9a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:15.997036 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62f8189-599f-4d1f-9f51-7d732057e9a2 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:16.001799 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 483/976] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Jul 15 17:25:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:16.003013 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c14d09-6caf-4567-a986-98c8d33a537f None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:16.003300 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c14d09-6caf-4567-a986-98c8d33a537f None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:16.003576 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c14d09-6caf-4567-a986-98c8d33a537f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:16.021134 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-e0c14d09-6caf-4567-a986-98c8d33a537f None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:25:16.022690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-e0c14d09-6caf-4567-a986-98c8d33a537f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:25:16.091344 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 484/977] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:25:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:25:16.091816 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10ca1b-c78f-42f0-9523-2f0e349287f5 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:16.091999 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c14d09-6caf-4567-a986-98c8d33a537f None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:16.131534 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66496c4-65a1-4527-9694-02512e607497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:16.132358 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66496c4-65a1-4527-9694-02512e607497 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:16.132634 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66496c4-65a1-4527-9694-02512e607497 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:16.132905 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66496c4-65a1-4527-9694-02512e607497 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:16.140112 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66496c4-65a1-4527-9694-02512e607497 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:16.141540 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66496c4-65a1-4527-9694-02512e607497 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:16.157012 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-f66496c4-65a1-4527-9694-02512e607497 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 17:25:16.157012 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:16.157012 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:16.157012 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:16.157012 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:16.157012 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:16.157012 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:16.157012 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:16.157012 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:16.157012 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:16.157012 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:16.157012 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:16.157012 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 17:25:16.157012 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 17:25:16.157012 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 17:25:16.157012 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 17:25:16.158046 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:16.158046 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:16.158046 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 17:25:16.158046 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:25:16.158046 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 17:25:16.158046 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:25:16.158046 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:16.158046 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:16.158046 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:16.158046 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:16.158046 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:16.158046 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:16.158046 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:16.158046 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:16.158046 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:16.158046 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:16.158046 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:16.158046 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:16.159693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:16.159693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:16.159693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 17:25:16.159693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 17:25:16.159693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 17:25:16.159693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 17:25:16.159693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 17:25:16.159693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 17:25:16.159693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 17:25:16.159693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:25:16.159693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 494/978] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Jul 15 17:25:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:25:16.159693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66496c4-65a1-4527-9694-02512e607497 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:16.188659 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:16.203422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c14d09-6caf-4567-a986-98c8d33a537f None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:16.227308 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:16.239091 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a33260-431b-483c-a72b-17bbb4734266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:16.239761 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a33260-431b-483c-a72b-17bbb4734266 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:16.240037 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a33260-431b-483c-a72b-17bbb4734266 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:16.240308 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a33260-431b-483c-a72b-17bbb4734266 None admin] PATH_INFO: `/v3/services` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:16.241014 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a33260-431b-483c-a72b-17bbb4734266 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:16.241316 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a33260-431b-483c-a72b-17bbb4734266 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:16.242752 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a33260-431b-483c-a72b-17bbb4734266 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:16.248081 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 485/979] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Jul 15 17:25:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:16.248846 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a33260-431b-483c-a72b-17bbb4734266 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:16.262636 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66496c4-65a1-4527-9694-02512e607497 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:16.301561 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66267e3-8239-40e4-a2c0-6e5d388e0f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:16.302263 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66267e3-8239-40e4-a2c0-6e5d388e0f7e None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:16.302545 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66267e3-8239-40e4-a2c0-6e5d388e0f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:16.302820 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66267e3-8239-40e4-a2c0-6e5d388e0f7e None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:16.303549 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66267e3-8239-40e4-a2c0-6e5d388e0f7e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:16.304957 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66267e3-8239-40e4-a2c0-6e5d388e0f7e None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:16.320060 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 495/980] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Jul 15 17:25:16 2022] POST /identity/v3/services => generated 242 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:25:16.321034 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66267e3-8239-40e4-a2c0-6e5d388e0f7e None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:16.352407 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a33260-431b-483c-a72b-17bbb4734266 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:16.398193 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc42d8-40bd-460d-b152-e462b548f581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:16.398853 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc42d8-40bd-460d-b152-e462b548f581 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:16.399117 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc42d8-40bd-460d-b152-e462b548f581 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:16.399384 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc42d8-40bd-460d-b152-e462b548f581 None admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:16.400225 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc42d8-40bd-460d-b152-e462b548f581 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:16.400527 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc42d8-40bd-460d-b152-e462b548f581 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:16.402069 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc42d8-40bd-460d-b152-e462b548f581 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:16.421195 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 486/981] 10.222.0.27 () {56 vars in 1149 bytes} [Fri Jul 15 17:25:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:16.427195 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc42d8-40bd-460d-b152-e462b548f581 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:16.457953 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:16.475061 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:16.476550 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66267e3-8239-40e4-a2c0-6e5d388e0f7e None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:16.517379 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0cc9bd-5f7c-482d-b086-68c94f6ff5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:16.518083 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cc9bd-5f7c-482d-b086-68c94f6ff5ea None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:16.518385 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cc9bd-5f7c-482d-b086-68c94f6ff5ea None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:16.518659 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cc9bd-5f7c-482d-b086-68c94f6ff5ea None admin] PATH_INFO: `/v3/endpoints` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:16.519452 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0cc9bd-5f7c-482d-b086-68c94f6ff5ea None admin] RBAC: Adding query filter params (interface=admin, service_id=d54ce557594b4404823df3914f405c55, region_id=RegionOne) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:16.519762 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0cc9bd-5f7c-482d-b086-68c94f6ff5ea None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:16.521129 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0cc9bd-5f7c-482d-b086-68c94f6ff5ea None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:16.526352 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 496/982] 10.222.0.27 () {56 vars in 1249 bytes} [Fri Jul 15 17:25:16 2022] GET /identity/v3/endpoints?service_id=d54ce557594b4404823df3914f405c55&interface=admin®ion_id=RegionOne => generated 193 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:16.532173 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0cc9bd-5f7c-482d-b086-68c94f6ff5ea None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:16.541967 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc42d8-40bd-460d-b152-e462b548f581 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:16.579094 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fcdd2e-43d1-4085-891c-64bed28c6093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:16.579749 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fcdd2e-43d1-4085-891c-64bed28c6093 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:16.580030 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fcdd2e-43d1-4085-891c-64bed28c6093 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:16.580607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fcdd2e-43d1-4085-891c-64bed28c6093 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:16.635775 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0cc9bd-5f7c-482d-b086-68c94f6ff5ea None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:16.652157 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fcdd2e-43d1-4085-891c-64bed28c6093 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:16.653804 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fcdd2e-43d1-4085-891c-64bed28c6093 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:16.672244 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b2216-cd12-4963-8c07-0351745e3447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:16.673182 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b2216-cd12-4963-8c07-0351745e3447 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:16.673622 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b2216-cd12-4963-8c07-0351745e3447 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:16.674077 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b2216-cd12-4963-8c07-0351745e3447 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:16.675329 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b2216-cd12-4963-8c07-0351745e3447 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:16.677325 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b2216-cd12-4963-8c07-0351745e3447 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:16.687067 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 497/983] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Jul 15 17:25:16 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:25:16.708541 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:16.777230 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 487/984] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:25:16 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 15 17:25:16.783482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b2216-cd12-4963-8c07-0351745e3447 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:16.804024 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:16.897696 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b2216-cd12-4963-8c07-0351745e3447 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:16.934925 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6f3f5-bc62-4588-9e3a-9f2158aef59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:16.935718 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6f3f5-bc62-4588-9e3a-9f2158aef59f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:16.936003 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6f3f5-bc62-4588-9e3a-9f2158aef59f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:16.936274 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6f3f5-bc62-4588-9e3a-9f2158aef59f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:16.946846 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6f3f5-bc62-4588-9e3a-9f2158aef59f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:16.948302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6f3f5-bc62-4588-9e3a-9f2158aef59f None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:16.966771 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-afd6f3f5-bc62-4588-9e3a-9f2158aef59f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:25:16.966771 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:16.966771 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:16.966771 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:16.966771 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:16.966771 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:16.966771 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:16.966771 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:16.966771 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:16.966771 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:16.966771 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:16.966771 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:16.966771 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:25:16.966771 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:25:16.966771 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:25:16.967673 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:25:16.967673 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:16.967673 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:16.967673 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:16.967673 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:16.967673 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:16.967673 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:16.967673 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:16.967673 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:16.967673 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:16.967673 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:16.967673 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:16.967673 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:16.967673 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:16.967673 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:16.967673 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:16.967673 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:16.973614 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:25:16.973614 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:25:16.973614 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:25:16.973614 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:25:16.973614 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 498/985] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:25:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:25:16.973996 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fcdd2e-43d1-4085-891c-64bed28c6093 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:17.074313 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fcdd2e-43d1-4085-891c-64bed28c6093 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:17.108690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a860e0-5b2a-4f8c-adcc-a5a7eaabd314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:17.109351 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a860e0-5b2a-4f8c-adcc-a5a7eaabd314 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:17.109629 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a860e0-5b2a-4f8c-adcc-a5a7eaabd314 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:17.109937 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a860e0-5b2a-4f8c-adcc-a5a7eaabd314 None admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:17.110931 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a860e0-5b2a-4f8c-adcc-a5a7eaabd314 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:17.111231 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a860e0-5b2a-4f8c-adcc-a5a7eaabd314 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:17.112591 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a860e0-5b2a-4f8c-adcc-a5a7eaabd314 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:17.124382 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 488/986] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:17.129795 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6f3f5-bc62-4588-9e3a-9f2158aef59f None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:17.199901 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:17.235576 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6f3f5-bc62-4588-9e3a-9f2158aef59f None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:17.271376 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d010a0-48af-4803-b459-4a19d17a4bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:17.272177 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d010a0-48af-4803-b459-4a19d17a4bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:17.272460 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d010a0-48af-4803-b459-4a19d17a4bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:17.272731 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d010a0-48af-4803-b459-4a19d17a4bf7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:17.279603 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d010a0-48af-4803-b459-4a19d17a4bf7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:17.281040 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d010a0-48af-4803-b459-4a19d17a4bf7 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:17.294986 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-75d010a0-48af-4803-b459-4a19d17a4bf7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:25:17.294986 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:17.294986 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:17.294986 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:17.294986 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:17.294986 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:17.294986 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:17.294986 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:17.294986 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:17.294986 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:17.294986 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:17.294986 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:17.294986 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 17:25:17.294986 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 17:25:17.294986 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 17:25:17.295886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 17:25:17.295886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:17.295886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:17.295886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:17.295886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:17.295886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:17.295886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:17.295886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:17.295886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:17.295886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:17.295886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:17.295886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:17.295886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:17.295886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:17.295886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:17.295886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:17.295886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:17.296821 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 17:25:17.296821 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 17:25:17.296821 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 17:25:17.296821 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 17:25:17.296821 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 17:25:17.296821 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 17:25:17.296821 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:25:17.296821 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:25:17.296821 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 499/987] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:25:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:25:17.303322 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a860e0-5b2a-4f8c-adcc-a5a7eaabd314 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:17.306243 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:17.410874 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a860e0-5b2a-4f8c-adcc-a5a7eaabd314 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:17.445474 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac71502e-7e18-49f5-aeb2-f94ff95e96af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:17.446162 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71502e-7e18-49f5-aeb2-f94ff95e96af None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:17.446441 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71502e-7e18-49f5-aeb2-f94ff95e96af None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:17.446712 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71502e-7e18-49f5-aeb2-f94ff95e96af None admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:17.447490 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac71502e-7e18-49f5-aeb2-f94ff95e96af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:17.447788 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac71502e-7e18-49f5-aeb2-f94ff95e96af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:17.449208 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac71502e-7e18-49f5-aeb2-f94ff95e96af None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:17.462669 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 489/988] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jul 15 17:25:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:17.468196 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d010a0-48af-4803-b459-4a19d17a4bf7 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:17.571432 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d010a0-48af-4803-b459-4a19d17a4bf7 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:17.599333 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:17.608840 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f5d7f-ccc0-47f2-9f4c-81dc92124af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:17.609491 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f5d7f-ccc0-47f2-9f4c-81dc92124af1 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:17.609768 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f5d7f-ccc0-47f2-9f4c-81dc92124af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:17.610059 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f5d7f-ccc0-47f2-9f4c-81dc92124af1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:17.610905 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35f5d7f-ccc0-47f2-9f4c-81dc92124af1 None admin] RBAC: Adding query filter params (role.id=d0e262213cce48f4950efc71e4e127f8, scope.project.id=19cc5221b8074f48b5f73dc9c4289b03, user.id=b73d09bd7c1e4753a45cfdb00cc5abe9) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:17.611208 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35f5d7f-ccc0-47f2-9f4c-81dc92124af1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:17.612623 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35f5d7f-ccc0-47f2-9f4c-81dc92124af1 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:17.619569 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 500/989] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jul 15 17:25:17 2022] GET /identity/v3/role_assignments?user.id=b73d09bd7c1e4753a45cfdb00cc5abe9&scope.project.id=19cc5221b8074f48b5f73dc9c4289b03&role.id=d0e262213cce48f4950efc71e4e127f8 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:18.358961 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf3684-27bf-4d00-8f3d-a1a95dd77337 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:18.359489 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf3684-27bf-4d00-8f3d-a1a95dd77337 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:18.359489 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf3684-27bf-4d00-8f3d-a1a95dd77337 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:18.361038 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 490/990] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:25:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:25:18.366086 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae90533-8ab0-436e-b5ec-b5d9c0f0aa95 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:18.366496 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae90533-8ab0-436e-b5ec-b5d9c0f0aa95 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:18.366589 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae90533-8ab0-436e-b5ec-b5d9c0f0aa95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:18.383874 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-fae90533-8ab0-436e-b5ec-b5d9c0f0aa95 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:25:18.385055 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-fae90533-8ab0-436e-b5ec-b5d9c0f0aa95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:25:18.454158 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 501/991] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:25:18 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:25:18.476531 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf3684-27bf-4d00-8f3d-a1a95dd77337 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:18.539442 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:18.579621 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf3684-27bf-4d00-8f3d-a1a95dd77337 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:18.613200 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f379865-cc66-4957-888e-09bff6109c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:18.614022 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f379865-cc66-4957-888e-09bff6109c01 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:18.614296 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f379865-cc66-4957-888e-09bff6109c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:18.614565 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f379865-cc66-4957-888e-09bff6109c01 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:18.615209 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f379865-cc66-4957-888e-09bff6109c01 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:18.616551 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f379865-cc66-4957-888e-09bff6109c01 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:18.628725 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-5f379865-cc66-4957-888e-09bff6109c01 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 17:25:18.628725 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:18.628725 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 17:25:18.628725 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 17:25:18.628725 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 17:25:18.628725 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 17:25:18.628725 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 17:25:18.628725 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:25:18.628725 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 17:25:18.628725 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:18.628725 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 17:25:18.628725 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:18.628725 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:18.628725 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:18.628725 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:18.628725 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:18.628725 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:18.629766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:18.629766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:18.629766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:18.629766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:18.629766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:18.629766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:18.629766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 17:25:18.629766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 17:25:18.629766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 17:25:18.629766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 17:25:18.629766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:18.629766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:18.629766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:18.629766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:18.629766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:18.629766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:18.630917 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:18.630917 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:18.630917 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:18.630917 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:18.630917 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:18.630917 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:18.630917 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:18.630917 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:18.630917 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:18.630917 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:18.630917 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 17:25:18.630917 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:25:18.630917 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 17:25:18.630917 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:18.634181 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 491/992] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:25:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:25:18.635846 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae90533-8ab0-436e-b5ec-b5d9c0f0aa95 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:18.709384 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6fed1-0d45-4693-8d15-0d6339f5e231 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:18.709723 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6fed1-0d45-4693-8d15-0d6339f5e231 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:18.709998 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6fed1-0d45-4693-8d15-0d6339f5e231 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:18.711517 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 492/993] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:25:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:25:18.716533 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24c9c4-bbae-4ee7-bb75-b784fdfb3f48 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:18.716818 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24c9c4-bbae-4ee7-bb75-b784fdfb3f48 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:18.717090 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24c9c4-bbae-4ee7-bb75-b784fdfb3f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:18.735856 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-8f24c9c4-bbae-4ee7-bb75-b784fdfb3f48 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:25:18.737108 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-8f24c9c4-bbae-4ee7-bb75-b784fdfb3f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:25:18.742284 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae90533-8ab0-436e-b5ec-b5d9c0f0aa95 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:18.765608 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:18.779434 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94288240-fc02-43ea-8051-d5cec3b64c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:18.780394 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94288240-fc02-43ea-8051-d5cec3b64c7d None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:18.780679 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94288240-fc02-43ea-8051-d5cec3b64c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:18.780951 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94288240-fc02-43ea-8051-d5cec3b64c7d None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:18.781663 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94288240-fc02-43ea-8051-d5cec3b64c7d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:18.781995 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94288240-fc02-43ea-8051-d5cec3b64c7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:18.783364 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94288240-fc02-43ea-8051-d5cec3b64c7d None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:18.793401 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 502/994] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Jul 15 17:25:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:18.794614 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94288240-fc02-43ea-8051-d5cec3b64c7d None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:18.819497 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 493/995] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:25:18 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:25:18.842315 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f24c9c4-bbae-4ee7-bb75-b784fdfb3f48 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:18.900435 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:18.903122 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94288240-fc02-43ea-8051-d5cec3b64c7d None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:18.938169 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b691e-8420-4d7a-9741-e75692cf6a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:18.938825 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b691e-8420-4d7a-9741-e75692cf6a3f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:18.939103 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b691e-8420-4d7a-9741-e75692cf6a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:18.939371 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b691e-8420-4d7a-9741-e75692cf6a3f None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:18.940068 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b691e-8420-4d7a-9741-e75692cf6a3f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:18.940366 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b691e-8420-4d7a-9741-e75692cf6a3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:18.941713 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b691e-8420-4d7a-9741-e75692cf6a3f None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:18.945681 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f24c9c4-bbae-4ee7-bb75-b784fdfb3f48 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:18.950127 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 503/996] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Jul 15 17:25:18 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:18.952618 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b691e-8420-4d7a-9741-e75692cf6a3f None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:18.992419 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca090e07-23f7-411a-b55c-ac826c848a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:18.993257 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca090e07-23f7-411a-b55c-ac826c848a18 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:18.993544 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca090e07-23f7-411a-b55c-ac826c848a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:18.993840 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca090e07-23f7-411a-b55c-ac826c848a18 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:18.994855 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca090e07-23f7-411a-b55c-ac826c848a18 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:18.996626 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca090e07-23f7-411a-b55c-ac826c848a18 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:19.002363 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:19.009234 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-ca090e07-23f7-411a-b55c-ac826c848a18 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 17:25:19.009234 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:19.009234 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 17:25:19.009234 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 17:25:19.009234 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 17:25:19.009234 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 17:25:19.009234 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 17:25:19.009234 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:25:19.009234 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 17:25:19.009234 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:19.009234 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 17:25:19.009234 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:19.009234 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:19.009234 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:19.009234 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:19.009234 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:19.009234 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:19.010461 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:19.010461 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:19.010461 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:19.010461 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:19.010461 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:19.010461 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:19.010461 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 17:25:19.010461 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 17:25:19.010461 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 17:25:19.010461 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 17:25:19.010461 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:19.010461 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:19.010461 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:19.010461 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:19.010461 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:19.010461 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:19.011299 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:19.011299 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:19.011299 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:19.011299 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:19.011299 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:19.011299 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:19.011299 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:19.011299 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:19.011299 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:19.011299 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:19.011299 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 17:25:19.011299 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:25:19.011299 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 17:25:19.011299 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:19.011299 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 494/997] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Jul 15 17:25:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:25:19.016688 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca090e07-23f7-411a-b55c-ac826c848a18 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:19.059938 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b691e-8420-4d7a-9741-e75692cf6a3f None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:19.094989 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb675e-c72f-45f7-b307-fc8bc759f8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:19.095564 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb675e-c72f-45f7-b307-fc8bc759f8b2 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:19.095842 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb675e-c72f-45f7-b307-fc8bc759f8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:19.096111 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb675e-c72f-45f7-b307-fc8bc759f8b2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:19.096896 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb675e-c72f-45f7-b307-fc8bc759f8b2 None admin] RBAC: Adding query filter params (interface=public, service_id=6f0ec1bfeefe466aa0410fa3e6135ad8, region_id=RegionOne) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:19.097203 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb675e-c72f-45f7-b307-fc8bc759f8b2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:19.098596 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb675e-c72f-45f7-b307-fc8bc759f8b2 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:19.103758 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 504/998] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Jul 15 17:25:18 2022] GET /identity/v3/endpoints?service_id=6f0ec1bfeefe466aa0410fa3e6135ad8&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:25:19.109236 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb675e-c72f-45f7-b307-fc8bc759f8b2 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:19.132857 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca090e07-23f7-411a-b55c-ac826c848a18 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:19.154068 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:19.171411 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d9b59-d961-4436-9c17-3facdc84f816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:19.172059 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d9b59-d961-4436-9c17-3facdc84f816 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:19.172372 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d9b59-d961-4436-9c17-3facdc84f816 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:19.172645 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d9b59-d961-4436-9c17-3facdc84f816 None admin] PATH_INFO: `/v3/services` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:19.173344 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d9b59-d961-4436-9c17-3facdc84f816 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:19.173631 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d9b59-d961-4436-9c17-3facdc84f816 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:19.175046 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d9b59-d961-4436-9c17-3facdc84f816 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:19.185284 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 495/999] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Jul 15 17:25:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:25:19.186391 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d9b59-d961-4436-9c17-3facdc84f816 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:19.218799 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb675e-c72f-45f7-b307-fc8bc759f8b2 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:19.232984 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:19.256005 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8beaa22-6c75-4480-ae64-4b1c7e8c4613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:19.257164 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8beaa22-6c75-4480-ae64-4b1c7e8c4613 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:19.257453 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8beaa22-6c75-4480-ae64-4b1c7e8c4613 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:19.257829 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8beaa22-6c75-4480-ae64-4b1c7e8c4613 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:19.258449 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8beaa22-6c75-4480-ae64-4b1c7e8c4613 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:19.259824 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8beaa22-6c75-4480-ae64-4b1c7e8c4613 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:19.266433 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 505/1000] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Jul 15 17:25:19 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 17:25:19.293958 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d9b59-d961-4436-9c17-3facdc84f816 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:19.339747 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1769607d-db0b-4feb-9346-ea4806db2312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:19.340666 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769607d-db0b-4feb-9346-ea4806db2312 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:19.340948 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769607d-db0b-4feb-9346-ea4806db2312 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:19.341220 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769607d-db0b-4feb-9346-ea4806db2312 None admin] PATH_INFO: `/v3/services` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:19.341984 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1769607d-db0b-4feb-9346-ea4806db2312 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:19.342286 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1769607d-db0b-4feb-9346-ea4806db2312 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:19.343672 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1769607d-db0b-4feb-9346-ea4806db2312 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:19.354478 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 496/1001] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Jul 15 17:25:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:19.355395 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8beaa22-6c75-4480-ae64-4b1c7e8c4613 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:19.464205 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8beaa22-6c75-4480-ae64-4b1c7e8c4613 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:19.502121 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97b8a1-181f-43b2-8259-ba2cbc21f007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:19.503140 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97b8a1-181f-43b2-8259-ba2cbc21f007 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:19.503648 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97b8a1-181f-43b2-8259-ba2cbc21f007 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:19.504134 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97b8a1-181f-43b2-8259-ba2cbc21f007 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:19.505094 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97b8a1-181f-43b2-8259-ba2cbc21f007 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:19.506795 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97b8a1-181f-43b2-8259-ba2cbc21f007 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:19.524622 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 506/1002] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Jul 15 17:25:19 2022] POST /identity/v3/endpoints => generated 325 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 17:25:19.628005 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ae46a-9b99-4eb9-ad7a-c975949b0ff3 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:19.628506 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ae46a-9b99-4eb9-ad7a-c975949b0ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:19.628506 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ae46a-9b99-4eb9-ad7a-c975949b0ff3 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:19.629959 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 497/1003] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:25:19.635894 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5718c26-3f4f-4b86-b4bd-ed2397d44418 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:19.636202 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5718c26-3f4f-4b86-b4bd-ed2397d44418 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:19.636427 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5718c26-3f4f-4b86-b4bd-ed2397d44418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:19.654373 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-d5718c26-3f4f-4b86-b4bd-ed2397d44418 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:25:19.655579 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d5718c26-3f4f-4b86-b4bd-ed2397d44418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:25:19.690551 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:19.741228 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 507/1004] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:25:19 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:25:19.763714 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ae46a-9b99-4eb9-ad7a-c975949b0ff3 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:19.820550 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:19.876404 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ae46a-9b99-4eb9-ad7a-c975949b0ff3 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:19.913411 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811aba9-3180-4f98-8279-028590b00d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:19.914162 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811aba9-3180-4f98-8279-028590b00d77 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:19.914440 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811aba9-3180-4f98-8279-028590b00d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:19.914711 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811aba9-3180-4f98-8279-028590b00d77 None admin] PATH_INFO: `/v3/services/image` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:19.915366 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5811aba9-3180-4f98-8279-028590b00d77 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:19.916829 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5811aba9-3180-4f98-8279-028590b00d77 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:19.928892 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-5811aba9-3180-4f98-8279-028590b00d77 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 17:25:19.928892 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:19.928892 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 17:25:19.928892 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 17:25:19.928892 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 17:25:19.928892 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 17:25:19.928892 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 17:25:19.928892 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:25:19.928892 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 17:25:19.928892 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:19.928892 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 17:25:19.928892 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:19.928892 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:19.928892 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:19.928892 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:19.928892 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:19.928892 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:19.930226 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:19.930226 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:19.930226 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:19.930226 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:19.930226 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:19.930226 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:19.930226 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 17:25:19.930226 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 17:25:19.930226 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 17:25:19.930226 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 17:25:19.930226 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:19.930226 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:19.930226 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:19.930226 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:19.930226 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:19.930226 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:19.931098 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:19.931098 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:19.931098 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:19.931098 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:19.931098 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:19.931098 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:19.931098 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:19.931098 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:19.931098 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:19.931098 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:19.931098 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 17:25:19.931098 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:25:19.931098 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 17:25:19.931098 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:19.931098 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 498/1005] 10.222.0.27 () {56 vars in 1105 bytes} [Fri Jul 15 17:25:19 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:25:19.938025 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5718c26-3f4f-4b86-b4bd-ed2397d44418 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:20.045311 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5718c26-3f4f-4b86-b4bd-ed2397d44418 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:20.081606 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e176d9-9e1a-44b5-82fe-409690ae2b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:20.082295 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e176d9-9e1a-44b5-82fe-409690ae2b33 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:20.082572 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e176d9-9e1a-44b5-82fe-409690ae2b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:20.082842 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e176d9-9e1a-44b5-82fe-409690ae2b33 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:20.083540 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e176d9-9e1a-44b5-82fe-409690ae2b33 None admin] RBAC: Adding query filter params (name=image) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:20.083838 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e176d9-9e1a-44b5-82fe-409690ae2b33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:20.085195 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e176d9-9e1a-44b5-82fe-409690ae2b33 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:20.090527 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 508/1006] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:25:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:20.096124 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811aba9-3180-4f98-8279-028590b00d77 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:20.196364 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811aba9-3180-4f98-8279-028590b00d77 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:20.209710 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:20.236349 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95feef41-b943-46c8-9a10-fb78ee4e46b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:20.237028 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95feef41-b943-46c8-9a10-fb78ee4e46b8 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:20.237305 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95feef41-b943-46c8-9a10-fb78ee4e46b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:20.237574 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95feef41-b943-46c8-9a10-fb78ee4e46b8 None admin] PATH_INFO: `/v3/services` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:20.238308 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95feef41-b943-46c8-9a10-fb78ee4e46b8 None admin] RBAC: Adding query filter params (type=image) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:20.238611 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95feef41-b943-46c8-9a10-fb78ee4e46b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:20.239970 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95feef41-b943-46c8-9a10-fb78ee4e46b8 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:20.245598 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 499/1007] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:25:20 2022] GET /identity/v3/services?type=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:21.278224 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa06d7c-c0fb-474a-bb51-4dcde64ca9b4 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:21.278224 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa06d7c-c0fb-474a-bb51-4dcde64ca9b4 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:21.278837 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa06d7c-c0fb-474a-bb51-4dcde64ca9b4 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:21.279806 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 509/1008] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:25:21.285635 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47e8b5-99d4-40d0-a01a-f94cb9357bec None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:21.286119 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47e8b5-99d4-40d0-a01a-f94cb9357bec None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:21.286215 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47e8b5-99d4-40d0-a01a-f94cb9357bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:21.304072 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-0f47e8b5-99d4-40d0-a01a-f94cb9357bec None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:25:21.305598 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-0f47e8b5-99d4-40d0-a01a-f94cb9357bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:25:21.382156 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 500/1009] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:25:21 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:25:21.404888 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa06d7c-c0fb-474a-bb51-4dcde64ca9b4 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:21.435466 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:21.513296 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa06d7c-c0fb-474a-bb51-4dcde64ca9b4 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:21.540032 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c0fff-5602-4731-9c0d-7ab5521b05a8 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:21.540235 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c0fff-5602-4731-9c0d-7ab5521b05a8 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:21.540517 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c0fff-5602-4731-9c0d-7ab5521b05a8 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:21.541933 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 501/1010] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:25:21.546798 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8cd80-f0ac-48dc-b8fd-a90947b67034 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:21.547081 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8cd80-f0ac-48dc-b8fd-a90947b67034 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:21.547351 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8cd80-f0ac-48dc-b8fd-a90947b67034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:21.554517 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d01eb-3e68-469f-b076-28c877540e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:21.555317 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d01eb-3e68-469f-b076-28c877540e8a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:21.555596 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d01eb-3e68-469f-b076-28c877540e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:21.555866 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d01eb-3e68-469f-b076-28c877540e8a None admin] PATH_INFO: `/v3/services/compute` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:21.556542 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3d01eb-3e68-469f-b076-28c877540e8a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:21.557934 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3d01eb-3e68-469f-b076-28c877540e8a None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:21.566069 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-a3b8cd80-f0ac-48dc-b8fd-a90947b67034 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:25:21.567243 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-a3b8cd80-f0ac-48dc-b8fd-a90947b67034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:25:21.570125 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-8f3d01eb-3e68-469f-b076-28c877540e8a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 17:25:21.570125 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:21.570125 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 17:25:21.570125 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 17:25:21.570125 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 17:25:21.570125 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 17:25:21.570125 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 17:25:21.570125 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:25:21.570125 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 17:25:21.570125 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:25:21.570125 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 17:25:21.570125 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:25:21.570125 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:21.570125 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:21.570125 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:21.570125 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:21.570125 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:21.571120 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:21.571120 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:21.571120 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:21.571120 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:21.571120 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:21.571120 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:21.571120 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 17:25:21.571120 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 17:25:21.571120 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 17:25:21.571120 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 17:25:21.571120 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:21.571120 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:21.571120 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:21.571120 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:21.571120 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:21.571120 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:21.572147 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:21.572147 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:21.572147 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:21.572147 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:21.572147 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:21.572147 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:21.572147 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:21.572147 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:21.572147 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:21.572147 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:21.572147 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 17:25:21.572147 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:25:21.572147 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 17:25:21.572147 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:25:21.572147 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 510/1011] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:25:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:25:21.577318 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d01eb-3e68-469f-b076-28c877540e8a None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:21.639931 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 502/1012] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:25:21 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 17:25:21.662548 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8cd80-f0ac-48dc-b8fd-a90947b67034 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:21.675100 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:21.684642 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d01eb-3e68-469f-b076-28c877540e8a None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:21.702418 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:21.722222 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8940e507-a46e-4829-b387-163e6ac59815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:21.722893 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940e507-a46e-4829-b387-163e6ac59815 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:21.723172 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940e507-a46e-4829-b387-163e6ac59815 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:21.723446 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940e507-a46e-4829-b387-163e6ac59815 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:21.724208 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8940e507-a46e-4829-b387-163e6ac59815 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:21.724449 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8940e507-a46e-4829-b387-163e6ac59815 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:21.725829 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8940e507-a46e-4829-b387-163e6ac59815 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:21.731124 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 511/1013] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Jul 15 17:25:21 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:25:21.736835 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8940e507-a46e-4829-b387-163e6ac59815 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:21.776835 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8cd80-f0ac-48dc-b8fd-a90947b67034 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:21.813674 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d998ca-5081-4bf5-9c51-e3cc5f06d53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:21.814429 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d998ca-5081-4bf5-9c51-e3cc5f06d53c None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:21.814713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d998ca-5081-4bf5-9c51-e3cc5f06d53c None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:21.814996 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d998ca-5081-4bf5-9c51-e3cc5f06d53c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:21.816191 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d998ca-5081-4bf5-9c51-e3cc5f06d53c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:21.817619 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d998ca-5081-4bf5-9c51-e3cc5f06d53c None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:21.819304 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 503/1014] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:25:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:25:21.825566 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d998ca-5081-4bf5-9c51-e3cc5f06d53c None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:21.847115 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8940e507-a46e-4829-b387-163e6ac59815 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:21.885172 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecffe379-5ae1-48cd-9c26-ef5c599c4413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:21.885877 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffe379-5ae1-48cd-9c26-ef5c599c4413 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:21.886163 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffe379-5ae1-48cd-9c26-ef5c599c4413 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:21.886440 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffe379-5ae1-48cd-9c26-ef5c599c4413 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:21.887501 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecffe379-5ae1-48cd-9c26-ef5c599c4413 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:21.887809 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecffe379-5ae1-48cd-9c26-ef5c599c4413 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:21.889189 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecffe379-5ae1-48cd-9c26-ef5c599c4413 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:21.894153 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 512/1015] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Jul 15 17:25:21 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:21.899632 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecffe379-5ae1-48cd-9c26-ef5c599c4413 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:21.923387 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:21.936491 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d998ca-5081-4bf5-9c51-e3cc5f06d53c None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:21.939242 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:21.973830 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020cf175-e052-4a25-be19-2bc760296b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:21.974496 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cf175-e052-4a25-be19-2bc760296b18 None admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:21.974775 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cf175-e052-4a25-be19-2bc760296b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:21.975046 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cf175-e052-4a25-be19-2bc760296b18 None admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:21.975747 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020cf175-e052-4a25-be19-2bc760296b18 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:21.977157 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020cf175-e052-4a25-be19-2bc760296b18 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:22.005099 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 504/1016] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Jul 15 17:25:21 2022] POST /identity/v3/projects => generated 311 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:25:22.013585 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecffe379-5ae1-48cd-9c26-ef5c599c4413 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:22.052220 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a58f9-f5d8-466a-a701-65e952232540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:22.052894 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a58f9-f5d8-466a-a701-65e952232540 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:22.053178 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a58f9-f5d8-466a-a701-65e952232540 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:22.053457 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a58f9-f5d8-466a-a701-65e952232540 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:22.054359 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a58f9-f5d8-466a-a701-65e952232540 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:22.055706 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a58f9-f5d8-466a-a701-65e952232540 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:22.083576 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 513/1017] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Jul 15 17:25:21 2022] POST /identity/v3/endpoints => generated 334 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 17:25:22.225339 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794fc2a-752b-44ec-b9e9-1731fd7733f7 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:22.225625 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794fc2a-752b-44ec-b9e9-1731fd7733f7 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:22.226049 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794fc2a-752b-44ec-b9e9-1731fd7733f7 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:22.227492 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 505/1018] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:25:22.233654 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdc4ae-002a-483a-89e2-ced3578dbb72 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:22.234014 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdc4ae-002a-483a-89e2-ced3578dbb72 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:22.234295 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdc4ae-002a-483a-89e2-ced3578dbb72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:22.252919 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-a1fdc4ae-002a-483a-89e2-ced3578dbb72 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:25:22.254175 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a1fdc4ae-002a-483a-89e2-ced3578dbb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:25:22.331350 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 514/1019] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:25:22 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:25:22.354605 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794fc2a-752b-44ec-b9e9-1731fd7733f7 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:22.461477 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794fc2a-752b-44ec-b9e9-1731fd7733f7 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:22.496235 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4a384-8120-4c2b-83bc-0c81023fc4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:22.496932 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4a384-8120-4c2b-83bc-0c81023fc4b3 None admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:22.497213 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4a384-8120-4c2b-83bc-0c81023fc4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:22.497487 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4a384-8120-4c2b-83bc-0c81023fc4b3 None admin] PATH_INFO: `/v3/services` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:22.498257 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e4a384-8120-4c2b-83bc-0c81023fc4b3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:22.499627 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e4a384-8120-4c2b-83bc-0c81023fc4b3 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:22.513898 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 506/1020] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Jul 15 17:25:22 2022] POST /identity/v3/services => generated 242 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:25:24.127916 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531cdb3-c317-4c74-bc06-fbd2aca8596b None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:24.128467 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531cdb3-c317-4c74-bc06-fbd2aca8596b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:24.128467 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531cdb3-c317-4c74-bc06-fbd2aca8596b None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:24.130047 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 515/1021] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:25:24.135256 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f690d-b646-48c1-b700-438427342377 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:24.135679 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f690d-b646-48c1-b700-438427342377 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:24.135848 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f690d-b646-48c1-b700-438427342377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:24.153160 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-7a3f690d-b646-48c1-b700-438427342377 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:25:24.154717 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-7a3f690d-b646-48c1-b700-438427342377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:25:24.166737 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:24.184706 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa5693-2d3d-4a19-b5aa-93823259e70f None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:24.185008 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa5693-2d3d-4a19-b5aa-93823259e70f None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:24.185264 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa5693-2d3d-4a19-b5aa-93823259e70f None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:24.186828 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 516/1022] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 17:25:24.191708 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e430e-23c9-4b5a-b495-f2d044f61af3 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:24.191992 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e430e-23c9-4b5a-b495-f2d044f61af3 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:24.192284 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e430e-23c9-4b5a-b495-f2d044f61af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:24.197463 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:24.211627 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-2d3e430e-23c9-4b5a-b495-f2d044f61af3 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:25:24.212808 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-2d3e430e-23c9-4b5a-b495-f2d044f61af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:25:24.241603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 507/1023] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:25:24 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:25:24.265601 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f690d-b646-48c1-b700-438427342377 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:24.282183 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 517/1024] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:25:24 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 17:25:24.306593 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e430e-23c9-4b5a-b495-f2d044f61af3 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:24.375372 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f690d-b646-48c1-b700-438427342377 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:24.408954 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e430e-23c9-4b5a-b495-f2d044f61af3 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:24.410701 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c83f0-cfb5-4f75-93f5-a6766e4e2344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:24.412075 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c83f0-cfb5-4f75-93f5-a6766e4e2344 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:24.412075 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c83f0-cfb5-4f75-93f5-a6766e4e2344 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:24.412247 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c83f0-cfb5-4f75-93f5-a6766e4e2344 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:24.413256 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c83f0-cfb5-4f75-93f5-a6766e4e2344 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:24.414726 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c83f0-cfb5-4f75-93f5-a6766e4e2344 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:24.416508 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 508/1025] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:25:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:24.422546 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c83f0-cfb5-4f75-93f5-a6766e4e2344 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:24.435750 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:24.446787 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:24.453351 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf25237b-eebc-40ab-bff8-0cbc9ec56c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:24.454487 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25237b-eebc-40ab-bff8-0cbc9ec56c16 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:24.455278 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25237b-eebc-40ab-bff8-0cbc9ec56c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:24.455561 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25237b-eebc-40ab-bff8-0cbc9ec56c16 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:24.467894 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf25237b-eebc-40ab-bff8-0cbc9ec56c16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:25:24.476124 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-cf25237b-eebc-40ab-bff8-0cbc9ec56c16 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 17:25:24.476124 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:24.476124 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:24.476124 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:24.476124 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:24.476124 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:24.476124 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:24.476124 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:24.476124 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:24.476124 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:24.476124 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:24.476124 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:24.476124 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:25:24.476124 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:25:24.476124 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:25:24.476124 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:25:24.477060 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:25:24.477060 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:25:24.477060 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:25:24.477060 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:25:24.477060 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:24.477060 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:24.477060 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:24.477060 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:24.477060 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:24.477060 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:24.477060 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:24.477060 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:24.477060 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:24.477060 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:24.477060 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:24.477060 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:24.478165 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:24.478165 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:24.478165 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:24.478165 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:24.478165 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:25:24.478165 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:25:24.478165 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:25:24.478165 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:25:24.478165 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:25:24.478165 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:25:24.478165 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 17:25:24.478165 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:25:24.478165 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 518/1026] 10.222.0.27 () {56 vars in 1120 bytes} [Fri Jul 15 17:25:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 17:25:24.483959 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf25237b-eebc-40ab-bff8-0cbc9ec56c16 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:24.537357 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c83f0-cfb5-4f75-93f5-a6766e4e2344 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:24.574471 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd96986-c356-48bb-bb7c-afc1dacd1bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:24.575148 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd96986-c356-48bb-bb7c-afc1dacd1bf9 None admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:24.575475 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd96986-c356-48bb-bb7c-afc1dacd1bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:24.575745 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd96986-c356-48bb-bb7c-afc1dacd1bf9 None admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:24.576453 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd96986-c356-48bb-bb7c-afc1dacd1bf9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:24.577941 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd96986-c356-48bb-bb7c-afc1dacd1bf9 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:24.586007 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf25237b-eebc-40ab-bff8-0cbc9ec56c16 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:24.609819 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 509/1027] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Jul 15 17:25:24 2022] POST /identity/v3/users => generated 285 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 17:25:24.609819 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c908813-7f42-46e2-b57e-907a48c0328e None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:24.609819 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c908813-7f42-46e2-b57e-907a48c0328e None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:24.609819 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c908813-7f42-46e2-b57e-907a48c0328e None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:24.609819 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 510/1028] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:25:24.609819 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56beee4e-f142-4dd2-89c8-fbe5586934f5 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:24.609819 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56beee4e-f142-4dd2-89c8-fbe5586934f5 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:24.610444 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56beee4e-f142-4dd2-89c8-fbe5586934f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:24.626820 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-56beee4e-f142-4dd2-89c8-fbe5586934f5 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:25:24.628043 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-56beee4e-f142-4dd2-89c8-fbe5586934f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:25:24.628595 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35023c6-9c9a-4e1f-a44d-567c5a9990a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:24.629335 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35023c6-9c9a-4e1f-a44d-567c5a9990a9 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:24.629616 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35023c6-9c9a-4e1f-a44d-567c5a9990a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:24.629929 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35023c6-9c9a-4e1f-a44d-567c5a9990a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:24.630747 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35023c6-9c9a-4e1f-a44d-567c5a9990a9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:24.631065 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35023c6-9c9a-4e1f-a44d-567c5a9990a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:24.632480 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35023c6-9c9a-4e1f-a44d-567c5a9990a9 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:24.641936 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 519/1029] 10.222.0.27 () {56 vars in 1115 bytes} [Fri Jul 15 17:25:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:24.647807 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35023c6-9c9a-4e1f-a44d-567c5a9990a9 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:24.705674 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:24.711476 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:24.726518 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 511/1030] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:25:24 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:25:24.740319 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56beee4e-f142-4dd2-89c8-fbe5586934f5 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:24.769177 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35023c6-9c9a-4e1f-a44d-567c5a9990a9 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:24.814615 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67c685-d15a-49f9-a1f1-ab3966423443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:24.815570 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67c685-d15a-49f9-a1f1-ab3966423443 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:24.815848 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67c685-d15a-49f9-a1f1-ab3966423443 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:24.816426 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67c685-d15a-49f9-a1f1-ab3966423443 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:24.833168 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc67c685-d15a-49f9-a1f1-ab3966423443 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:24.834651 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc67c685-d15a-49f9-a1f1-ab3966423443 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:24.854664 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-dc67c685-d15a-49f9-a1f1-ab3966423443 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:25:24.854664 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:24.854664 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:24.854664 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:24.854664 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:24.854664 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:24.854664 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:24.854664 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:24.854664 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:24.854664 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:24.854664 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:24.854664 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:24.854664 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:25:24.854664 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:25:24.854664 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:25:24.855671 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:25:24.855671 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:24.855671 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:24.855671 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:24.855671 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:24.855671 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:24.855671 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:24.855671 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:24.855671 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:24.855671 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:24.855671 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:24.855671 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:24.855671 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:24.855671 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:24.855671 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:24.855671 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:24.855671 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:24.856579 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:25:24.856579 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:25:24.856579 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:25:24.856579 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:25:24.856579 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 520/1031] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:25:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 17:25:24.861621 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67c685-d15a-49f9-a1f1-ab3966423443 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:24.863397 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56beee4e-f142-4dd2-89c8-fbe5586934f5 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:24.899092 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a536ea8-bf47-4e9d-a576-e48d1f457f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:24.899899 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a536ea8-bf47-4e9d-a576-e48d1f457f4b None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:24.900182 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a536ea8-bf47-4e9d-a576-e48d1f457f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:24.900455 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a536ea8-bf47-4e9d-a576-e48d1f457f4b None admin] PATH_INFO: `/v3/services/image` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:24.901112 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a536ea8-bf47-4e9d-a576-e48d1f457f4b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:24.902605 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a536ea8-bf47-4e9d-a576-e48d1f457f4b None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:24.914884 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-0a536ea8-bf47-4e9d-a576-e48d1f457f4b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 17:25:24.914884 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:24.914884 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 17:25:24.914884 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 17:25:24.914884 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 17:25:24.914884 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 17:25:24.914884 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 17:25:24.914884 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:25:24.914884 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 17:25:24.914884 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:24.914884 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 17:25:24.914884 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:24.914884 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:24.914884 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:24.914884 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:24.914884 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:24.914884 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:24.915870 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:24.915870 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:24.915870 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:24.915870 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:24.915870 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:24.915870 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:24.915870 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 17:25:24.915870 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 17:25:24.915870 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 17:25:24.915870 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 17:25:24.915870 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:24.915870 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:24.915870 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:24.915870 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:24.915870 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:24.915870 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:24.916727 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:24.916727 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:24.916727 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:24.916727 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:24.916727 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:24.916727 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:24.916727 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:24.916727 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:24.916727 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:24.916727 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:24.916727 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 17:25:24.916727 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:25:24.916727 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 17:25:24.916727 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:24.921289 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 512/1032] 10.222.0.27 () {56 vars in 1105 bytes} [Fri Jul 15 17:25:24 2022] GET /identity/v3/services/image => generated 86 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:25:24.922144 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a536ea8-bf47-4e9d-a576-e48d1f457f4b None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:24.968836 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67c685-d15a-49f9-a1f1-ab3966423443 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:24.976385 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:24.984804 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:25.005118 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7598b-2b01-48d3-8c1d-71d5bd53eadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:25.005934 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7598b-2b01-48d3-8c1d-71d5bd53eadd None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:25.006220 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7598b-2b01-48d3-8c1d-71d5bd53eadd None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:25.006495 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7598b-2b01-48d3-8c1d-71d5bd53eadd None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:25.007214 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7598b-2b01-48d3-8c1d-71d5bd53eadd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:25.007517 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7598b-2b01-48d3-8c1d-71d5bd53eadd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:25.008894 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7598b-2b01-48d3-8c1d-71d5bd53eadd None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:25.020873 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 521/1033] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:25:25.026436 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7598b-2b01-48d3-8c1d-71d5bd53eadd None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:25.031763 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a536ea8-bf47-4e9d-a576-e48d1f457f4b None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:25.072170 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab69c6-2f9c-437e-8994-de804dba9409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:25.072839 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab69c6-2f9c-437e-8994-de804dba9409 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:25.073125 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab69c6-2f9c-437e-8994-de804dba9409 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:25.073404 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab69c6-2f9c-437e-8994-de804dba9409 None admin] PATH_INFO: `/v3/services` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:25.074167 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eab69c6-2f9c-437e-8994-de804dba9409 None admin] RBAC: Adding query filter params (name=image) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:25.074592 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eab69c6-2f9c-437e-8994-de804dba9409 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:25.076388 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eab69c6-2f9c-437e-8994-de804dba9409 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:25.082998 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 513/1034] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:25:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:25:25.088853 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab69c6-2f9c-437e-8994-de804dba9409 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:25.158762 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7598b-2b01-48d3-8c1d-71d5bd53eadd None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:25.196419 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da393fa-af1c-4401-9816-edad7d590d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:25.197215 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da393fa-af1c-4401-9816-edad7d590d21 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:25.197495 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da393fa-af1c-4401-9816-edad7d590d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:25.197768 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da393fa-af1c-4401-9816-edad7d590d21 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:25.206064 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da393fa-af1c-4401-9816-edad7d590d21 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:25.207498 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da393fa-af1c-4401-9816-edad7d590d21 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:25.207687 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab69c6-2f9c-437e-8994-de804dba9409 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:25.222369 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-2da393fa-af1c-4401-9816-edad7d590d21 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 17:25:25.222369 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:25.222369 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:25.222369 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:25.222369 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:25.222369 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:25.222369 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:25.222369 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:25.222369 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:25.222369 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:25.222369 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:25.222369 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:25.222369 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 17:25:25.222369 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 17:25:25.222369 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 17:25:25.222369 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 17:25:25.223339 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:25.223339 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:25.223339 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 17:25:25.223339 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:25:25.223339 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 17:25:25.223339 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:25:25.223339 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:25.223339 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:25.223339 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:25.223339 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:25.223339 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:25.223339 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:25.223339 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:25.223339 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:25.223339 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:25.223339 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:25.223339 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:25.223339 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:25.224288 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:25.224288 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:25.224288 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 17:25:25.224288 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 17:25:25.224288 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 17:25:25.224288 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 17:25:25.224288 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 17:25:25.224288 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 17:25:25.224288 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 17:25:25.224288 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:25:25.228444 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 522/1035] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Jul 15 17:25:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:25:25.229131 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da393fa-af1c-4401-9816-edad7d590d21 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:25.234443 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:25.246654 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22e4f6-13c7-40a3-b708-7382a73e0509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:25.247405 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22e4f6-13c7-40a3-b708-7382a73e0509 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:25.247683 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22e4f6-13c7-40a3-b708-7382a73e0509 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:25.247955 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22e4f6-13c7-40a3-b708-7382a73e0509 None admin] PATH_INFO: `/v3/services` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:25.248655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22e4f6-13c7-40a3-b708-7382a73e0509 None admin] RBAC: Adding query filter params (type=image) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:25.248954 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22e4f6-13c7-40a3-b708-7382a73e0509 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:25.250344 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22e4f6-13c7-40a3-b708-7382a73e0509 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:25.260787 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 514/1036] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:25:25 2022] GET /identity/v3/services?type=image => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:25.260939 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:25.262819 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22e4f6-13c7-40a3-b708-7382a73e0509 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:25.339967 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da393fa-af1c-4401-9816-edad7d590d21 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:25.373799 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22e4f6-13c7-40a3-b708-7382a73e0509 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:25.374259 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1191a8e7-56cb-4d82-8cad-918d00c01cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:25.374936 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191a8e7-56cb-4d82-8cad-918d00c01cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:25.375193 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191a8e7-56cb-4d82-8cad-918d00c01cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:25.375471 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191a8e7-56cb-4d82-8cad-918d00c01cf6 None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:25.376308 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1191a8e7-56cb-4d82-8cad-918d00c01cf6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:25.376620 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1191a8e7-56cb-4d82-8cad-918d00c01cf6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:25.378073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1191a8e7-56cb-4d82-8cad-918d00c01cf6 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:25.400648 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 523/1037] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Jul 15 17:25:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:25:25.402043 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1191a8e7-56cb-4d82-8cad-918d00c01cf6 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:25.413908 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d92ad1-e00e-4572-9478-a7a9199dd501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:25.414940 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d92ad1-e00e-4572-9478-a7a9199dd501 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:25.415217 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d92ad1-e00e-4572-9478-a7a9199dd501 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:25.415787 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d92ad1-e00e-4572-9478-a7a9199dd501 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:25.416579 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d92ad1-e00e-4572-9478-a7a9199dd501 None admin] RBAC: Adding query filter params (interface=public, service_id=76484a6c86ef45ba9828cd080c418d02, region_id=RegionOne) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:25.416880 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d92ad1-e00e-4572-9478-a7a9199dd501 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:25.418284 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d92ad1-e00e-4572-9478-a7a9199dd501 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:25.427967 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 515/1038] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Jul 15 17:25:25 2022] GET /identity/v3/endpoints?service_id=76484a6c86ef45ba9828cd080c418d02&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:25.429720 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d92ad1-e00e-4572-9478-a7a9199dd501 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:25.489984 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:25.495467 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:25.512514 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1191a8e7-56cb-4d82-8cad-918d00c01cf6 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:25.538801 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d92ad1-e00e-4572-9478-a7a9199dd501 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:25.549461 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43394d6d-cb6a-4277-b3e6-48ec6b49dde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:25.549960 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43394d6d-cb6a-4277-b3e6-48ec6b49dde9 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:25.550443 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43394d6d-cb6a-4277-b3e6-48ec6b49dde9 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:25.550717 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43394d6d-cb6a-4277-b3e6-48ec6b49dde9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:25.577129 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9939ecd-57b2-444e-84bd-69b43d1873fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:25.578059 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9939ecd-57b2-444e-84bd-69b43d1873fc None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:25.578341 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9939ecd-57b2-444e-84bd-69b43d1873fc None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:25.578614 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9939ecd-57b2-444e-84bd-69b43d1873fc None admin] PATH_INFO: `/v3/services` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:25.579303 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9939ecd-57b2-444e-84bd-69b43d1873fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:25.580986 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9939ecd-57b2-444e-84bd-69b43d1873fc None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:25.587925 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 516/1039] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Jul 15 17:25:25 2022] GET /identity/v3/services => generated 1957 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 17:25:25.627239 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43394d6d-cb6a-4277-b3e6-48ec6b49dde9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:25.628845 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43394d6d-cb6a-4277-b3e6-48ec6b49dde9 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:25.723656 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:25.745532 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 524/1040] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:25:25 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 17:25:25.751452 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9939ecd-57b2-444e-84bd-69b43d1873fc None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:25.856839 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9939ecd-57b2-444e-84bd-69b43d1873fc None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:25.873293 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:25.893529 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c82be4-9344-47fc-b087-9eb5f83a113b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:25.894630 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c82be4-9344-47fc-b087-9eb5f83a113b None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:25.894906 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c82be4-9344-47fc-b087-9eb5f83a113b None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:25.895179 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c82be4-9344-47fc-b087-9eb5f83a113b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:25.907238 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c82be4-9344-47fc-b087-9eb5f83a113b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:25.908724 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c82be4-9344-47fc-b087-9eb5f83a113b None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:25.925956 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-e4c82be4-9344-47fc-b087-9eb5f83a113b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:25:25.925956 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:25.925956 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:25.925956 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:25.925956 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:25.925956 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:25.925956 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:25.925956 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:25.925956 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:25.925956 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:25.925956 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:25.925956 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:25.925956 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:25:25.925956 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:25:25.925956 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:25:25.926863 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:25:25.926863 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:25.926863 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:25.926863 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:25.926863 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:25.926863 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:25.926863 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:25.926863 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:25.926863 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:25.926863 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:25.926863 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:25.926863 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:25.926863 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:25.926863 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:25.926863 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:25.926863 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:25.926863 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:25.927758 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:25:25.927758 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:25:25.927758 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:25:25.927758 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:25.928514 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 517/1041] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:25:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:25:25.933395 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43394d6d-cb6a-4277-b3e6-48ec6b49dde9 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:26.035973 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43394d6d-cb6a-4277-b3e6-48ec6b49dde9 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:26.070372 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57198f91-d720-481e-adeb-df72baa1ec19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:26.071038 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57198f91-d720-481e-adeb-df72baa1ec19 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:26.071320 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57198f91-d720-481e-adeb-df72baa1ec19 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:26.071593 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57198f91-d720-481e-adeb-df72baa1ec19 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:26.072315 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57198f91-d720-481e-adeb-df72baa1ec19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:26.072615 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57198f91-d720-481e-adeb-df72baa1ec19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:26.073999 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57198f91-d720-481e-adeb-df72baa1ec19 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:26.086342 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 525/1042] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:26.092034 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c82be4-9344-47fc-b087-9eb5f83a113b None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:26.191808 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c82be4-9344-47fc-b087-9eb5f83a113b None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:26.233943 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f67bae-b0d0-4630-b57e-7e0735aa9891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:26.234737 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f67bae-b0d0-4630-b57e-7e0735aa9891 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:26.235027 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f67bae-b0d0-4630-b57e-7e0735aa9891 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:26.235294 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f67bae-b0d0-4630-b57e-7e0735aa9891 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:26.242290 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f67bae-b0d0-4630-b57e-7e0735aa9891 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:26.243737 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f67bae-b0d0-4630-b57e-7e0735aa9891 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:26.258356 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-a7f67bae-b0d0-4630-b57e-7e0735aa9891 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:25:26.258356 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:26.258356 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:26.258356 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:26.258356 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:26.258356 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:26.258356 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:26.258356 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:26.258356 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:26.258356 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:26.258356 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:26.258356 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:26.258356 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 17:25:26.258356 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 17:25:26.258356 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 17:25:26.259278 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 17:25:26.259278 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:26.259278 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:26.259278 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:26.259278 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:26.259278 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:26.259278 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:26.259278 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:26.259278 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:26.259278 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:26.259278 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:26.259278 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:26.259278 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:26.259278 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:26.259278 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:26.259278 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:26.259278 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:26.260172 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 17:25:26.260172 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 17:25:26.260172 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 17:25:26.260172 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 17:25:26.260172 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 17:25:26.260172 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 17:25:26.260172 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:25:26.260172 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:26.263150 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 518/1043] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:25:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:25:26.265722 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57198f91-d720-481e-adeb-df72baa1ec19 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:26.331467 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:26.390024 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57198f91-d720-481e-adeb-df72baa1ec19 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:26.426501 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0629280-afc5-44ba-9496-82b58365ef84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:26.427466 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0629280-afc5-44ba-9496-82b58365ef84 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:26.427924 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0629280-afc5-44ba-9496-82b58365ef84 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:26.428340 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0629280-afc5-44ba-9496-82b58365ef84 None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:26.429336 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0629280-afc5-44ba-9496-82b58365ef84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:26.429804 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0629280-afc5-44ba-9496-82b58365ef84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:26.431494 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0629280-afc5-44ba-9496-82b58365ef84 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:26.444790 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 526/1044] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jul 15 17:25:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:26.451304 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f67bae-b0d0-4630-b57e-7e0735aa9891 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:26.481844 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:26.557629 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f67bae-b0d0-4630-b57e-7e0735aa9891 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:26.593707 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec81d41-e8bf-4e04-8f02-3eae7dde6240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:26.594775 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec81d41-e8bf-4e04-8f02-3eae7dde6240 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:26.595271 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec81d41-e8bf-4e04-8f02-3eae7dde6240 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:26.595748 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec81d41-e8bf-4e04-8f02-3eae7dde6240 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:26.596781 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec81d41-e8bf-4e04-8f02-3eae7dde6240 None admin] RBAC: Adding query filter params (role.id=d0e262213cce48f4950efc71e4e127f8, scope.project.id=19cc5221b8074f48b5f73dc9c4289b03, user.id=f9d548c8199e4fdbbce7597bebd63421) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:26.597305 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec81d41-e8bf-4e04-8f02-3eae7dde6240 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:26.599008 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec81d41-e8bf-4e04-8f02-3eae7dde6240 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:26.605567 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 519/1045] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jul 15 17:25:26 2022] GET /identity/v3/role_assignments?user.id=f9d548c8199e4fdbbce7597bebd63421&scope.project.id=19cc5221b8074f48b5f73dc9c4289b03&role.id=d0e262213cce48f4950efc71e4e127f8 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:26.663531 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fb4c2-7283-4018-8348-3b29e5a56a55 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:26.663829 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fb4c2-7283-4018-8348-3b29e5a56a55 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:26.664288 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fb4c2-7283-4018-8348-3b29e5a56a55 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:26.668972 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 527/1046] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:25:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:25:26.671924 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e8df7-657c-4e9b-9dbd-74ca7a1d0a75 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:26.672220 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e8df7-657c-4e9b-9dbd-74ca7a1d0a75 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:26.672524 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e8df7-657c-4e9b-9dbd-74ca7a1d0a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:26.691368 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-e69e8df7-657c-4e9b-9dbd-74ca7a1d0a75 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:25:26.692746 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-e69e8df7-657c-4e9b-9dbd-74ca7a1d0a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:25:26.769531 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 520/1047] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:25:26 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:25:26.791177 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056fb4c2-7283-4018-8348-3b29e5a56a55 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:26.895917 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056fb4c2-7283-4018-8348-3b29e5a56a55 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:26.898216 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:26.931661 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec95ba-5974-43b4-abdb-22c3a941a7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:26.932468 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec95ba-5974-43b4-abdb-22c3a941a7ac None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:26.932742 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec95ba-5974-43b4-abdb-22c3a941a7ac None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:26.932991 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec95ba-5974-43b4-abdb-22c3a941a7ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:26.943604 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec95ba-5974-43b4-abdb-22c3a941a7ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:25:26.951526 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-b1ec95ba-5974-43b4-abdb-22c3a941a7ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:25:26.951526 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:26.951526 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:26.951526 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:26.951526 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:26.951526 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:26.951526 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:26.951526 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:26.951526 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:26.951526 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:26.951526 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:26.951526 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:26.951526 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:25:26.951526 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:25:26.951526 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:25:26.951526 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:25:26.952472 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:25:26.952472 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:25:26.952472 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:25:26.952472 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:25:26.952472 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:26.952472 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:26.952472 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:26.952472 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:26.952472 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:26.952472 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:26.952472 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:26.952472 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:26.952472 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:26.952472 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:26.952472 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:26.952472 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:26.953335 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:26.953335 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:26.953335 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:26.953335 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:26.953335 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:25:26.953335 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:25:26.953335 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:25:26.953335 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:25:26.953335 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:25:26.953335 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:25:26.953335 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:25:26.953335 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:25:26.961182 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 528/1048] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jul 15 17:25:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:25:26.961315 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e8df7-657c-4e9b-9dbd-74ca7a1d0a75 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:26.983844 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:27.064373 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e8df7-657c-4e9b-9dbd-74ca7a1d0a75 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:27.099372 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90bba9d-e2b1-4d04-aed0-f2bf4578c7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:27.100058 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bba9d-e2b1-4d04-aed0-f2bf4578c7e5 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:27.100335 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bba9d-e2b1-4d04-aed0-f2bf4578c7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:27.100606 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bba9d-e2b1-4d04-aed0-f2bf4578c7e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:27.101360 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90bba9d-e2b1-4d04-aed0-f2bf4578c7e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:27.101663 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90bba9d-e2b1-4d04-aed0-f2bf4578c7e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:27.103067 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90bba9d-e2b1-4d04-aed0-f2bf4578c7e5 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:27.111887 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 521/1049] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:25:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:25:27.117729 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec95ba-5974-43b4-abdb-22c3a941a7ac None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:27.221207 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec95ba-5974-43b4-abdb-22c3a941a7ac None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:27.255249 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917a92d-0660-42b7-ac6e-d6034a0a9ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:27.256132 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917a92d-0660-42b7-ac6e-d6034a0a9ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:27.256415 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917a92d-0660-42b7-ac6e-d6034a0a9ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:27.256667 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917a92d-0660-42b7-ac6e-d6034a0a9ca2 None admin] PATH_INFO: `/v3/users/7b50bcfa4e5e40f0861899bb66ae8cc2` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:27.271527 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c917a92d-0660-42b7-ac6e-d6034a0a9ca2 None admin] RBAC: Authorizing `identity:get_user(user_id=7b50bcfa4e5e40f0861899bb66ae8cc2)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:27.272978 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c917a92d-0660-42b7-ac6e-d6034a0a9ca2 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:27.274936 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 529/1050] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:25:27 2022] GET /identity/v3/users/7b50bcfa4e5e40f0861899bb66ae8cc2 => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:27.280846 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90bba9d-e2b1-4d04-aed0-f2bf4578c7e5 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:27.380197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:27.398115 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90bba9d-e2b1-4d04-aed0-f2bf4578c7e5 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:27.432785 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a70034-de59-40cc-8b47-eb8535a76fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:27.433441 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a70034-de59-40cc-8b47-eb8535a76fb8 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:27.433733 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a70034-de59-40cc-8b47-eb8535a76fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:27.434107 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a70034-de59-40cc-8b47-eb8535a76fb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:27.501958 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a70034-de59-40cc-8b47-eb8535a76fb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:27.503331 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a70034-de59-40cc-8b47-eb8535a76fb8 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:27.584847 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2025c-8f88-445d-a290-0ca206833937 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:27.585264 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2025c-8f88-445d-a290-0ca206833937 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:27.585605 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2025c-8f88-445d-a290-0ca206833937 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:27.587110 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 530/1051] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:25:27.588679 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:27.593087 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bbfe5b-37ba-4224-ba20-d6c725e0b85f None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:27.593447 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bbfe5b-37ba-4224-ba20-d6c725e0b85f None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:27.593919 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bbfe5b-37ba-4224-ba20-d6c725e0b85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:27.606577 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 522/1052] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:25:27 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 17:25:27.610949 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-95bbfe5b-37ba-4224-ba20-d6c725e0b85f None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:25:27.612122 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-95bbfe5b-37ba-4224-ba20-d6c725e0b85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:25:27.612619 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a70034-de59-40cc-8b47-eb8535a76fb8 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:27.630250 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:27.684181 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 531/1053] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:25:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:25:27.706631 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bbfe5b-37ba-4224-ba20-d6c725e0b85f None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:27.716842 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a70034-de59-40cc-8b47-eb8535a76fb8 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:27.752777 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ce95b-9cbd-407e-9246-a0afcb4aceda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:27.753990 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ce95b-9cbd-407e-9246-a0afcb4aceda None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:27.754269 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ce95b-9cbd-407e-9246-a0afcb4aceda None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:27.754538 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ce95b-9cbd-407e-9246-a0afcb4aceda None admin] PATH_INFO: `/v3/projects/23f2030aec8d4468bdfb505b82c62091` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:27.755868 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0ce95b-9cbd-407e-9246-a0afcb4aceda None admin] RBAC: Authorizing `identity:get_project(project_id=23f2030aec8d4468bdfb505b82c62091)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:27.757284 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0ce95b-9cbd-407e-9246-a0afcb4aceda None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:27.763924 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 523/1054] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:25:27 2022] GET /identity/v3/projects/23f2030aec8d4468bdfb505b82c62091 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:25:27.764944 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ce95b-9cbd-407e-9246-a0afcb4aceda None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:27.819541 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:27.819920 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bbfe5b-37ba-4224-ba20-d6c725e0b85f None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:27.854091 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5e61c-765f-43fa-82aa-9b5f9c56ac47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:27.854891 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5e61c-765f-43fa-82aa-9b5f9c56ac47 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:27.855167 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5e61c-765f-43fa-82aa-9b5f9c56ac47 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:27.855475 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5e61c-765f-43fa-82aa-9b5f9c56ac47 None admin] PATH_INFO: `/v3/services/image` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:27.856274 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb5e61c-765f-43fa-82aa-9b5f9c56ac47 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:27.857596 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb5e61c-765f-43fa-82aa-9b5f9c56ac47 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:27.869651 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-fcb5e61c-765f-43fa-82aa-9b5f9c56ac47 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 17:25:27.869651 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:27.869651 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 17:25:27.869651 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 17:25:27.869651 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 17:25:27.869651 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 17:25:27.869651 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 17:25:27.869651 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:25:27.869651 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 17:25:27.869651 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:25:27.869651 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 17:25:27.869651 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:25:27.869651 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:27.869651 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:27.869651 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:27.869651 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:27.869651 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:27.870697 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:27.870697 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:27.870697 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:27.870697 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:27.870697 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:27.870697 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:27.870697 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 17:25:27.870697 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 17:25:27.870697 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 17:25:27.870697 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 17:25:27.870697 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:27.870697 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:27.870697 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:27.870697 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:27.870697 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:27.870697 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:27.871907 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:27.871907 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:27.871907 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:27.871907 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:27.871907 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:27.871907 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:27.871907 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:27.871907 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:27.871907 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:27.871907 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:27.871907 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 17:25:27.871907 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:25:27.871907 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 17:25:27.871907 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:25:27.871907 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 532/1055] 10.222.0.27 () {56 vars in 1105 bytes} [Fri Jul 15 17:25:27 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 17:25:27.872836 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ce95b-9cbd-407e-9246-a0afcb4aceda None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:27.876784 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5e61c-765f-43fa-82aa-9b5f9c56ac47 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:27.899984 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:27.910442 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09282943-e996-4172-9474-ebceb51addbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:27.911343 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09282943-e996-4172-9474-ebceb51addbb None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:27.911621 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09282943-e996-4172-9474-ebceb51addbb None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:27.911890 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09282943-e996-4172-9474-ebceb51addbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:27.912712 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09282943-e996-4172-9474-ebceb51addbb None admin] RBAC: Adding query filter params (role.id=70d242b29ede4648b639c7ddae5eaead, scope.project.id=23f2030aec8d4468bdfb505b82c62091, user.id=7b50bcfa4e5e40f0861899bb66ae8cc2) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:27.913015 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09282943-e996-4172-9474-ebceb51addbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:27.914475 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09282943-e996-4172-9474-ebceb51addbb None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:27.929814 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 524/1056] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jul 15 17:25:27 2022] GET /identity/v3/role_assignments?user.id=7b50bcfa4e5e40f0861899bb66ae8cc2&scope.project.id=23f2030aec8d4468bdfb505b82c62091&role.id=70d242b29ede4648b639c7ddae5eaead => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:25:27.999063 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5e61c-765f-43fa-82aa-9b5f9c56ac47 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:28.037160 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24683d1-8dc6-4484-803c-4ae19d6dcf62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:28.037881 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24683d1-8dc6-4484-803c-4ae19d6dcf62 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:28.038162 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24683d1-8dc6-4484-803c-4ae19d6dcf62 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:28.038431 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24683d1-8dc6-4484-803c-4ae19d6dcf62 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:28.039143 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24683d1-8dc6-4484-803c-4ae19d6dcf62 None admin] RBAC: Adding query filter params (name=image) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:28.039446 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24683d1-8dc6-4484-803c-4ae19d6dcf62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:28.040904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24683d1-8dc6-4484-803c-4ae19d6dcf62 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:28.047202 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 533/1057] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:25:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:25:28.052933 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09282943-e996-4172-9474-ebceb51addbb None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:28.155066 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09282943-e996-4172-9474-ebceb51addbb None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:28.171646 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:28.190583 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6723cb3-3605-4194-afa6-e1c6b2638fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:28.191254 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6723cb3-3605-4194-afa6-e1c6b2638fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:28.191538 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6723cb3-3605-4194-afa6-e1c6b2638fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:28.191808 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6723cb3-3605-4194-afa6-e1c6b2638fe3 None admin] PATH_INFO: `/v3/services` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:28.192516 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6723cb3-3605-4194-afa6-e1c6b2638fe3 None admin] RBAC: Adding query filter params (type=image) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:28.192818 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6723cb3-3605-4194-afa6-e1c6b2638fe3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:28.194254 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6723cb3-3605-4194-afa6-e1c6b2638fe3 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:28.199796 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 525/1058] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:25:28 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:28.205700 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24683d1-8dc6-4484-803c-4ae19d6dcf62 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:28.289553 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:28.319696 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24683d1-8dc6-4484-803c-4ae19d6dcf62 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:28.355284 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efad752-90a9-4d0b-a924-3fd908426725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:28.356103 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efad752-90a9-4d0b-a924-3fd908426725 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:28.356442 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efad752-90a9-4d0b-a924-3fd908426725 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:28.356712 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efad752-90a9-4d0b-a924-3fd908426725 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:28.357452 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efad752-90a9-4d0b-a924-3fd908426725 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:28.358874 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efad752-90a9-4d0b-a924-3fd908426725 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:28.380846 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 534/1059] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Jul 15 17:25:28 2022] POST /identity/v3/endpoints => generated 327 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:25:28.597601 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e17644-19fb-4009-8a9f-733d5debe21b None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:28.598179 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e17644-19fb-4009-8a9f-733d5debe21b None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:28.598179 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e17644-19fb-4009-8a9f-733d5debe21b None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:28.599618 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 526/1060] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:25:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:25:28.604909 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7014918-6562-4f1d-8f4a-0f517c7ca541 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:28.605206 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7014918-6562-4f1d-8f4a-0f517c7ca541 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:28.605523 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7014918-6562-4f1d-8f4a-0f517c7ca541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:28.622958 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-f7014918-6562-4f1d-8f4a-0f517c7ca541 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:25:28.624140 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f7014918-6562-4f1d-8f4a-0f517c7ca541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:25:28.698476 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 535/1061] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:25:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:25:28.720726 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e17644-19fb-4009-8a9f-733d5debe21b None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:28.822809 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e17644-19fb-4009-8a9f-733d5debe21b None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:28.860397 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55a6af-979e-4ff5-a032-15bfe0f47f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:28.861168 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55a6af-979e-4ff5-a032-15bfe0f47f0f None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:28.861444 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55a6af-979e-4ff5-a032-15bfe0f47f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:28.861718 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55a6af-979e-4ff5-a032-15bfe0f47f0f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:28.873180 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f55a6af-979e-4ff5-a032-15bfe0f47f0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:25:28.881584 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-7f55a6af-979e-4ff5-a032-15bfe0f47f0f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 17:25:28.881584 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:28.881584 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:28.881584 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:28.881584 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:28.881584 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:28.881584 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:28.881584 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:28.881584 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:28.881584 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:28.881584 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:28.881584 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:28.881584 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:25:28.881584 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:25:28.881584 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:25:28.881584 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:25:28.882726 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:25:28.882726 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:25:28.882726 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:25:28.882726 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:25:28.882726 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:28.882726 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:28.882726 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:28.882726 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:28.882726 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:28.882726 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:28.882726 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:28.882726 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:28.882726 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:28.882726 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:28.882726 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:28.882726 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:28.883579 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:28.883579 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:28.883579 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:28.883579 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:28.883579 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:25:28.883579 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:25:28.883579 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:25:28.883579 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:25:28.883579 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:25:28.883579 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:25:28.883579 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 17:25:28.883579 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:28.885881 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 527/1062] 10.222.0.27 () {56 vars in 1120 bytes} [Fri Jul 15 17:25:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:25:28.889366 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7014918-6562-4f1d-8f4a-0f517c7ca541 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:28.957644 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:28.999819 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7014918-6562-4f1d-8f4a-0f517c7ca541 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:29.041076 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af784040-69e2-4ec4-8d18-1273090f8ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:29.041749 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af784040-69e2-4ec4-8d18-1273090f8ead None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:29.042054 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af784040-69e2-4ec4-8d18-1273090f8ead None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:29.042325 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af784040-69e2-4ec4-8d18-1273090f8ead None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:29.043718 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af784040-69e2-4ec4-8d18-1273090f8ead None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:29.044028 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af784040-69e2-4ec4-8d18-1273090f8ead None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:29.045397 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af784040-69e2-4ec4-8d18-1273090f8ead None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:29.058579 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 536/1063] 10.222.0.27 () {56 vars in 1115 bytes} [Fri Jul 15 17:25:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:29.060434 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55a6af-979e-4ff5-a032-15bfe0f47f0f None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:29.105314 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:29.165912 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55a6af-979e-4ff5-a032-15bfe0f47f0f None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:29.199813 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed7bde-7548-4425-a46f-ae25ee4ffe01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:29.200561 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed7bde-7548-4425-a46f-ae25ee4ffe01 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:29.200836 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed7bde-7548-4425-a46f-ae25ee4ffe01 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:29.201107 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed7bde-7548-4425-a46f-ae25ee4ffe01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:29.212211 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ed7bde-7548-4425-a46f-ae25ee4ffe01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:29.213655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ed7bde-7548-4425-a46f-ae25ee4ffe01 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:29.235194 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-83ed7bde-7548-4425-a46f-ae25ee4ffe01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:25:29.235194 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:29.235194 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:29.235194 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:29.235194 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:29.235194 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:29.235194 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:29.235194 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:29.235194 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:29.235194 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:29.235194 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:29.235194 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:29.235194 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:25:29.235194 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:25:29.235194 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:25:29.236101 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:25:29.236101 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:29.236101 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:29.236101 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:29.236101 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:29.236101 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:29.236101 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:29.236101 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:29.236101 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:29.236101 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:29.236101 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:29.236101 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:29.236101 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:29.236101 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:29.236101 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:29.236101 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:29.236101 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:29.242021 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:25:29.242021 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:25:29.242021 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:25:29.242021 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:29.242021 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 528/1064] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:25:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:25:29.243780 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af784040-69e2-4ec4-8d18-1273090f8ead None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:29.357304 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af784040-69e2-4ec4-8d18-1273090f8ead None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:29.381508 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:29.394217 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d422186-baeb-429a-8733-f3583b586c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:29.394879 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d422186-baeb-429a-8733-f3583b586c2e None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:29.395159 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d422186-baeb-429a-8733-f3583b586c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:29.395433 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d422186-baeb-429a-8733-f3583b586c2e None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:29.396149 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d422186-baeb-429a-8733-f3583b586c2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:29.396451 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d422186-baeb-429a-8733-f3583b586c2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:29.397823 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d422186-baeb-429a-8733-f3583b586c2e None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:29.410266 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 537/1065] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:29.415896 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed7bde-7548-4425-a46f-ae25ee4ffe01 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:29.512417 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:29.523503 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed7bde-7548-4425-a46f-ae25ee4ffe01 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:29.559058 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a80791-21ef-4926-9fb8-2d709d8e6a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:29.559969 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a80791-21ef-4926-9fb8-2d709d8e6a11 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:29.560247 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a80791-21ef-4926-9fb8-2d709d8e6a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:29.560517 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a80791-21ef-4926-9fb8-2d709d8e6a11 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:29.568634 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a80791-21ef-4926-9fb8-2d709d8e6a11 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:29.570088 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a80791-21ef-4926-9fb8-2d709d8e6a11 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:29.584530 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-f6a80791-21ef-4926-9fb8-2d709d8e6a11 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 17:25:29.584530 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:29.584530 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:29.584530 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:29.584530 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:29.584530 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:29.584530 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:29.584530 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:29.584530 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:29.584530 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:29.584530 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:29.584530 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:29.584530 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 17:25:29.584530 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 17:25:29.584530 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 17:25:29.584530 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 17:25:29.585501 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:29.585501 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:29.585501 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 17:25:29.585501 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:25:29.585501 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 17:25:29.585501 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:25:29.585501 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:29.585501 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:29.585501 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:29.585501 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:29.585501 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:29.585501 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:29.585501 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:29.585501 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:29.585501 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:29.585501 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:29.585501 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:29.585501 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:29.591336 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:29.591336 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:29.591336 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 17:25:29.591336 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 17:25:29.591336 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 17:25:29.591336 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 17:25:29.591336 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 17:25:29.591336 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 17:25:29.591336 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 17:25:29.591336 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:29.591336 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 529/1066] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Jul 15 17:25:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:25:29.593393 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d422186-baeb-429a-8733-f3583b586c2e None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:29.696122 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d422186-baeb-429a-8733-f3583b586c2e None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:29.729821 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d122d-8773-4577-b387-fb03e026cb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:29.730656 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d122d-8773-4577-b387-fb03e026cb85 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:29.730935 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d122d-8773-4577-b387-fb03e026cb85 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:29.731202 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d122d-8773-4577-b387-fb03e026cb85 None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:29.732097 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d122d-8773-4577-b387-fb03e026cb85 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:29.732399 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d122d-8773-4577-b387-fb03e026cb85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:29.733819 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d122d-8773-4577-b387-fb03e026cb85 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:29.751400 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 538/1067] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Jul 15 17:25:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:25:29.756919 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a80791-21ef-4926-9fb8-2d709d8e6a11 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:29.857379 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a80791-21ef-4926-9fb8-2d709d8e6a11 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:29.890755 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c02f3-750c-4a65-9529-dccf83b07a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:29.891555 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c02f3-750c-4a65-9529-dccf83b07a14 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:29.891829 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c02f3-750c-4a65-9529-dccf83b07a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:29.892097 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c02f3-750c-4a65-9529-dccf83b07a14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:29.902975 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c02f3-750c-4a65-9529-dccf83b07a14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:29.904405 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c02f3-750c-4a65-9529-dccf83b07a14 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:29.913721 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e76a1-ade1-4bcd-876e-10801bb2b4c6 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:29.914052 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e76a1-ade1-4bcd-876e-10801bb2b4c6 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:29.914330 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e76a1-ade1-4bcd-876e-10801bb2b4c6 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:29.915871 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 539/1068] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:25:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:25:29.920752 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b048227-386c-4268-b603-a4831e180940 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:29.920956 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b048227-386c-4268-b603-a4831e180940 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:29.921240 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b048227-386c-4268-b603-a4831e180940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:29.921713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-061c02f3-750c-4a65-9529-dccf83b07a14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:25:29.921713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:29.921713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:29.921713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:29.921713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:29.921713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:29.921713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:29.921713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:29.921713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:29.921713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:29.921713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:29.921713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:29.921713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:25:29.921713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:25:29.921713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:25:29.922590 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:25:29.922590 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:29.922590 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:29.922590 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:29.922590 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:29.922590 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:29.922590 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:29.922590 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:29.922590 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:29.922590 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:29.922590 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:29.922590 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:29.922590 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:29.922590 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:29.922590 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:29.922590 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:29.922590 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:29.923474 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:25:29.923474 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:25:29.923474 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:25:29.923474 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:29.925997 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 530/1069] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:25:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:25:29.928277 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c02f3-750c-4a65-9529-dccf83b07a14 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:29.932057 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:29.940441 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-2b048227-386c-4268-b603-a4831e180940 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:25:29.941643 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-2b048227-386c-4268-b603-a4831e180940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:25:29.982449 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:30.015327 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 540/1070] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:25:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 17:25:30.037394 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b048227-386c-4268-b603-a4831e180940 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:30.038795 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c02f3-750c-4a65-9529-dccf83b07a14 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:30.079321 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd3b895-73b6-472b-9bae-972ef97def4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:30.080798 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3b895-73b6-472b-9bae-972ef97def4e None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:30.081080 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3b895-73b6-472b-9bae-972ef97def4e None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:30.081350 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3b895-73b6-472b-9bae-972ef97def4e None admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:30.082530 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd3b895-73b6-472b-9bae-972ef97def4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:30.082838 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd3b895-73b6-472b-9bae-972ef97def4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:30.085280 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd3b895-73b6-472b-9bae-972ef97def4e None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:30.098756 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 531/1071] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:25:30.104310 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd3b895-73b6-472b-9bae-972ef97def4e None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:30.146479 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b048227-386c-4268-b603-a4831e180940 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:30.169241 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:30.183227 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45d18a-4534-412f-9898-7696880a79b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:30.184203 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45d18a-4534-412f-9898-7696880a79b6 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:30.184485 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45d18a-4534-412f-9898-7696880a79b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:30.184758 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45d18a-4534-412f-9898-7696880a79b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:30.196681 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d45d18a-4534-412f-9898-7696880a79b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:25:30.204678 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-3d45d18a-4534-412f-9898-7696880a79b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:25:30.204678 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:30.204678 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:30.204678 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:30.204678 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:30.204678 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:30.204678 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:30.204678 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:30.204678 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:30.204678 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:30.204678 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:30.204678 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:30.204678 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:25:30.204678 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:25:30.204678 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:25:30.204678 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:25:30.206482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:25:30.206482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:25:30.206482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:25:30.206482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:25:30.206482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:30.206482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:30.206482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:30.206482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:30.206482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:30.206482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:30.206482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:30.206482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:30.206482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:30.206482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:30.206482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:30.206482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:30.207521 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:30.207521 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:30.207521 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:30.207521 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:30.207521 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:25:30.207521 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:25:30.207521 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:25:30.207521 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:25:30.207521 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:25:30.207521 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:25:30.207521 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:25:30.207521 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:25:30.207521 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 541/1072] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jul 15 17:25:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 17:25:30.212108 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45d18a-4534-412f-9898-7696880a79b6 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:30.213876 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd3b895-73b6-472b-9bae-972ef97def4e None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:30.251351 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0bbdd2-bbdd-4aa3-82b2-e7262d325a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:30.252414 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bbdd2-bbdd-4aa3-82b2-e7262d325a4c None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:30.253016 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:30.253551 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bbdd2-bbdd-4aa3-82b2-e7262d325a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:30.254172 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bbdd2-bbdd-4aa3-82b2-e7262d325a4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:30.261635 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0bbdd2-bbdd-4aa3-82b2-e7262d325a4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:30.263113 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0bbdd2-bbdd-4aa3-82b2-e7262d325a4c None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:30.277172 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-0f0bbdd2-bbdd-4aa3-82b2-e7262d325a4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:25:30.277172 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:30.277172 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:30.277172 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:30.277172 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:30.277172 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:30.277172 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:30.277172 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:30.277172 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:30.277172 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:30.277172 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:30.277172 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:30.277172 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 17:25:30.277172 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 17:25:30.277172 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 17:25:30.278458 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 17:25:30.278458 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:30.278458 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:30.278458 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:30.278458 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:30.278458 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:30.278458 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:30.278458 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:30.278458 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:30.278458 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:30.278458 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:30.278458 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:30.278458 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:30.278458 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:30.278458 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:30.278458 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:30.278458 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:30.284845 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 17:25:30.284845 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 17:25:30.284845 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 17:25:30.284845 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 17:25:30.284845 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 17:25:30.284845 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 17:25:30.284845 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:25:30.284845 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:30.284845 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 532/1073] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:25:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 17:25:30.286823 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0bbdd2-bbdd-4aa3-82b2-e7262d325a4c None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:30.336529 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45d18a-4534-412f-9898-7696880a79b6 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:30.372616 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b0da2-4373-4d53-a0f3-ef0612640a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:30.373292 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b0da2-4373-4d53-a0f3-ef0612640a9d None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:30.373546 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b0da2-4373-4d53-a0f3-ef0612640a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:30.373834 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b0da2-4373-4d53-a0f3-ef0612640a9d None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:30.374579 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b0da2-4373-4d53-a0f3-ef0612640a9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:30.374877 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b0da2-4373-4d53-a0f3-ef0612640a9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:30.376231 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b0da2-4373-4d53-a0f3-ef0612640a9d None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:30.384478 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 542/1074] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:25:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:25:30.385738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e8b73-8416-47e0-883a-212721057d1a None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:30.386055 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e8b73-8416-47e0-883a-212721057d1a None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:30.386328 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e8b73-8416-47e0-883a-212721057d1a None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:30.387586 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 543/1075] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:25:30.390242 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e8b73-8416-47e0-883a-212721057d1a None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:30.405841 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0bbdd2-bbdd-4aa3-82b2-e7262d325a4c None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:30.428100 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:30.439757 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e008b43-23ac-4043-97c2-11aeae2c85e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:30.440416 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e008b43-23ac-4043-97c2-11aeae2c85e3 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:30.440691 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e008b43-23ac-4043-97c2-11aeae2c85e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:30.440961 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e008b43-23ac-4043-97c2-11aeae2c85e3 None admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:30.441747 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e008b43-23ac-4043-97c2-11aeae2c85e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:30.442353 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e008b43-23ac-4043-97c2-11aeae2c85e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:30.443775 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e008b43-23ac-4043-97c2-11aeae2c85e3 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:30.460668 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 533/1076] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jul 15 17:25:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:30.462070 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d80cc-efef-416a-ac39-72c89be5e3b2 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:30.462532 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d80cc-efef-416a-ac39-72c89be5e3b2 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:30.462983 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d80cc-efef-416a-ac39-72c89be5e3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:30.479603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-5f1d80cc-efef-416a-ac39-72c89be5e3b2 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:25:30.481090 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-5f1d80cc-efef-416a-ac39-72c89be5e3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:25:30.484207 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:30.493104 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e8b73-8416-47e0-883a-212721057d1a None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:30.527036 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab2e8d-197e-458d-9720-81a9f8a76d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:30.527992 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab2e8d-197e-458d-9720-81a9f8a76d40 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:30.528300 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab2e8d-197e-458d-9720-81a9f8a76d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:30.528568 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab2e8d-197e-458d-9720-81a9f8a76d40 None admin] PATH_INFO: `/v3/users/7b50bcfa4e5e40f0861899bb66ae8cc2` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:30.529822 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab2e8d-197e-458d-9720-81a9f8a76d40 None admin] RBAC: Authorizing `identity:get_user(user_id=7b50bcfa4e5e40f0861899bb66ae8cc2)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:30.531264 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab2e8d-197e-458d-9720-81a9f8a76d40 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:30.532885 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 544/1077] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:25:30 2022] GET /identity/v3/users/7b50bcfa4e5e40f0861899bb66ae8cc2 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:30.533615 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab2e8d-197e-458d-9720-81a9f8a76d40 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:30.544492 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 534/1078] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:25:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:25:30.545319 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d80cc-efef-416a-ac39-72c89be5e3b2 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:30.638360 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab2e8d-197e-458d-9720-81a9f8a76d40 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:30.651613 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d80cc-efef-416a-ac39-72c89be5e3b2 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:30.665921 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:30.671531 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e0c92-c430-4972-8295-b6ebaa52ffba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:30.672423 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e0c92-c430-4972-8295-b6ebaa52ffba None admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:30.672696 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e0c92-c430-4972-8295-b6ebaa52ffba None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:30.672962 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e0c92-c430-4972-8295-b6ebaa52ffba None admin] PATH_INFO: `/v3/projects/19cc5221b8074f48b5f73dc9c4289b03/users/f9d548c8199e4fdbbce7597bebd63421/roles/d0e262213cce48f4950efc71e4e127f8` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:30.675167 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4e0c92-c430-4972-8295-b6ebaa52ffba None admin] RBAC: Authorizing `identity:create_grant(project_id=19cc5221b8074f48b5f73dc9c4289b03, user_id=f9d548c8199e4fdbbce7597bebd63421, role_id=d0e262213cce48f4950efc71e4e127f8)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:30.676610 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4e0c92-c430-4972-8295-b6ebaa52ffba None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:30.685480 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ea141-5c11-46b9-9d3b-cc534a28d797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:30.686401 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ea141-5c11-46b9-9d3b-cc534a28d797 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:30.686674 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ea141-5c11-46b9-9d3b-cc534a28d797 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:30.686940 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ea141-5c11-46b9-9d3b-cc534a28d797 None admin] PATH_INFO: `/v3/projects/23f2030aec8d4468bdfb505b82c62091` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:30.688089 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ea141-5c11-46b9-9d3b-cc534a28d797 None admin] RBAC: Authorizing `identity:get_project(project_id=23f2030aec8d4468bdfb505b82c62091)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:30.689484 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ea141-5c11-46b9-9d3b-cc534a28d797 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:30.690362 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 545/1079] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Jul 15 17:25:30 2022] PUT /identity/v3/projects/19cc5221b8074f48b5f73dc9c4289b03/users/f9d548c8199e4fdbbce7597bebd63421/roles/d0e262213cce48f4950efc71e4e127f8 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:25:30.691329 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e0c92-c430-4972-8295-b6ebaa52ffba None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:30.691437 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 535/1080] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:25:30 2022] GET /identity/v3/projects/23f2030aec8d4468bdfb505b82c62091 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:30.727651 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ea141-5c11-46b9-9d3b-cc534a28d797 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:30.728309 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:30.830764 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e0c92-c430-4972-8295-b6ebaa52ffba None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:30.854922 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ea141-5c11-46b9-9d3b-cc534a28d797 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:30.884893 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db4d997-f65a-4cfb-8f8d-d5581033e8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:30.885602 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4d997-f65a-4cfb-8f8d-d5581033e8ce None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:30.885913 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4d997-f65a-4cfb-8f8d-d5581033e8ce None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:30.886326 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4d997-f65a-4cfb-8f8d-d5581033e8ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:30.904512 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af8e4b-4926-4db6-916f-f703bf308c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:30.905398 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af8e4b-4926-4db6-916f-f703bf308c03 None admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:30.905673 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af8e4b-4926-4db6-916f-f703bf308c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:30.905971 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af8e4b-4926-4db6-916f-f703bf308c03 None admin] PATH_INFO: `/v3/projects/23f2030aec8d4468bdfb505b82c62091/users/7b50bcfa4e5e40f0861899bb66ae8cc2/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:30.908105 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af8e4b-4926-4db6-916f-f703bf308c03 None admin] RBAC: Authorizing `identity:create_grant(project_id=23f2030aec8d4468bdfb505b82c62091, user_id=7b50bcfa4e5e40f0861899bb66ae8cc2, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:30.909538 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af8e4b-4926-4db6-916f-f703bf308c03 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:30.939158 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 536/1081] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Jul 15 17:25:30 2022] PUT /identity/v3/projects/23f2030aec8d4468bdfb505b82c62091/users/7b50bcfa4e5e40f0861899bb66ae8cc2/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:25:30.987293 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db4d997-f65a-4cfb-8f8d-d5581033e8ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:30.989383 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db4d997-f65a-4cfb-8f8d-d5581033e8ce None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:31.021685 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:31.140318 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 546/1082] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:25:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 17:25:31.147664 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af8e4b-4926-4db6-916f-f703bf308c03 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:31.209404 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:31.274258 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af8e4b-4926-4db6-916f-f703bf308c03 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:31.324649 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32545cdd-4584-41d4-b1dc-bbb3cacad8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:31.325755 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32545cdd-4584-41d4-b1dc-bbb3cacad8cb None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:31.326202 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32545cdd-4584-41d4-b1dc-bbb3cacad8cb None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:31.326611 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32545cdd-4584-41d4-b1dc-bbb3cacad8cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:31.346066 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32545cdd-4584-41d4-b1dc-bbb3cacad8cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:31.347798 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32545cdd-4584-41d4-b1dc-bbb3cacad8cb None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:31.369512 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-32545cdd-4584-41d4-b1dc-bbb3cacad8cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:25:31.369512 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:31.369512 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:31.369512 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:31.369512 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:31.369512 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:31.369512 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:31.369512 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:31.369512 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:31.369512 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:31.369512 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:31.369512 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:31.369512 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:25:31.369512 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:25:31.369512 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:25:31.370767 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:25:31.370767 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:31.370767 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:31.370767 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:31.370767 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:31.370767 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:31.370767 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:31.370767 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:31.370767 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:31.370767 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:31.370767 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:31.370767 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:31.370767 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:31.370767 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:31.370767 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:31.370767 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:31.370767 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:31.373029 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:25:31.373029 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:25:31.373029 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:25:31.373029 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:31.373029 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 537/1083] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:25:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:25:31.379748 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db4d997-f65a-4cfb-8f8d-d5581033e8ce None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:31.510129 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db4d997-f65a-4cfb-8f8d-d5581033e8ce None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:31.539317 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:31.557863 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ceffa7-a9bd-4867-91d6-61bb424e8293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:31.558606 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ceffa7-a9bd-4867-91d6-61bb424e8293 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:31.558870 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ceffa7-a9bd-4867-91d6-61bb424e8293 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:31.559144 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ceffa7-a9bd-4867-91d6-61bb424e8293 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:31.559863 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ceffa7-a9bd-4867-91d6-61bb424e8293 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:31.560164 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ceffa7-a9bd-4867-91d6-61bb424e8293 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:31.561882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ceffa7-a9bd-4867-91d6-61bb424e8293 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:31.574161 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 547/1084] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:32.761433 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c23993-a348-4754-9d50-10d101512caf None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:32.762010 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c23993-a348-4754-9d50-10d101512caf None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:32.762088 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c23993-a348-4754-9d50-10d101512caf None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:32.763441 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 538/1085] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:25:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:25:32.768706 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9abae-07b2-40ca-af3e-912b3458788c None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:32.769176 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9abae-07b2-40ca-af3e-912b3458788c None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:32.769268 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9abae-07b2-40ca-af3e-912b3458788c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:32.787158 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-02a9abae-07b2-40ca-af3e-912b3458788c None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:25:32.788354 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-02a9abae-07b2-40ca-af3e-912b3458788c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:25:32.858474 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 548/1086] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:25:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:25:32.881984 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c23993-a348-4754-9d50-10d101512caf None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:32.980692 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:32.989323 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c23993-a348-4754-9d50-10d101512caf None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:33.023809 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f0200-91d0-4846-9b7b-b61c3dc13cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:33.024657 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f0200-91d0-4846-9b7b-b61c3dc13cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:33.024940 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f0200-91d0-4846-9b7b-b61c3dc13cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:33.025200 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f0200-91d0-4846-9b7b-b61c3dc13cf6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:33.035815 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5f0200-91d0-4846-9b7b-b61c3dc13cf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:25:33.044361 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-df5f0200-91d0-4846-9b7b-b61c3dc13cf6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 17:25:33.044361 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:33.044361 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:33.044361 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:33.044361 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:33.044361 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:33.044361 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:33.044361 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:33.044361 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:33.044361 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:33.044361 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:33.044361 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:33.044361 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:25:33.044361 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:25:33.044361 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:25:33.044361 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:25:33.045335 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:25:33.045335 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:25:33.045335 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:25:33.045335 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:25:33.045335 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:33.045335 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:33.045335 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:33.045335 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:33.045335 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:33.045335 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:33.045335 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:33.045335 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:33.045335 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:33.045335 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:33.045335 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:33.045335 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:33.051450 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:33.051450 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:33.051450 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:33.051450 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:33.051450 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:25:33.051450 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:25:33.051450 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:25:33.051450 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:25:33.051450 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:25:33.051450 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:25:33.051450 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 17:25:33.051450 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:33.052248 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e353e-59a5-4153-b922-e1417cedb46f None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:33.052248 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e353e-59a5-4153-b922-e1417cedb46f None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:33.052248 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e353e-59a5-4153-b922-e1417cedb46f None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:33.052476 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 539/1087] 10.222.0.27 () {56 vars in 1120 bytes} [Fri Jul 15 17:25:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:25:33.052556 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 549/1088] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:25:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:25:33.052646 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb34c1-3b23-4303-9ea1-c5b85d2377b8 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:33.052646 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb34c1-3b23-4303-9ea1-c5b85d2377b8 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:33.052646 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb34c1-3b23-4303-9ea1-c5b85d2377b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:33.053689 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e353e-59a5-4153-b922-e1417cedb46f None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:33.069138 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-53fb34c1-3b23-4303-9ea1-c5b85d2377b8 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:25:33.070375 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-53fb34c1-3b23-4303-9ea1-c5b85d2377b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:25:33.136372 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 540/1089] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:25:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:25:33.155337 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e353e-59a5-4153-b922-e1417cedb46f None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:33.159387 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb34c1-3b23-4303-9ea1-c5b85d2377b8 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:33.168442 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:33.189030 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13c7f5-378f-4bca-8300-4b5fe6e4921f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:33.189691 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13c7f5-378f-4bca-8300-4b5fe6e4921f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:33.189994 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13c7f5-378f-4bca-8300-4b5fe6e4921f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:33.190266 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13c7f5-378f-4bca-8300-4b5fe6e4921f None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:33.191035 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13c7f5-378f-4bca-8300-4b5fe6e4921f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:33.191338 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13c7f5-378f-4bca-8300-4b5fe6e4921f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:33.192695 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13c7f5-378f-4bca-8300-4b5fe6e4921f None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:33.200652 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 550/1090] 10.222.0.27 () {56 vars in 1115 bytes} [Fri Jul 15 17:25:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:33.206550 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13c7f5-378f-4bca-8300-4b5fe6e4921f None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:33.244735 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:33.261050 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb34c1-3b23-4303-9ea1-c5b85d2377b8 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:33.296705 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb490f-dcd1-42f7-b173-b953907ea72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:33.297432 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb490f-dcd1-42f7-b173-b953907ea72d None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:33.297714 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb490f-dcd1-42f7-b173-b953907ea72d None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:33.298019 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb490f-dcd1-42f7-b173-b953907ea72d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:33.303511 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13c7f5-378f-4bca-8300-4b5fe6e4921f None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:33.313293 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb490f-dcd1-42f7-b173-b953907ea72d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:25:33.320971 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-62bb490f-dcd1-42f7-b173-b953907ea72d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:25:33.320971 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:33.320971 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:33.320971 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:33.320971 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:33.320971 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:33.320971 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:33.320971 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:33.320971 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:33.320971 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:33.320971 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:33.320971 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:33.320971 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:25:33.320971 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:25:33.320971 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:25:33.320971 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:25:33.321962 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:25:33.321962 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:25:33.321962 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:25:33.321962 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:25:33.321962 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:33.321962 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:33.321962 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:33.321962 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:33.321962 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:33.321962 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:33.321962 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:33.321962 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:33.321962 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:33.321962 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:33.321962 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:33.321962 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:33.322838 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:33.322838 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:33.322838 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:33.322838 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:33.322838 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:25:33.322838 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:25:33.322838 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:25:33.322838 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:25:33.322838 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:25:33.322838 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:25:33.322838 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:25:33.322838 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:33.322838 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 541/1091] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jul 15 17:25:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 17:25:33.328327 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb490f-dcd1-42f7-b173-b953907ea72d None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:33.338743 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf37bc-52e3-4e35-98ea-428e3df11a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:33.339554 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf37bc-52e3-4e35-98ea-428e3df11a68 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:33.339933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf37bc-52e3-4e35-98ea-428e3df11a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:33.340245 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf37bc-52e3-4e35-98ea-428e3df11a68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:33.351089 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf37bc-52e3-4e35-98ea-428e3df11a68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:33.352543 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf37bc-52e3-4e35-98ea-428e3df11a68 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:33.369903 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-42cf37bc-52e3-4e35-98ea-428e3df11a68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:25:33.369903 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:33.369903 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:33.369903 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:33.369903 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:33.369903 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:33.369903 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:33.369903 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:33.369903 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:33.369903 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:33.369903 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:33.369903 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:33.369903 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:25:33.369903 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:25:33.369903 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:25:33.370997 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:25:33.370997 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:33.370997 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:33.370997 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:33.370997 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:33.370997 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:33.370997 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:33.370997 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:33.370997 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:33.370997 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:33.370997 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:33.370997 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:33.370997 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:33.370997 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:33.370997 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:33.370997 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:33.370997 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:33.372055 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:25:33.372055 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:25:33.372055 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:25:33.372055 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:25:33.372055 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 551/1092] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:25:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 17:25:33.376874 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf37bc-52e3-4e35-98ea-428e3df11a68 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:33.403402 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:33.425753 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb490f-dcd1-42f7-b173-b953907ea72d None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:33.458999 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786ad08-a0b1-44f9-82e3-d7e92d8ffc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:33.459669 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786ad08-a0b1-44f9-82e3-d7e92d8ffc19 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:33.459948 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786ad08-a0b1-44f9-82e3-d7e92d8ffc19 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:33.460221 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786ad08-a0b1-44f9-82e3-d7e92d8ffc19 None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:33.460996 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4786ad08-a0b1-44f9-82e3-d7e92d8ffc19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:33.461302 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4786ad08-a0b1-44f9-82e3-d7e92d8ffc19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:33.462713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4786ad08-a0b1-44f9-82e3-d7e92d8ffc19 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:33.472059 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 542/1093] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:25:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:33.473427 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf37bc-52e3-4e35-98ea-428e3df11a68 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:33.477917 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786ad08-a0b1-44f9-82e3-d7e92d8ffc19 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:33.486404 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:33.507003 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51618e97-456a-40c5-9f6b-f1ee69dc9a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:33.507669 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51618e97-456a-40c5-9f6b-f1ee69dc9a07 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:33.507967 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51618e97-456a-40c5-9f6b-f1ee69dc9a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:33.508237 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51618e97-456a-40c5-9f6b-f1ee69dc9a07 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:33.508994 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51618e97-456a-40c5-9f6b-f1ee69dc9a07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:33.509296 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51618e97-456a-40c5-9f6b-f1ee69dc9a07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:33.510692 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51618e97-456a-40c5-9f6b-f1ee69dc9a07 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:33.523074 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 552/1094] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:25:33.528630 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51618e97-456a-40c5-9f6b-f1ee69dc9a07 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:33.576272 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786ad08-a0b1-44f9-82e3-d7e92d8ffc19 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:33.610756 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50497ac-f42a-4639-92bc-3c7b961ec719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:33.611629 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:33.611759 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50497ac-f42a-4639-92bc-3c7b961ec719 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:33.611898 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50497ac-f42a-4639-92bc-3c7b961ec719 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:33.612161 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50497ac-f42a-4639-92bc-3c7b961ec719 None admin] PATH_INFO: `/v3/users/7b50bcfa4e5e40f0861899bb66ae8cc2` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:33.613326 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50497ac-f42a-4639-92bc-3c7b961ec719 None admin] RBAC: Authorizing `identity:get_user(user_id=7b50bcfa4e5e40f0861899bb66ae8cc2)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:33.614787 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50497ac-f42a-4639-92bc-3c7b961ec719 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:33.616579 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 543/1095] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:25:33 2022] GET /identity/v3/users/7b50bcfa4e5e40f0861899bb66ae8cc2 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:25:33.622479 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50497ac-f42a-4639-92bc-3c7b961ec719 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:33.628336 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51618e97-456a-40c5-9f6b-f1ee69dc9a07 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:33.661621 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff398a-7d4e-4ef0-90f3-3b53387c085f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:33.662447 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff398a-7d4e-4ef0-90f3-3b53387c085f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:33.662746 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff398a-7d4e-4ef0-90f3-3b53387c085f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:33.663015 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff398a-7d4e-4ef0-90f3-3b53387c085f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:33.669903 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff398a-7d4e-4ef0-90f3-3b53387c085f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:33.671341 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff398a-7d4e-4ef0-90f3-3b53387c085f None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:33.685957 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-6cff398a-7d4e-4ef0-90f3-3b53387c085f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 17:25:33.685957 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:33.685957 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:33.685957 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:33.685957 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:33.685957 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:33.685957 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:33.685957 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:33.685957 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:33.685957 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:33.685957 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:33.685957 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:33.685957 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 17:25:33.685957 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 17:25:33.685957 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 17:25:33.685957 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 17:25:33.687082 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:33.687082 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:33.687082 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 17:25:33.687082 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:25:33.687082 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 17:25:33.687082 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:25:33.687082 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:33.687082 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:33.687082 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:33.687082 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:33.687082 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:33.687082 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:33.687082 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:33.687082 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:33.687082 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:33.687082 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:33.687082 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:33.687082 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:33.688961 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:33.688961 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:33.688961 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 17:25:33.688961 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 17:25:33.688961 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 17:25:33.688961 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 17:25:33.688961 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 17:25:33.688961 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 17:25:33.688961 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 17:25:33.688961 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:25:33.688961 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 553/1096] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Jul 15 17:25:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:25:33.692841 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff398a-7d4e-4ef0-90f3-3b53387c085f None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:33.697150 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:33.723647 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50497ac-f42a-4639-92bc-3c7b961ec719 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:33.756768 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48df0c-3c12-4ce9-8000-e2afed5ad087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:33.757421 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48df0c-3c12-4ce9-8000-e2afed5ad087 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:33.757700 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48df0c-3c12-4ce9-8000-e2afed5ad087 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:33.758002 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48df0c-3c12-4ce9-8000-e2afed5ad087 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:33.789429 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff398a-7d4e-4ef0-90f3-3b53387c085f None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:33.823115 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510038b-1bcd-4331-b15f-b66f52503051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:33.823427 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e48df0c-3c12-4ce9-8000-e2afed5ad087 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:33.823840 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510038b-1bcd-4331-b15f-b66f52503051 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:33.824099 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510038b-1bcd-4331-b15f-b66f52503051 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:33.824370 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510038b-1bcd-4331-b15f-b66f52503051 None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:33.825011 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e48df0c-3c12-4ce9-8000-e2afed5ad087 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:33.825197 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9510038b-1bcd-4331-b15f-b66f52503051 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:33.825499 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9510038b-1bcd-4331-b15f-b66f52503051 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:33.827033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9510038b-1bcd-4331-b15f-b66f52503051 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:33.844172 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 554/1097] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Jul 15 17:25:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:25:33.849833 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510038b-1bcd-4331-b15f-b66f52503051 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:33.853977 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:33.897512 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:33.922991 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 544/1098] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:25:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 17:25:33.928812 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48df0c-3c12-4ce9-8000-e2afed5ad087 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:33.947127 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510038b-1bcd-4331-b15f-b66f52503051 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:33.979821 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad2bf8-1c29-4eb2-bfc2-1584eb596ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:33.980531 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad2bf8-1c29-4eb2-bfc2-1584eb596ccb None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:33.980804 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad2bf8-1c29-4eb2-bfc2-1584eb596ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:33.981070 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad2bf8-1c29-4eb2-bfc2-1584eb596ccb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:34.023838 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48df0c-3c12-4ce9-8000-e2afed5ad087 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:34.049610 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ad2bf8-1c29-4eb2-bfc2-1584eb596ccb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:34.051098 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ad2bf8-1c29-4eb2-bfc2-1584eb596ccb None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:34.053715 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:34.057022 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed9f04-1da1-4e46-9401-7d9d2e39b1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:34.057948 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed9f04-1da1-4e46-9401-7d9d2e39b1ae None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:34.058199 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed9f04-1da1-4e46-9401-7d9d2e39b1ae None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:34.058639 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed9f04-1da1-4e46-9401-7d9d2e39b1ae None admin] PATH_INFO: `/v3/projects/23f2030aec8d4468bdfb505b82c62091` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:34.060169 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed9f04-1da1-4e46-9401-7d9d2e39b1ae None admin] RBAC: Authorizing `identity:get_project(project_id=23f2030aec8d4468bdfb505b82c62091)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:34.061585 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed9f04-1da1-4e46-9401-7d9d2e39b1ae None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:34.063352 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 545/1099] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:25:33 2022] GET /identity/v3/projects/23f2030aec8d4468bdfb505b82c62091 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:34.069405 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed9f04-1da1-4e46-9401-7d9d2e39b1ae None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:34.112596 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:34.151777 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 555/1100] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:25:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 15 17:25:34.157697 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad2bf8-1c29-4eb2-bfc2-1584eb596ccb None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:34.168610 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed9f04-1da1-4e46-9401-7d9d2e39b1ae None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:34.202428 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a849c7af-9533-4e41-938d-57ddda35a0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:34.203081 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849c7af-9533-4e41-938d-57ddda35a0bf None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:34.203360 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849c7af-9533-4e41-938d-57ddda35a0bf None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:34.203633 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849c7af-9533-4e41-938d-57ddda35a0bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:34.204457 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a849c7af-9533-4e41-938d-57ddda35a0bf None admin] RBAC: Adding query filter params (role.id=70d242b29ede4648b639c7ddae5eaead, scope.project.id=23f2030aec8d4468bdfb505b82c62091, user.id=7b50bcfa4e5e40f0861899bb66ae8cc2) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:34.204759 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a849c7af-9533-4e41-938d-57ddda35a0bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:34.206559 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a849c7af-9533-4e41-938d-57ddda35a0bf None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:34.212260 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 546/1101] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jul 15 17:25:34 2022] GET /identity/v3/role_assignments?user.id=7b50bcfa4e5e40f0861899bb66ae8cc2&scope.project.id=23f2030aec8d4468bdfb505b82c62091&role.id=70d242b29ede4648b639c7ddae5eaead => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:34.256746 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad2bf8-1c29-4eb2-bfc2-1584eb596ccb None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:34.259452 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:34.294592 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c5964-ba3c-421e-ae73-5f61c642cc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:34.295395 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c5964-ba3c-421e-ae73-5f61c642cc43 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:34.295641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c5964-ba3c-421e-ae73-5f61c642cc43 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:34.295942 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c5964-ba3c-421e-ae73-5f61c642cc43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:34.307015 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c5964-ba3c-421e-ae73-5f61c642cc43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:34.311212 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c5964-ba3c-421e-ae73-5f61c642cc43 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:34.327886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-fa4c5964-ba3c-421e-ae73-5f61c642cc43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:25:34.327886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:34.327886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:34.327886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:34.327886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:34.327886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:34.327886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:34.327886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:34.327886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:34.327886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:34.327886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:34.327886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:34.327886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:25:34.327886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:25:34.327886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:25:34.328907 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:25:34.328907 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:34.328907 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:34.328907 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:34.328907 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:34.328907 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:34.328907 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:34.328907 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:34.328907 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:34.328907 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:34.328907 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:34.328907 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:34.328907 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:34.328907 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:34.328907 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:34.328907 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:34.328907 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:34.330194 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:25:34.330194 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:25:34.330194 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:25:34.330194 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:25:34.330194 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 556/1102] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:25:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 17:25:34.335498 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a849c7af-9533-4e41-938d-57ddda35a0bf None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:34.444634 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a849c7af-9533-4e41-938d-57ddda35a0bf None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:34.451936 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:34.481442 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72473568-7cd7-4925-a352-f51704b272ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:34.482126 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72473568-7cd7-4925-a352-f51704b272ab None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:34.482406 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72473568-7cd7-4925-a352-f51704b272ab None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:34.482671 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72473568-7cd7-4925-a352-f51704b272ab None admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:34.483381 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72473568-7cd7-4925-a352-f51704b272ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:34.483677 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72473568-7cd7-4925-a352-f51704b272ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:34.485028 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72473568-7cd7-4925-a352-f51704b272ab None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:34.496816 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 547/1103] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:25:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:34.502560 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c5964-ba3c-421e-ae73-5f61c642cc43 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:34.603445 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c5964-ba3c-421e-ae73-5f61c642cc43 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:34.638503 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc85e4-970d-4e69-82fd-7b7efba1d4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:34.639292 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc85e4-970d-4e69-82fd-7b7efba1d4ff None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:34.639564 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc85e4-970d-4e69-82fd-7b7efba1d4ff None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:34.639828 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc85e4-970d-4e69-82fd-7b7efba1d4ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:34.646701 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bc85e4-970d-4e69-82fd-7b7efba1d4ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:34.648150 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bc85e4-970d-4e69-82fd-7b7efba1d4ff None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:34.662141 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-b7bc85e4-970d-4e69-82fd-7b7efba1d4ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:25:34.662141 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:34.662141 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:34.662141 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:34.662141 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:34.662141 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:34.662141 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:34.662141 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:34.662141 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:34.662141 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:34.662141 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:34.662141 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:34.662141 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 17:25:34.662141 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 17:25:34.662141 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 17:25:34.663068 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 17:25:34.663068 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:34.663068 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:34.663068 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:34.663068 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:34.663068 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:34.663068 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:34.663068 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:34.663068 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:34.663068 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:34.663068 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:34.663068 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:34.663068 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:34.663068 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:34.663068 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:34.663068 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:34.663068 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:34.663950 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 17:25:34.663950 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 17:25:34.663950 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 17:25:34.663950 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 17:25:34.663950 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 17:25:34.663950 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 17:25:34.663950 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:25:34.663950 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:25:34.663950 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 557/1104] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:25:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:25:34.669430 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72473568-7cd7-4925-a352-f51704b272ab None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:34.771716 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72473568-7cd7-4925-a352-f51704b272ab None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:34.807076 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e92fdb-884d-48f5-807e-b5d68efeec1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:34.807736 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e92fdb-884d-48f5-807e-b5d68efeec1f None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:34.808006 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e92fdb-884d-48f5-807e-b5d68efeec1f None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:34.808285 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e92fdb-884d-48f5-807e-b5d68efeec1f None admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:34.809175 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e92fdb-884d-48f5-807e-b5d68efeec1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:34.809480 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e92fdb-884d-48f5-807e-b5d68efeec1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:34.810914 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e92fdb-884d-48f5-807e-b5d68efeec1f None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:34.822782 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 548/1105] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jul 15 17:25:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:34.828975 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc85e4-970d-4e69-82fd-7b7efba1d4ff None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:34.847415 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:34.930794 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc85e4-970d-4e69-82fd-7b7efba1d4ff None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:34.966056 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c8285-2876-400d-baa1-7594c0ae7617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:34.966701 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c8285-2876-400d-baa1-7594c0ae7617 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:34.966978 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c8285-2876-400d-baa1-7594c0ae7617 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:34.967225 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c8285-2876-400d-baa1-7594c0ae7617 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:34.968067 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c8285-2876-400d-baa1-7594c0ae7617 None admin] RBAC: Adding query filter params (role.id=d0e262213cce48f4950efc71e4e127f8, scope.project.id=19cc5221b8074f48b5f73dc9c4289b03, user.id=f9d548c8199e4fdbbce7597bebd63421) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:34.968374 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c8285-2876-400d-baa1-7594c0ae7617 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:34.969809 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c8285-2876-400d-baa1-7594c0ae7617 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:34.975737 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 558/1106] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jul 15 17:25:34 2022] GET /identity/v3/role_assignments?user.id=f9d548c8199e4fdbbce7597bebd63421&scope.project.id=19cc5221b8074f48b5f73dc9c4289b03&role.id=d0e262213cce48f4950efc71e4e127f8 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:36.345061 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418fe88-da60-48b2-92b6-1525782ffff0 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:36.345569 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418fe88-da60-48b2-92b6-1525782ffff0 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:36.345569 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418fe88-da60-48b2-92b6-1525782ffff0 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:36.347795 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 549/1107] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:25:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:25:36.353100 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a693f1-febd-423b-904d-6cbbebe4c5dc None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:36.353520 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a693f1-febd-423b-904d-6cbbebe4c5dc None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:36.353609 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a693f1-febd-423b-904d-6cbbebe4c5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:36.379526 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-57a693f1-febd-423b-904d-6cbbebe4c5dc None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:25:36.380731 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-57a693f1-febd-423b-904d-6cbbebe4c5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:25:36.456472 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 559/1108] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:25:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:25:36.482295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7418fe88-da60-48b2-92b6-1525782ffff0 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:36.514163 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:36.605958 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7418fe88-da60-48b2-92b6-1525782ffff0 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:36.641324 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5036c2-1faf-4ced-b716-a71865f0c0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:36.642141 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5036c2-1faf-4ced-b716-a71865f0c0a9 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:36.642424 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5036c2-1faf-4ced-b716-a71865f0c0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:36.642694 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5036c2-1faf-4ced-b716-a71865f0c0a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:36.644000 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5036c2-1faf-4ced-b716-a71865f0c0a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:36.645452 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5036c2-1faf-4ced-b716-a71865f0c0a9 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:36.647108 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 550/1109] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:25:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:25:36.653504 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a693f1-febd-423b-904d-6cbbebe4c5dc None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:36.665263 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:36.759648 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a693f1-febd-423b-904d-6cbbebe4c5dc None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:36.794435 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2692a-5024-4349-9e03-21c38aa3a253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:36.795104 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2692a-5024-4349-9e03-21c38aa3a253 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:36.795380 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2692a-5024-4349-9e03-21c38aa3a253 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:36.795645 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2692a-5024-4349-9e03-21c38aa3a253 None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:36.796344 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2692a-5024-4349-9e03-21c38aa3a253 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:36.797759 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2692a-5024-4349-9e03-21c38aa3a253 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:36.823269 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 560/1110] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Jul 15 17:25:36 2022] POST /identity/v3/users => generated 286 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 17:25:38.844110 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3547ecc-c283-4521-aeec-d349d23d01fc None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:38.844949 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3547ecc-c283-4521-aeec-d349d23d01fc None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:38.844949 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3547ecc-c283-4521-aeec-d349d23d01fc None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:38.847187 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 551/1111] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:25:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:25:38.856078 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44c710-787d-4df5-9f99-ed3d66955307 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:38.856502 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44c710-787d-4df5-9f99-ed3d66955307 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:38.856654 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44c710-787d-4df5-9f99-ed3d66955307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:38.879221 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-4e44c710-787d-4df5-9f99-ed3d66955307 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:25:38.880407 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-4e44c710-787d-4df5-9f99-ed3d66955307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:25:38.946011 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:38.955755 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 561/1112] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:25:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:25:38.979275 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3547ecc-c283-4521-aeec-d349d23d01fc None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:39.086109 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:39.095726 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3547ecc-c283-4521-aeec-d349d23d01fc None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:39.133884 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55befe7-9db2-4c44-aea9-3cab1791f41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:39.134749 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55befe7-9db2-4c44-aea9-3cab1791f41e None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:39.135082 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55befe7-9db2-4c44-aea9-3cab1791f41e None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:39.135292 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55befe7-9db2-4c44-aea9-3cab1791f41e None admin] PATH_INFO: `/v3/roles/c9b1f4b47f054f7a8a9a079e65a7197a` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:39.136791 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55befe7-9db2-4c44-aea9-3cab1791f41e None admin] RBAC: Authorizing `identity:get_role(role_id=c9b1f4b47f054f7a8a9a079e65a7197a)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:39.138212 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55befe7-9db2-4c44-aea9-3cab1791f41e None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:39.139587 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 552/1113] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:25:38 2022] GET /identity/v3/roles/c9b1f4b47f054f7a8a9a079e65a7197a => generated 223 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:39.146109 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44c710-787d-4df5-9f99-ed3d66955307 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:39.259815 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44c710-787d-4df5-9f99-ed3d66955307 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:39.295349 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d89bf-af61-46fd-8cf6-bea38197feba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:39.296226 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d89bf-af61-46fd-8cf6-bea38197feba None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:39.296506 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d89bf-af61-46fd-8cf6-bea38197feba None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:39.296773 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d89bf-af61-46fd-8cf6-bea38197feba None admin] PATH_INFO: `/v3/users/93324f8b21474f9689fbba24507f54df` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:39.312625 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095d89bf-af61-46fd-8cf6-bea38197feba None admin] RBAC: Authorizing `identity:get_user(user_id=93324f8b21474f9689fbba24507f54df)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:39.314673 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095d89bf-af61-46fd-8cf6-bea38197feba None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:39.317287 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 562/1114] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:25:39 2022] GET /identity/v3/users/93324f8b21474f9689fbba24507f54df => generated 286 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:39.325938 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55befe7-9db2-4c44-aea9-3cab1791f41e None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:39.448076 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55befe7-9db2-4c44-aea9-3cab1791f41e None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:39.483223 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89404bb1-4a81-4db0-a073-9241bde7c07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:39.483868 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89404bb1-4a81-4db0-a073-9241bde7c07d None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:39.484158 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89404bb1-4a81-4db0-a073-9241bde7c07d None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:39.484426 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89404bb1-4a81-4db0-a073-9241bde7c07d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:39.518648 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:39.567440 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89404bb1-4a81-4db0-a073-9241bde7c07d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:39.568916 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89404bb1-4a81-4db0-a073-9241bde7c07d None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:39.677523 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 553/1115] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:25:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 17:25:39.684127 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d89bf-af61-46fd-8cf6-bea38197feba None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:39.747303 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:39.794348 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d89bf-af61-46fd-8cf6-bea38197feba None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:39.830340 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897586d-e843-4ee2-8eb5-0977449b947b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:39.831184 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897586d-e843-4ee2-8eb5-0977449b947b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:39.831466 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897586d-e843-4ee2-8eb5-0977449b947b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:39.831733 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897586d-e843-4ee2-8eb5-0977449b947b None admin] PATH_INFO: `/v3/projects/23f2030aec8d4468bdfb505b82c62091` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:39.833023 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897586d-e843-4ee2-8eb5-0977449b947b None admin] RBAC: Authorizing `identity:get_project(project_id=23f2030aec8d4468bdfb505b82c62091)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:39.834479 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897586d-e843-4ee2-8eb5-0977449b947b None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:39.836165 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 563/1116] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:25:39 2022] GET /identity/v3/projects/23f2030aec8d4468bdfb505b82c62091 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:39.843437 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89404bb1-4a81-4db0-a073-9241bde7c07d None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:39.916257 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:39.955303 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89404bb1-4a81-4db0-a073-9241bde7c07d None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:39.990146 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac4d68-6e2a-4c0d-a138-51e665552c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:39.990804 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac4d68-6e2a-4c0d-a138-51e665552c8c None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:39.991074 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac4d68-6e2a-4c0d-a138-51e665552c8c None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:39.991340 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac4d68-6e2a-4c0d-a138-51e665552c8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:39.992164 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aac4d68-6e2a-4c0d-a138-51e665552c8c None admin] RBAC: Adding query filter params (role.id=c9b1f4b47f054f7a8a9a079e65a7197a, scope.project.id=23f2030aec8d4468bdfb505b82c62091, user.id=93324f8b21474f9689fbba24507f54df) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:39.992496 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aac4d68-6e2a-4c0d-a138-51e665552c8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:39.993978 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aac4d68-6e2a-4c0d-a138-51e665552c8c None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:40.000493 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 554/1117] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jul 15 17:25:39 2022] GET /identity/v3/role_assignments?user.id=93324f8b21474f9689fbba24507f54df&scope.project.id=23f2030aec8d4468bdfb505b82c62091&role.id=c9b1f4b47f054f7a8a9a079e65a7197a => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:41.952591 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3120638-5f15-47eb-8ab7-9907e15456af None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:41.953503 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3120638-5f15-47eb-8ab7-9907e15456af None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:41.953503 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3120638-5f15-47eb-8ab7-9907e15456af None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:41.956045 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 564/1118] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:25:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:25:41.961535 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d722f-ced8-4f57-aa05-c1ab8821b5c6 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:41.962000 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d722f-ced8-4f57-aa05-c1ab8821b5c6 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:41.962091 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d722f-ced8-4f57-aa05-c1ab8821b5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:41.980483 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-6a2d722f-ced8-4f57-aa05-c1ab8821b5c6 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:25:41.981642 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-6a2d722f-ced8-4f57-aa05-c1ab8821b5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:25:42.050502 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 555/1119] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:25:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:25:42.072957 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3120638-5f15-47eb-8ab7-9907e15456af None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:42.191674 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3120638-5f15-47eb-8ab7-9907e15456af None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:42.217087 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:42.233512 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6e6d3-959e-4111-8baa-08f6ad564343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:42.234412 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6e6d3-959e-4111-8baa-08f6ad564343 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:42.234695 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6e6d3-959e-4111-8baa-08f6ad564343 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:42.234971 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6e6d3-959e-4111-8baa-08f6ad564343 None admin] PATH_INFO: `/v3/roles/c9b1f4b47f054f7a8a9a079e65a7197a` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:42.236598 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c6e6d3-959e-4111-8baa-08f6ad564343 None admin] RBAC: Authorizing `identity:get_role(role_id=c9b1f4b47f054f7a8a9a079e65a7197a)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:42.238020 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c6e6d3-959e-4111-8baa-08f6ad564343 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:42.239413 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 565/1120] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:25:42 2022] GET /identity/v3/roles/c9b1f4b47f054f7a8a9a079e65a7197a => generated 223 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:42.245521 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d722f-ced8-4f57-aa05-c1ab8821b5c6 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:42.308200 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:42.358351 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d722f-ced8-4f57-aa05-c1ab8821b5c6 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:42.394071 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00140c-e928-4c35-b447-8b9e5ab2c574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:42.394972 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00140c-e928-4c35-b447-8b9e5ab2c574 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:42.395248 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00140c-e928-4c35-b447-8b9e5ab2c574 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:42.395519 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00140c-e928-4c35-b447-8b9e5ab2c574 None admin] PATH_INFO: `/v3/users/93324f8b21474f9689fbba24507f54df` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:42.396748 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d00140c-e928-4c35-b447-8b9e5ab2c574 None admin] RBAC: Authorizing `identity:get_user(user_id=93324f8b21474f9689fbba24507f54df)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:42.398226 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d00140c-e928-4c35-b447-8b9e5ab2c574 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:42.399872 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 556/1121] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:25:42 2022] GET /identity/v3/users/93324f8b21474f9689fbba24507f54df => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:42.406851 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6e6d3-959e-4111-8baa-08f6ad564343 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:42.536933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6e6d3-959e-4111-8baa-08f6ad564343 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:42.570986 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbbd995-e17b-4be3-9a40-134c18a2e477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:42.572120 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbd995-e17b-4be3-9a40-134c18a2e477 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:42.572396 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbd995-e17b-4be3-9a40-134c18a2e477 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:42.572665 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbd995-e17b-4be3-9a40-134c18a2e477 None admin] PATH_INFO: `/v3/projects/23f2030aec8d4468bdfb505b82c62091` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:42.573916 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbbd995-e17b-4be3-9a40-134c18a2e477 None admin] RBAC: Authorizing `identity:get_project(project_id=23f2030aec8d4468bdfb505b82c62091)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:42.575439 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbbd995-e17b-4be3-9a40-134c18a2e477 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:42.577133 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 566/1122] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:25:42 2022] GET /identity/v3/projects/23f2030aec8d4468bdfb505b82c62091 => generated 311 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:42.586546 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00140c-e928-4c35-b447-8b9e5ab2c574 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:42.690479 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00140c-e928-4c35-b447-8b9e5ab2c574 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:42.715545 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:42.728258 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d92d7-4358-4ddf-926d-261dbf066d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:42.729162 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d92d7-4358-4ddf-926d-261dbf066d62 None admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:42.729431 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d92d7-4358-4ddf-926d-261dbf066d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:42.729727 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d92d7-4358-4ddf-926d-261dbf066d62 None admin] PATH_INFO: `/v3/projects/23f2030aec8d4468bdfb505b82c62091/users/93324f8b21474f9689fbba24507f54df/roles/c9b1f4b47f054f7a8a9a079e65a7197a` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:42.732140 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d92d7-4358-4ddf-926d-261dbf066d62 None admin] RBAC: Authorizing `identity:create_grant(project_id=23f2030aec8d4468bdfb505b82c62091, user_id=93324f8b21474f9689fbba24507f54df, role_id=c9b1f4b47f054f7a8a9a079e65a7197a)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:42.733639 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d92d7-4358-4ddf-926d-261dbf066d62 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:42.750695 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 557/1123] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Jul 15 17:25:42 2022] PUT /identity/v3/projects/23f2030aec8d4468bdfb505b82c62091/users/93324f8b21474f9689fbba24507f54df/roles/c9b1f4b47f054f7a8a9a079e65a7197a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:25:44.732818 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c01546-c132-4ed1-856d-4607c0025079 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:44.733656 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c01546-c132-4ed1-856d-4607c0025079 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:44.733656 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c01546-c132-4ed1-856d-4607c0025079 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:44.735661 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 567/1124] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:25:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:25:44.742034 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe85a7-1fdc-4782-a585-b02a8242aa46 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:44.742756 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe85a7-1fdc-4782-a585-b02a8242aa46 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:44.742932 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe85a7-1fdc-4782-a585-b02a8242aa46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:44.762260 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-23fe85a7-1fdc-4782-a585-b02a8242aa46 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:25:44.763433 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-23fe85a7-1fdc-4782-a585-b02a8242aa46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:25:44.837235 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 558/1125] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:25:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:25:44.861455 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c01546-c132-4ed1-856d-4607c0025079 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:44.923492 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:44.969892 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c01546-c132-4ed1-856d-4607c0025079 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:45.006850 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c58767-b8a5-40c8-80f6-1ac04da58e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:45.007636 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c58767-b8a5-40c8-80f6-1ac04da58e17 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:45.007921 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c58767-b8a5-40c8-80f6-1ac04da58e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:45.008197 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c58767-b8a5-40c8-80f6-1ac04da58e17 None admin] PATH_INFO: `/v3/roles/c9b1f4b47f054f7a8a9a079e65a7197a` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:45.009813 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c58767-b8a5-40c8-80f6-1ac04da58e17 None admin] RBAC: Authorizing `identity:get_role(role_id=c9b1f4b47f054f7a8a9a079e65a7197a)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:45.011376 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c58767-b8a5-40c8-80f6-1ac04da58e17 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:45.013172 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 568/1126] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:25:44 2022] GET /identity/v3/roles/c9b1f4b47f054f7a8a9a079e65a7197a => generated 223 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:45.020096 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe85a7-1fdc-4782-a585-b02a8242aa46 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:45.129505 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe85a7-1fdc-4782-a585-b02a8242aa46 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:45.143413 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:45.167075 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e2262-3b60-4aee-8eed-69895f4099c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:45.168177 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e2262-3b60-4aee-8eed-69895f4099c8 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:45.168457 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e2262-3b60-4aee-8eed-69895f4099c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:45.168714 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e2262-3b60-4aee-8eed-69895f4099c8 None admin] PATH_INFO: `/v3/users/93324f8b21474f9689fbba24507f54df` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:45.169960 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e2262-3b60-4aee-8eed-69895f4099c8 None admin] RBAC: Authorizing `identity:get_user(user_id=93324f8b21474f9689fbba24507f54df)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:45.171404 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e2262-3b60-4aee-8eed-69895f4099c8 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:45.173041 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 559/1127] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:25:45 2022] GET /identity/v3/users/93324f8b21474f9689fbba24507f54df => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:45.181869 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c58767-b8a5-40c8-80f6-1ac04da58e17 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:45.283903 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c58767-b8a5-40c8-80f6-1ac04da58e17 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:45.309898 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:45.321394 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577e24c-61ab-422c-997c-db46f5a48026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:45.322091 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577e24c-61ab-422c-997c-db46f5a48026 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:45.322368 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577e24c-61ab-422c-997c-db46f5a48026 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:45.322634 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577e24c-61ab-422c-997c-db46f5a48026 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:45.388554 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577e24c-61ab-422c-997c-db46f5a48026 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:45.390015 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577e24c-61ab-422c-997c-db46f5a48026 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:45.490276 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 569/1128] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:25:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 17:25:45.496729 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e2262-3b60-4aee-8eed-69895f4099c8 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:45.599868 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e2262-3b60-4aee-8eed-69895f4099c8 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:45.634924 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d75b1e7-38a2-469b-82bd-ebe3ae9e841d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:45.635774 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75b1e7-38a2-469b-82bd-ebe3ae9e841d None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:45.636093 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75b1e7-38a2-469b-82bd-ebe3ae9e841d None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:45.636364 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75b1e7-38a2-469b-82bd-ebe3ae9e841d None admin] PATH_INFO: `/v3/projects/23f2030aec8d4468bdfb505b82c62091` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:45.637753 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d75b1e7-38a2-469b-82bd-ebe3ae9e841d None admin] RBAC: Authorizing `identity:get_project(project_id=23f2030aec8d4468bdfb505b82c62091)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:45.639198 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d75b1e7-38a2-469b-82bd-ebe3ae9e841d None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:45.640879 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 560/1129] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:25:45 2022] GET /identity/v3/projects/23f2030aec8d4468bdfb505b82c62091 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:25:45.650382 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577e24c-61ab-422c-997c-db46f5a48026 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:45.679295 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:45.757447 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577e24c-61ab-422c-997c-db46f5a48026 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:45.803989 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b7f68-7b7f-432c-ba3d-2d77abca5fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:45.804644 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b7f68-7b7f-432c-ba3d-2d77abca5fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:45.804928 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b7f68-7b7f-432c-ba3d-2d77abca5fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:45.805200 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b7f68-7b7f-432c-ba3d-2d77abca5fe8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:45.806069 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b7f68-7b7f-432c-ba3d-2d77abca5fe8 None admin] RBAC: Adding query filter params (role.id=c9b1f4b47f054f7a8a9a079e65a7197a, scope.project.id=23f2030aec8d4468bdfb505b82c62091, user.id=93324f8b21474f9689fbba24507f54df) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:45.806382 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b7f68-7b7f-432c-ba3d-2d77abca5fe8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:45.807809 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b7f68-7b7f-432c-ba3d-2d77abca5fe8 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:45.814531 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 570/1130] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jul 15 17:25:45 2022] GET /identity/v3/role_assignments?user.id=93324f8b21474f9689fbba24507f54df&scope.project.id=23f2030aec8d4468bdfb505b82c62091&role.id=c9b1f4b47f054f7a8a9a079e65a7197a => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:47.817252 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9973b5f-fabd-4a3d-8db2-21c69d42e5e9 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:47.817845 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9973b5f-fabd-4a3d-8db2-21c69d42e5e9 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:47.817845 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9973b5f-fabd-4a3d-8db2-21c69d42e5e9 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:47.819210 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 561/1131] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:25:47.825583 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656bfe1-898d-41ed-a6d1-d6c39aec3cbf None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:47.826362 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656bfe1-898d-41ed-a6d1-d6c39aec3cbf None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:47.826509 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656bfe1-898d-41ed-a6d1-d6c39aec3cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:47.849089 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-c656bfe1-898d-41ed-a6d1-d6c39aec3cbf None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:25:47.850344 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c656bfe1-898d-41ed-a6d1-d6c39aec3cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:25:47.918712 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 571/1132] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:25:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:25:47.942189 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9973b5f-fabd-4a3d-8db2-21c69d42e5e9 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:47.998433 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:48.051070 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9973b5f-fabd-4a3d-8db2-21c69d42e5e9 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:48.088966 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6aa246-ffd7-4a01-be73-141905d05ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:48.090253 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6aa246-ffd7-4a01-be73-141905d05ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:48.090681 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6aa246-ffd7-4a01-be73-141905d05ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:48.091107 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6aa246-ffd7-4a01-be73-141905d05ea8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:48.093194 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6aa246-ffd7-4a01-be73-141905d05ea8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:48.095690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6aa246-ffd7-4a01-be73-141905d05ea8 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:48.098282 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 562/1133] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:25:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:48.104801 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656bfe1-898d-41ed-a6d1-d6c39aec3cbf None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:48.132188 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:48.212411 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656bfe1-898d-41ed-a6d1-d6c39aec3cbf None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:48.247912 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e38d91-a425-47b2-aa3f-0f2640bea264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:48.248565 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e38d91-a425-47b2-aa3f-0f2640bea264 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:48.248846 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e38d91-a425-47b2-aa3f-0f2640bea264 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:48.249116 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e38d91-a425-47b2-aa3f-0f2640bea264 None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:48.249821 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e38d91-a425-47b2-aa3f-0f2640bea264 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:48.251269 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e38d91-a425-47b2-aa3f-0f2640bea264 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:48.282841 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 572/1134] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Jul 15 17:25:48 2022] POST /identity/v3/projects => generated 311 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:25:50.281640 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58c6a2-e27f-438e-a65a-69940365e77c None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:50.282586 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58c6a2-e27f-438e-a65a-69940365e77c None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:50.282586 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58c6a2-e27f-438e-a65a-69940365e77c None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:50.284777 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 563/1135] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:25:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:25:50.291159 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47358f36-5502-4fb2-965e-e03ca4052112 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:50.291917 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47358f36-5502-4fb2-965e-e03ca4052112 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:50.292104 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47358f36-5502-4fb2-965e-e03ca4052112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:50.316604 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-47358f36-5502-4fb2-965e-e03ca4052112 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:25:50.317814 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-47358f36-5502-4fb2-965e-e03ca4052112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:25:50.392328 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 573/1136] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:25:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:25:50.416697 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58c6a2-e27f-438e-a65a-69940365e77c None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:50.533190 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58c6a2-e27f-438e-a65a-69940365e77c None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:50.551351 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:50.578076 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68fda2-741a-4a15-a2b6-eb50d90a1434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:50.578875 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68fda2-741a-4a15-a2b6-eb50d90a1434 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:50.579154 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68fda2-741a-4a15-a2b6-eb50d90a1434 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:50.579425 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68fda2-741a-4a15-a2b6-eb50d90a1434 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:50.581198 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a68fda2-741a-4a15-a2b6-eb50d90a1434 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:50.582654 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a68fda2-741a-4a15-a2b6-eb50d90a1434 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:50.584276 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 564/1137] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:25:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:50.590890 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47358f36-5502-4fb2-965e-e03ca4052112 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:50.594070 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:50.698379 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47358f36-5502-4fb2-965e-e03ca4052112 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:50.735103 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64f2cf-ebd5-486a-b0e8-0545382d65ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:50.735768 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64f2cf-ebd5-486a-b0e8-0545382d65ab None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:50.736050 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64f2cf-ebd5-486a-b0e8-0545382d65ab None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:50.736320 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64f2cf-ebd5-486a-b0e8-0545382d65ab None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:50.737028 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a64f2cf-ebd5-486a-b0e8-0545382d65ab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:50.738494 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a64f2cf-ebd5-486a-b0e8-0545382d65ab None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:50.764003 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 574/1138] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Jul 15 17:25:50 2022] POST /identity/v3/users => generated 286 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:25:52.881153 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9b98e-da12-4d69-913d-0b7cbd3a2212 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:52.881734 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9b98e-da12-4d69-913d-0b7cbd3a2212 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:52.881734 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9b98e-da12-4d69-913d-0b7cbd3a2212 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:52.883416 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 565/1139] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:25:52.890530 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e549dd7-8662-4d3b-a2af-1a36627ef0bc None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:52.891215 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e549dd7-8662-4d3b-a2af-1a36627ef0bc None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:52.891394 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e549dd7-8662-4d3b-a2af-1a36627ef0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:52.918599 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-7e549dd7-8662-4d3b-a2af-1a36627ef0bc None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:25:52.919781 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7e549dd7-8662-4d3b-a2af-1a36627ef0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:25:52.976819 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:52.991967 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 575/1140] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:25:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:25:53.022422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f9b98e-da12-4d69-913d-0b7cbd3a2212 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:53.144191 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f9b98e-da12-4d69-913d-0b7cbd3a2212 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:53.179172 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232af32-edd9-486e-a2a8-85649444e19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:53.179963 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232af32-edd9-486e-a2a8-85649444e19c None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:53.180243 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232af32-edd9-486e-a2a8-85649444e19c None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:53.180515 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232af32-edd9-486e-a2a8-85649444e19c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:53.191057 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4232af32-edd9-486e-a2a8-85649444e19c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:25:53.198732 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-4232af32-edd9-486e-a2a8-85649444e19c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:25:53.198732 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:53.198732 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:53.198732 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:53.198732 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:53.198732 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:53.198732 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:53.198732 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:53.198732 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:53.198732 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:53.198732 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:53.198732 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:53.198732 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:25:53.198732 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:25:53.198732 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:25:53.198732 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:25:53.199849 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:25:53.199849 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:25:53.199849 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:25:53.199849 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:25:53.199849 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:53.199849 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:53.199849 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:53.199849 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:53.199849 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:53.199849 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:53.199849 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:53.199849 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:53.199849 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:53.199849 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:53.199849 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:53.199849 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:53.200949 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:53.200949 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:53.200949 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:53.200949 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:53.200949 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:25:53.200949 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:25:53.200949 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:25:53.200949 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:25:53.200949 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:25:53.200949 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:25:53.200949 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:25:53.200949 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:53.200949 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 566/1141] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jul 15 17:25:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:25:53.206690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e549dd7-8662-4d3b-a2af-1a36627ef0bc None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:53.310080 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e549dd7-8662-4d3b-a2af-1a36627ef0bc None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:53.345794 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb40b5d-19c9-402d-9ee2-b3d7394d17e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:53.346468 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb40b5d-19c9-402d-9ee2-b3d7394d17e6 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:53.346755 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb40b5d-19c9-402d-9ee2-b3d7394d17e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:53.347031 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb40b5d-19c9-402d-9ee2-b3d7394d17e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:53.347786 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb40b5d-19c9-402d-9ee2-b3d7394d17e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:53.348094 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb40b5d-19c9-402d-9ee2-b3d7394d17e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:53.349469 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb40b5d-19c9-402d-9ee2-b3d7394d17e6 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:53.357683 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 576/1142] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:25:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:25:53.364042 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232af32-edd9-486e-a2a8-85649444e19c None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:53.419674 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:53.474935 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232af32-edd9-486e-a2a8-85649444e19c None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:53.521532 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b9d547-4c0c-4d5b-818d-1d2544ff3536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:53.522429 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9d547-4c0c-4d5b-818d-1d2544ff3536 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:53.522709 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9d547-4c0c-4d5b-818d-1d2544ff3536 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:53.522980 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9d547-4c0c-4d5b-818d-1d2544ff3536 None admin] PATH_INFO: `/v3/users/d000361765b54df68267c40384cdd184` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:53.536790 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b9d547-4c0c-4d5b-818d-1d2544ff3536 None admin] RBAC: Authorizing `identity:get_user(user_id=d000361765b54df68267c40384cdd184)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:53.538280 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b9d547-4c0c-4d5b-818d-1d2544ff3536 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:53.539922 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 567/1143] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:25:53 2022] GET /identity/v3/users/d000361765b54df68267c40384cdd184 => generated 286 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:53.546570 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb40b5d-19c9-402d-9ee2-b3d7394d17e6 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:53.617995 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:53.673249 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb40b5d-19c9-402d-9ee2-b3d7394d17e6 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:53.709716 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef741ecd-850b-4adf-9602-94f129bc6dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:53.710382 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef741ecd-850b-4adf-9602-94f129bc6dbe None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:53.710664 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef741ecd-850b-4adf-9602-94f129bc6dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:53.710933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef741ecd-850b-4adf-9602-94f129bc6dbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:53.780945 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef741ecd-850b-4adf-9602-94f129bc6dbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:53.782426 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef741ecd-850b-4adf-9602-94f129bc6dbe None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:53.831501 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:53.895019 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 577/1144] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:25:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 17:25:53.902330 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b9d547-4c0c-4d5b-818d-1d2544ff3536 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:54.012520 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b9d547-4c0c-4d5b-818d-1d2544ff3536 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:54.015064 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:54.052203 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55290499-1149-41b1-82a3-24715c5221d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:54.053081 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55290499-1149-41b1-82a3-24715c5221d2 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:54.053363 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55290499-1149-41b1-82a3-24715c5221d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:54.053638 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55290499-1149-41b1-82a3-24715c5221d2 None admin] PATH_INFO: `/v3/projects/adecad6e980c47c995882888eea4f7ee` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:54.054924 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55290499-1149-41b1-82a3-24715c5221d2 None admin] RBAC: Authorizing `identity:get_project(project_id=adecad6e980c47c995882888eea4f7ee)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:54.056348 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55290499-1149-41b1-82a3-24715c5221d2 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:54.058172 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 568/1145] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:25:53 2022] GET /identity/v3/projects/adecad6e980c47c995882888eea4f7ee => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:54.064541 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef741ecd-850b-4adf-9602-94f129bc6dbe None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:54.178700 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef741ecd-850b-4adf-9602-94f129bc6dbe None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:54.215058 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba143cb-d32b-4db5-a2f0-4644042c5e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:54.215715 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba143cb-d32b-4db5-a2f0-4644042c5e35 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:54.215991 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba143cb-d32b-4db5-a2f0-4644042c5e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:54.216259 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba143cb-d32b-4db5-a2f0-4644042c5e35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:54.217096 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba143cb-d32b-4db5-a2f0-4644042c5e35 None admin] RBAC: Adding query filter params (role.id=70d242b29ede4648b639c7ddae5eaead, scope.project.id=adecad6e980c47c995882888eea4f7ee, user.id=d000361765b54df68267c40384cdd184) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:54.217394 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba143cb-d32b-4db5-a2f0-4644042c5e35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:54.218972 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba143cb-d32b-4db5-a2f0-4644042c5e35 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:54.225213 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 578/1146] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jul 15 17:25:54 2022] GET /identity/v3/role_assignments?user.id=d000361765b54df68267c40384cdd184&scope.project.id=adecad6e980c47c995882888eea4f7ee&role.id=70d242b29ede4648b639c7ddae5eaead => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:56.182127 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee959e3-72e2-4175-bb1f-216cd67e66ac None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:56.182752 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee959e3-72e2-4175-bb1f-216cd67e66ac None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:56.182752 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee959e3-72e2-4175-bb1f-216cd67e66ac None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:56.184848 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 569/1147] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:25:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:25:56.192372 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e03553-39df-43be-96a0-8f93ca645be2 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:56.192807 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e03553-39df-43be-96a0-8f93ca645be2 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:56.192916 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e03553-39df-43be-96a0-8f93ca645be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:56.211532 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-29e03553-39df-43be-96a0-8f93ca645be2 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:25:56.212705 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-29e03553-39df-43be-96a0-8f93ca645be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:25:56.222263 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:56.308078 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 579/1148] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:25:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:25:56.330707 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee959e3-72e2-4175-bb1f-216cd67e66ac None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:56.441082 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee959e3-72e2-4175-bb1f-216cd67e66ac None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:56.479536 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5536c6-9d33-485d-be2b-055b7564d75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:56.480546 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5536c6-9d33-485d-be2b-055b7564d75e None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:56.480830 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5536c6-9d33-485d-be2b-055b7564d75e None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:56.481106 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5536c6-9d33-485d-be2b-055b7564d75e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:56.492567 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5536c6-9d33-485d-be2b-055b7564d75e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:25:56.500346 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-ec5536c6-9d33-485d-be2b-055b7564d75e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:25:56.500346 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:56.500346 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:56.500346 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:56.500346 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:56.500346 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:56.500346 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:56.500346 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:56.500346 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:56.500346 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:56.500346 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:56.500346 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:56.500346 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:25:56.500346 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:25:56.500346 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:25:56.500346 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:25:56.501443 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:25:56.501443 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:25:56.501443 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:25:56.501443 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:25:56.501443 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:56.501443 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:56.501443 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:56.501443 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:56.501443 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:56.501443 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:56.501443 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:56.501443 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:56.501443 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:56.501443 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:56.501443 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:56.501443 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:56.502951 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:56.502951 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:56.502951 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:56.502951 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:56.502951 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:25:56.502951 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:25:56.502951 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:25:56.502951 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:25:56.502951 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:25:56.502951 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:25:56.502951 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:25:56.502951 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:25:56.502951 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 570/1149] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jul 15 17:25:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:25:56.510965 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e03553-39df-43be-96a0-8f93ca645be2 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:56.632077 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e03553-39df-43be-96a0-8f93ca645be2 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:56.668175 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470c356-846f-4643-ad94-2df8b3aad8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:56.668838 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470c356-846f-4643-ad94-2df8b3aad8af None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:56.669119 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470c356-846f-4643-ad94-2df8b3aad8af None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:56.669394 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470c356-846f-4643-ad94-2df8b3aad8af None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:56.670175 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e470c356-846f-4643-ad94-2df8b3aad8af None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:56.670459 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e470c356-846f-4643-ad94-2df8b3aad8af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:56.671839 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e470c356-846f-4643-ad94-2df8b3aad8af None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:56.679990 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 580/1150] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:25:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:56.690389 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5536c6-9d33-485d-be2b-055b7564d75e None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:56.726921 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:56.802058 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5536c6-9d33-485d-be2b-055b7564d75e None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:56.836896 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee954fd-ae6f-400a-acbf-44d2d9e86b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:56.837751 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee954fd-ae6f-400a-acbf-44d2d9e86b94 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:56.838058 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee954fd-ae6f-400a-acbf-44d2d9e86b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:56.838328 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee954fd-ae6f-400a-acbf-44d2d9e86b94 None admin] PATH_INFO: `/v3/users/d000361765b54df68267c40384cdd184` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:56.839583 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee954fd-ae6f-400a-acbf-44d2d9e86b94 None admin] RBAC: Authorizing `identity:get_user(user_id=d000361765b54df68267c40384cdd184)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:56.840999 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee954fd-ae6f-400a-acbf-44d2d9e86b94 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:56.842659 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 571/1151] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:25:56 2022] GET /identity/v3/users/d000361765b54df68267c40384cdd184 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:56.852269 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470c356-846f-4643-ad94-2df8b3aad8af None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:56.867383 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:56.963012 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470c356-846f-4643-ad94-2df8b3aad8af None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:56.998375 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963298d3-f104-41b9-912a-540528736a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:56.999147 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963298d3-f104-41b9-912a-540528736a55 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:56.999422 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963298d3-f104-41b9-912a-540528736a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:56.999691 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963298d3-f104-41b9-912a-540528736a55 None admin] PATH_INFO: `/v3/projects/adecad6e980c47c995882888eea4f7ee` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:57.000948 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963298d3-f104-41b9-912a-540528736a55 None admin] RBAC: Authorizing `identity:get_project(project_id=adecad6e980c47c995882888eea4f7ee)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:57.002407 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963298d3-f104-41b9-912a-540528736a55 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:57.004085 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 581/1152] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:25:56 2022] GET /identity/v3/projects/adecad6e980c47c995882888eea4f7ee => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:57.010074 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee954fd-ae6f-400a-acbf-44d2d9e86b94 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:57.113401 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:57.116703 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee954fd-ae6f-400a-acbf-44d2d9e86b94 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:57.150991 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6038102-e356-433a-a072-4a1c98a47a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:57.152083 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6038102-e356-433a-a072-4a1c98a47a76 None admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:57.152362 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6038102-e356-433a-a072-4a1c98a47a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:57.152631 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6038102-e356-433a-a072-4a1c98a47a76 None admin] PATH_INFO: `/v3/projects/adecad6e980c47c995882888eea4f7ee/users/d000361765b54df68267c40384cdd184/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:57.154820 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6038102-e356-433a-a072-4a1c98a47a76 None admin] RBAC: Authorizing `identity:create_grant(project_id=adecad6e980c47c995882888eea4f7ee, user_id=d000361765b54df68267c40384cdd184, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:57.156234 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6038102-e356-433a-a072-4a1c98a47a76 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:57.172059 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 572/1153] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Jul 15 17:25:57 2022] PUT /identity/v3/projects/adecad6e980c47c995882888eea4f7ee/users/d000361765b54df68267c40384cdd184/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:25:59.108744 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c3aac-c8a7-4b80-9366-10d471a3c14b None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:59.109626 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c3aac-c8a7-4b80-9366-10d471a3c14b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:59.109626 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c3aac-c8a7-4b80-9366-10d471a3c14b None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:59.111896 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 582/1154] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:25:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:25:59.117687 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bfd71-1b34-4027-a331-8697a5de89bb None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:59.118149 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bfd71-1b34-4027-a331-8697a5de89bb None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:59.118250 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bfd71-1b34-4027-a331-8697a5de89bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:59.136793 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-4c2bfd71-1b34-4027-a331-8697a5de89bb None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:25:59.138129 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-4c2bfd71-1b34-4027-a331-8697a5de89bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:25:59.207723 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 573/1155] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:25:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:25:59.231476 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c3aac-c8a7-4b80-9366-10d471a3c14b None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:59.323843 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:59.353581 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c3aac-c8a7-4b80-9366-10d471a3c14b None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:59.388930 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5132698-e911-49e4-9ead-33d09953ba90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:59.389654 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5132698-e911-49e4-9ead-33d09953ba90 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:59.389966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5132698-e911-49e4-9ead-33d09953ba90 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:59.390235 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5132698-e911-49e4-9ead-33d09953ba90 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:59.401322 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5132698-e911-49e4-9ead-33d09953ba90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:25:59.409235 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-b5132698-e911-49e4-9ead-33d09953ba90 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:25:59.409235 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:25:59.409235 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:25:59.409235 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:25:59.409235 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:25:59.409235 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:25:59.409235 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:25:59.409235 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:25:59.409235 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:25:59.409235 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:25:59.409235 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:25:59.409235 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:25:59.409235 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:25:59.409235 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:25:59.409235 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:25:59.409235 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:25:59.410336 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:25:59.410336 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:25:59.410336 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:25:59.410336 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:25:59.410336 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:25:59.410336 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:25:59.410336 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:25:59.410336 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:25:59.410336 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:25:59.410336 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:25:59.410336 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:25:59.410336 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:25:59.410336 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:25:59.410336 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:25:59.410336 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:25:59.410336 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:25:59.411303 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:25:59.411303 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:25:59.411303 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:25:59.411303 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:25:59.411303 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:25:59.411303 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:25:59.411303 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:25:59.411303 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:25:59.411303 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:25:59.411303 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:25:59.411303 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:25:59.411303 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:25:59.411303 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 583/1156] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jul 15 17:25:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:25:59.417419 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2bfd71-1b34-4027-a331-8697a5de89bb None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:59.514519 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:59.525725 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2bfd71-1b34-4027-a331-8697a5de89bb None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:59.561221 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725e410-539f-4d50-8e8e-86d0403d042e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:59.561913 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725e410-539f-4d50-8e8e-86d0403d042e None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:59.562196 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725e410-539f-4d50-8e8e-86d0403d042e None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:59.562472 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725e410-539f-4d50-8e8e-86d0403d042e None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:59.563245 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7725e410-539f-4d50-8e8e-86d0403d042e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:25:59.563548 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7725e410-539f-4d50-8e8e-86d0403d042e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:59.564922 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7725e410-539f-4d50-8e8e-86d0403d042e None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:59.573737 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 574/1157] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:25:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:59.580238 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5132698-e911-49e4-9ead-33d09953ba90 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:59.688303 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5132698-e911-49e4-9ead-33d09953ba90 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:59.726036 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085541b5-1c99-4902-beb0-f8b1bf07ba47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:59.726901 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085541b5-1c99-4902-beb0-f8b1bf07ba47 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:59.727176 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085541b5-1c99-4902-beb0-f8b1bf07ba47 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:59.727445 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085541b5-1c99-4902-beb0-f8b1bf07ba47 None admin] PATH_INFO: `/v3/users/d000361765b54df68267c40384cdd184` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:59.728751 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085541b5-1c99-4902-beb0-f8b1bf07ba47 None admin] RBAC: Authorizing `identity:get_user(user_id=d000361765b54df68267c40384cdd184)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:59.730362 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085541b5-1c99-4902-beb0-f8b1bf07ba47 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:25:59.731967 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 584/1158] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:25:59 2022] GET /identity/v3/users/d000361765b54df68267c40384cdd184 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:25:59.741095 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725e410-539f-4d50-8e8e-86d0403d042e None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:25:59.855074 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725e410-539f-4d50-8e8e-86d0403d042e None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:25:59.893529 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb2d95-12bd-4904-b0f3-56d3b8cdb17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:25:59.894212 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb2d95-12bd-4904-b0f3-56d3b8cdb17f None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:25:59.894487 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb2d95-12bd-4904-b0f3-56d3b8cdb17f None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:25:59.894754 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb2d95-12bd-4904-b0f3-56d3b8cdb17f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:25:59.916589 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:25:59.965549 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb2d95-12bd-4904-b0f3-56d3b8cdb17f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:25:59.966943 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb2d95-12bd-4904-b0f3-56d3b8cdb17f None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:26:00.074264 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 575/1159] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:25:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 17:26:00.081428 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085541b5-1c99-4902-beb0-f8b1bf07ba47 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:26:00.085968 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:26:00.192495 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085541b5-1c99-4902-beb0-f8b1bf07ba47 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:26:00.231949 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31687d12-96f6-4cc1-91f7-6da31de02b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:26:00.232744 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31687d12-96f6-4cc1-91f7-6da31de02b99 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:26:00.233024 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31687d12-96f6-4cc1-91f7-6da31de02b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:26:00.233300 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31687d12-96f6-4cc1-91f7-6da31de02b99 None admin] PATH_INFO: `/v3/projects/adecad6e980c47c995882888eea4f7ee` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:26:00.234635 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31687d12-96f6-4cc1-91f7-6da31de02b99 None admin] RBAC: Authorizing `identity:get_project(project_id=adecad6e980c47c995882888eea4f7ee)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:26:00.236063 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31687d12-96f6-4cc1-91f7-6da31de02b99 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:26:00.237802 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 585/1160] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:26:00 2022] GET /identity/v3/projects/adecad6e980c47c995882888eea4f7ee => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:26:00.246752 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb2d95-12bd-4904-b0f3-56d3b8cdb17f None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:26:00.303294 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:26:00.354968 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb2d95-12bd-4904-b0f3-56d3b8cdb17f None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:26:00.390324 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d4af8-a988-444e-98cd-8aa6f6c27759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:26:00.390963 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d4af8-a988-444e-98cd-8aa6f6c27759 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:26:00.391254 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d4af8-a988-444e-98cd-8aa6f6c27759 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:26:00.391524 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d4af8-a988-444e-98cd-8aa6f6c27759 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:26:00.392348 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d4af8-a988-444e-98cd-8aa6f6c27759 None admin] RBAC: Adding query filter params (role.id=70d242b29ede4648b639c7ddae5eaead, scope.project.id=adecad6e980c47c995882888eea4f7ee, user.id=d000361765b54df68267c40384cdd184) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:26:00.392658 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d4af8-a988-444e-98cd-8aa6f6c27759 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:26:00.394110 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d4af8-a988-444e-98cd-8aa6f6c27759 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:26:00.400001 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 576/1161] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jul 15 17:26:00 2022] GET /identity/v3/role_assignments?user.id=d000361765b54df68267c40384cdd184&scope.project.id=adecad6e980c47c995882888eea4f7ee&role.id=70d242b29ede4648b639c7ddae5eaead => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:26:02.393328 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782836dc-ba9a-419c-9291-dc58ffdf6aae None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:26:02.394282 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782836dc-ba9a-419c-9291-dc58ffdf6aae None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:26:02.394282 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782836dc-ba9a-419c-9291-dc58ffdf6aae None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:26:02.396501 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 586/1162] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:26:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:26:02.403012 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3caf1f5-f8f2-41ee-9b60-4d6bf7c50d45 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:26:02.403412 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3caf1f5-f8f2-41ee-9b60-4d6bf7c50d45 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:26:02.403609 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3caf1f5-f8f2-41ee-9b60-4d6bf7c50d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:26:02.430979 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-c3caf1f5-f8f2-41ee-9b60-4d6bf7c50d45 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:26:02.432656 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-c3caf1f5-f8f2-41ee-9b60-4d6bf7c50d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:26:02.508627 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 577/1163] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:26:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:26:02.530926 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782836dc-ba9a-419c-9291-dc58ffdf6aae None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:26:02.605300 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:26:02.646524 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782836dc-ba9a-419c-9291-dc58ffdf6aae None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:26:02.683391 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab80d2-818e-4bd9-992a-44ada97c9f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:26:02.684055 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab80d2-818e-4bd9-992a-44ada97c9f41 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:26:02.684331 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab80d2-818e-4bd9-992a-44ada97c9f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:26:02.684604 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab80d2-818e-4bd9-992a-44ada97c9f41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:26:02.757044 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab80d2-818e-4bd9-992a-44ada97c9f41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:26:02.758506 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab80d2-818e-4bd9-992a-44ada97c9f41 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:26:02.830741 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:26:02.862470 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 587/1164] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:26:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 17:26:02.868756 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3caf1f5-f8f2-41ee-9b60-4d6bf7c50d45 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:26:02.932222 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:26:02.995279 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3caf1f5-f8f2-41ee-9b60-4d6bf7c50d45 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:26:03.031385 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3103f6-e9b5-43ee-9313-b008b6992f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:26:03.032185 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3103f6-e9b5-43ee-9313-b008b6992f24 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:26:03.032454 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3103f6-e9b5-43ee-9313-b008b6992f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:26:03.032725 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3103f6-e9b5-43ee-9313-b008b6992f24 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:26:03.039952 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3103f6-e9b5-43ee-9313-b008b6992f24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:26:03.041397 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3103f6-e9b5-43ee-9313-b008b6992f24 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:26:03.055628 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-3e3103f6-e9b5-43ee-9313-b008b6992f24 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 15 17:26:03.055628 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:26:03.055628 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 15 17:26:03.055628 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 15 17:26:03.055628 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 17:26:03.055628 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 17:26:03.055628 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 17:26:03.055628 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 17:26:03.055628 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 15 17:26:03.055628 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:26:03.055628 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 17:26:03.055628 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:26:03.055628 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:26:03.055628 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:26:03.055628 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:26:03.055628 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:26:03.055628 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:26:03.056789 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:26:03.056789 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:26:03.056789 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:26:03.056789 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:26:03.056789 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:26:03.056789 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:26:03.056789 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:26:03.056789 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:26:03.056789 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:26:03.056789 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:26:03.056789 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:26:03.056789 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:26:03.056789 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:26:03.056789 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:26:03.056789 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:26:03.056789 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:26:03.058216 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:26:03.058216 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:26:03.058216 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:26:03.058216 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:26:03.058216 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:26:03.058216 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:26:03.058216 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:26:03.058216 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:26:03.058216 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:26:03.058216 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:26:03.058216 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 15 17:26:03.058216 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:26:03.058216 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 15 17:26:03.058216 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:26:03.058216 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 578/1165] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Jul 15 17:26:02 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:26:03.067723 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab80d2-818e-4bd9-992a-44ada97c9f41 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:26:03.170122 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab80d2-818e-4bd9-992a-44ada97c9f41 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:26:03.213899 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea471f-9474-4602-a6fc-0eba4acf2c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:26:03.214549 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea471f-9474-4602-a6fc-0eba4acf2c9c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:26:03.214831 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea471f-9474-4602-a6fc-0eba4acf2c9c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:26:03.215095 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea471f-9474-4602-a6fc-0eba4acf2c9c None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:26:03.215824 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea471f-9474-4602-a6fc-0eba4acf2c9c None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:26:03.216129 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea471f-9474-4602-a6fc-0eba4acf2c9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:26:03.217535 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea471f-9474-4602-a6fc-0eba4acf2c9c None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:26:03.225131 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 588/1166] 10.222.0.27 () {56 vars in 1115 bytes} [Fri Jul 15 17:26:03 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:26:05.183948 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf5707-3294-421a-b0b1-c76295282cf6 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:26:05.184881 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf5707-3294-421a-b0b1-c76295282cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:26:05.184881 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf5707-3294-421a-b0b1-c76295282cf6 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:26:05.187066 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 579/1167] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:26:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:26:05.193351 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ddc22-ad97-4df5-b571-5642e750027c None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:26:05.194142 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ddc22-ad97-4df5-b571-5642e750027c None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:26:05.194309 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ddc22-ad97-4df5-b571-5642e750027c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:26:05.215546 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-fb7ddc22-ad97-4df5-b571-5642e750027c None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:26:05.216741 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-fb7ddc22-ad97-4df5-b571-5642e750027c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:26:05.246190 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:26:05.290633 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 589/1168] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:26:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:26:05.322014 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf5707-3294-421a-b0b1-c76295282cf6 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:26:05.440994 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf5707-3294-421a-b0b1-c76295282cf6 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:26:05.448184 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:26:05.483829 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554da42-4176-4036-ae2f-1178213fd24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:26:05.484481 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554da42-4176-4036-ae2f-1178213fd24e None admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:26:05.484760 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554da42-4176-4036-ae2f-1178213fd24e None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:26:05.485024 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554da42-4176-4036-ae2f-1178213fd24e None admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:26:05.485761 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c554da42-4176-4036-ae2f-1178213fd24e None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:26:05.487143 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c554da42-4176-4036-ae2f-1178213fd24e None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:26:05.504640 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 580/1169] 10.222.0.27 () {60 vars in 1138 bytes} [Fri Jul 15 17:26:05 2022] POST /identity/v3/domains => generated 267 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:26:07.518807 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d25d4-e3e1-4a6d-a05d-0573daceb47a None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:26:07.519356 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d25d4-e3e1-4a6d-a05d-0573daceb47a None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:26:07.519356 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d25d4-e3e1-4a6d-a05d-0573daceb47a None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:26:07.520748 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 590/1170] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:26:07.527793 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94478d31-0265-48df-8f34-a86a3712472c None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:26:07.528232 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94478d31-0265-48df-8f34-a86a3712472c None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:26:07.528350 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94478d31-0265-48df-8f34-a86a3712472c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:26:07.549691 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-94478d31-0265-48df-8f34-a86a3712472c None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:26:07.550910 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-94478d31-0265-48df-8f34-a86a3712472c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:26:07.621884 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 581/1171] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:26:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:26:07.645587 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d25d4-e3e1-4a6d-a05d-0573daceb47a None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:26:07.753956 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d25d4-e3e1-4a6d-a05d-0573daceb47a None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:26:07.788874 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eaf992-49ad-4d6c-8030-80a5ea1cf83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:26:07.789721 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eaf992-49ad-4d6c-8030-80a5ea1cf83b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:26:07.790029 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eaf992-49ad-4d6c-8030-80a5ea1cf83b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:26:07.790300 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eaf992-49ad-4d6c-8030-80a5ea1cf83b None admin] PATH_INFO: `/v3/domains/3d9774631baa4c9bbc04cff9d6fd8bc8` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:26:07.801656 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eaf992-49ad-4d6c-8030-80a5ea1cf83b None admin] RBAC: Authorizing `identity:get_domain(domain_id=3d9774631baa4c9bbc04cff9d6fd8bc8)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:26:07.803155 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eaf992-49ad-4d6c-8030-80a5ea1cf83b None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:26:07.804794 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 591/1172] 10.222.0.27 () {56 vars in 1183 bytes} [Fri Jul 15 17:26:07 2022] GET /identity/v3/domains/3d9774631baa4c9bbc04cff9d6fd8bc8 => generated 267 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:26:07.811891 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94478d31-0265-48df-8f34-a86a3712472c None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:26:07.924936 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:26:07.934123 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94478d31-0265-48df-8f34-a86a3712472c None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:26:07.969573 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2973d530-6978-480f-8f7b-f9993895b4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:26:07.970254 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973d530-6978-480f-8f7b-f9993895b4f1 None admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:26:07.970571 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973d530-6978-480f-8f7b-f9993895b4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:26:07.970845 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973d530-6978-480f-8f7b-f9993895b4f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:26:07.971596 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2973d530-6978-480f-8f7b-f9993895b4f1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:26:07.973017 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2973d530-6978-480f-8f7b-f9993895b4f1 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:26:08.000467 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 582/1173] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Jul 15 17:26:07 2022] POST /identity/v3/projects => generated 361 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:26:10.014001 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e4a34-3afa-49ef-8412-199f2285b5a7 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:26:10.014857 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e4a34-3afa-49ef-8412-199f2285b5a7 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:26:10.014857 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e4a34-3afa-49ef-8412-199f2285b5a7 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:26:10.017046 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 592/1174] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:26:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:26:10.025976 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb465956-5075-420d-ad33-4428c7ad5ca9 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:26:10.026401 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb465956-5075-420d-ad33-4428c7ad5ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:26:10.026491 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb465956-5075-420d-ad33-4428c7ad5ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:26:10.046098 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-cb465956-5075-420d-ad33-4428c7ad5ca9 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:26:10.047303 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-cb465956-5075-420d-ad33-4428c7ad5ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:26:10.122672 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 583/1175] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:26:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:26:10.158474 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e4a34-3afa-49ef-8412-199f2285b5a7 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:26:10.188987 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:26:10.272148 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e4a34-3afa-49ef-8412-199f2285b5a7 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:26:10.307211 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7884ddf-6baa-4abf-a09b-5f1ef3fda581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:26:10.308074 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7884ddf-6baa-4abf-a09b-5f1ef3fda581 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:26:10.308380 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7884ddf-6baa-4abf-a09b-5f1ef3fda581 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:26:10.308666 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7884ddf-6baa-4abf-a09b-5f1ef3fda581 None admin] PATH_INFO: `/v3/domains/3d9774631baa4c9bbc04cff9d6fd8bc8` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:26:10.309922 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7884ddf-6baa-4abf-a09b-5f1ef3fda581 None admin] RBAC: Authorizing `identity:get_domain(domain_id=3d9774631baa4c9bbc04cff9d6fd8bc8)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:26:10.311360 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7884ddf-6baa-4abf-a09b-5f1ef3fda581 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:26:10.313147 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 593/1176] 10.222.0.27 () {56 vars in 1183 bytes} [Fri Jul 15 17:26:10 2022] GET /identity/v3/domains/3d9774631baa4c9bbc04cff9d6fd8bc8 => generated 267 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:26:10.319105 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb465956-5075-420d-ad33-4428c7ad5ca9 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:26:10.407415 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:26:10.431515 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb465956-5075-420d-ad33-4428c7ad5ca9 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:26:10.475703 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361511cf-650e-4894-851c-468e07298420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:26:10.476369 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361511cf-650e-4894-851c-468e07298420 None admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:26:10.476643 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361511cf-650e-4894-851c-468e07298420 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:26:10.476919 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361511cf-650e-4894-851c-468e07298420 None admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:26:10.477619 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361511cf-650e-4894-851c-468e07298420 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:26:10.479168 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361511cf-650e-4894-851c-468e07298420 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:26:10.506480 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 584/1177] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Jul 15 17:26:10 2022] POST /identity/v3/users => generated 311 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:26:12.531788 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a1c51-7860-49d9-a5ed-7882684bb43e None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:26:12.532371 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a1c51-7860-49d9-a5ed-7882684bb43e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:26:12.532371 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a1c51-7860-49d9-a5ed-7882684bb43e None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:26:12.533733 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 594/1178] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:26:12.540009 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411873cc-34d0-4a13-a734-a1ba9a345d92 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:26:12.540701 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411873cc-34d0-4a13-a734-a1ba9a345d92 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:26:12.540885 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411873cc-34d0-4a13-a734-a1ba9a345d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:26:12.565120 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-411873cc-34d0-4a13-a734-a1ba9a345d92 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:26:12.566260 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-411873cc-34d0-4a13-a734-a1ba9a345d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:26:12.640571 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 585/1179] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:26:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:26:12.674117 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a1c51-7860-49d9-a5ed-7882684bb43e None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:26:12.771142 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:26:12.782482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a1c51-7860-49d9-a5ed-7882684bb43e None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:26:12.819263 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ff9ae-8389-4b37-8e52-cd0ccba95ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:26:12.819979 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ff9ae-8389-4b37-8e52-cd0ccba95ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:26:12.820258 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ff9ae-8389-4b37-8e52-cd0ccba95ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:26:12.820532 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ff9ae-8389-4b37-8e52-cd0ccba95ea7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:26:12.831591 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56ff9ae-8389-4b37-8e52-cd0ccba95ea7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:26:12.839296 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-e56ff9ae-8389-4b37-8e52-cd0ccba95ea7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:26:12.839296 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:26:12.839296 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:26:12.839296 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:26:12.839296 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:26:12.839296 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:26:12.839296 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:26:12.839296 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:26:12.839296 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:26:12.839296 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:26:12.839296 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:26:12.839296 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:26:12.839296 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:26:12.839296 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:26:12.839296 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:26:12.839296 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:26:12.840357 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:26:12.840357 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:26:12.840357 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:26:12.840357 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:26:12.840357 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:26:12.840357 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:26:12.840357 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:26:12.840357 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:26:12.840357 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:26:12.840357 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:26:12.840357 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:26:12.840357 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:26:12.840357 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:26:12.840357 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:26:12.840357 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:26:12.840357 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:26:12.841519 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:26:12.841519 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:26:12.841519 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:26:12.841519 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:26:12.841519 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:26:12.841519 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:26:12.841519 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:26:12.841519 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:26:12.841519 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:26:12.841519 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:26:12.841519 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:26:12.841519 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:26:12.841519 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 595/1180] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jul 15 17:26:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:26:12.847379 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411873cc-34d0-4a13-a734-a1ba9a345d92 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:26:12.916647 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:26:12.958102 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411873cc-34d0-4a13-a734-a1ba9a345d92 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:26:12.992942 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954ca8e-a96a-4d1c-b960-cbd1a963a319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:26:12.993582 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954ca8e-a96a-4d1c-b960-cbd1a963a319 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:26:12.993915 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954ca8e-a96a-4d1c-b960-cbd1a963a319 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:26:12.994261 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954ca8e-a96a-4d1c-b960-cbd1a963a319 None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:26:12.995132 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954ca8e-a96a-4d1c-b960-cbd1a963a319 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:26:12.995432 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954ca8e-a96a-4d1c-b960-cbd1a963a319 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:26:12.996791 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954ca8e-a96a-4d1c-b960-cbd1a963a319 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:26:13.004875 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 586/1181] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:26:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:26:13.014725 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ff9ae-8389-4b37-8e52-cd0ccba95ea7 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:26:13.130514 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ff9ae-8389-4b37-8e52-cd0ccba95ea7 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:26:13.164760 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4b573-85a2-4b24-8588-744d355ff50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:26:13.165630 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4b573-85a2-4b24-8588-744d355ff50c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:26:13.165941 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4b573-85a2-4b24-8588-744d355ff50c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:26:13.166241 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4b573-85a2-4b24-8588-744d355ff50c None admin] PATH_INFO: `/v3/users/9ac591ff0706485f9069de50510d766d` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:26:13.179532 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4b573-85a2-4b24-8588-744d355ff50c None admin] RBAC: Authorizing `identity:get_user(user_id=9ac591ff0706485f9069de50510d766d)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:26:13.180966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4b573-85a2-4b24-8588-744d355ff50c None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:26:13.182725 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 596/1182] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:26:13 2022] GET /identity/v3/users/9ac591ff0706485f9069de50510d766d => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:26:13.189943 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954ca8e-a96a-4d1c-b960-cbd1a963a319 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:26:13.307187 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954ca8e-a96a-4d1c-b960-cbd1a963a319 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:26:13.333988 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:26:13.343292 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7275896-e790-4133-b206-c451a569072d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:26:13.343948 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7275896-e790-4133-b206-c451a569072d None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:26:13.344226 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7275896-e790-4133-b206-c451a569072d None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:26:13.344496 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7275896-e790-4133-b206-c451a569072d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:26:13.411922 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7275896-e790-4133-b206-c451a569072d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:26:13.413293 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7275896-e790-4133-b206-c451a569072d None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:26:13.512709 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 587/1183] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:26:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 17:26:13.522234 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4b573-85a2-4b24-8588-744d355ff50c None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:26:13.545592 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:26:13.654218 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4b573-85a2-4b24-8588-744d355ff50c None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:26:13.689724 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e46aec-d3d8-47ce-8efc-0d5cc8d3225e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:26:13.690540 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e46aec-d3d8-47ce-8efc-0d5cc8d3225e None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:26:13.690811 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e46aec-d3d8-47ce-8efc-0d5cc8d3225e None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:26:13.691081 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e46aec-d3d8-47ce-8efc-0d5cc8d3225e None admin] PATH_INFO: `/v3/projects/e6d5f96535144e058f91dc1ae5a7e1d6` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:26:13.692374 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e46aec-d3d8-47ce-8efc-0d5cc8d3225e None admin] RBAC: Authorizing `identity:get_project(project_id=e6d5f96535144e058f91dc1ae5a7e1d6)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:26:13.693811 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e46aec-d3d8-47ce-8efc-0d5cc8d3225e None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:26:13.695531 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 597/1184] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:26:13 2022] GET /identity/v3/projects/e6d5f96535144e058f91dc1ae5a7e1d6 => generated 361 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:26:13.702751 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7275896-e790-4133-b206-c451a569072d None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:26:13.736785 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:26:13.815017 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7275896-e790-4133-b206-c451a569072d None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:26:13.853464 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41878eb7-7bd3-4f1f-ae18-644e6fcc8b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:26:13.854675 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41878eb7-7bd3-4f1f-ae18-644e6fcc8b0e None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:26:13.854957 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41878eb7-7bd3-4f1f-ae18-644e6fcc8b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:26:13.855231 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41878eb7-7bd3-4f1f-ae18-644e6fcc8b0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:26:13.856055 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41878eb7-7bd3-4f1f-ae18-644e6fcc8b0e None admin] RBAC: Adding query filter params (role.id=70d242b29ede4648b639c7ddae5eaead, scope.project.id=e6d5f96535144e058f91dc1ae5a7e1d6, user.id=9ac591ff0706485f9069de50510d766d) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:26:13.856367 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41878eb7-7bd3-4f1f-ae18-644e6fcc8b0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:26:13.857819 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41878eb7-7bd3-4f1f-ae18-644e6fcc8b0e None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:26:13.863939 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 588/1185] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jul 15 17:26:13 2022] GET /identity/v3/role_assignments?user.id=9ac591ff0706485f9069de50510d766d&scope.project.id=e6d5f96535144e058f91dc1ae5a7e1d6&role.id=70d242b29ede4648b639c7ddae5eaead => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:26:15.801830 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4288480-09dd-4de1-8e7f-b1e6c59402a4 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:26:15.802701 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4288480-09dd-4de1-8e7f-b1e6c59402a4 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:26:15.802701 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4288480-09dd-4de1-8e7f-b1e6c59402a4 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:26:15.804952 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 598/1186] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:26:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:26:15.811369 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ff365-5bfc-4183-9f1e-bf4ad1597037 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:26:15.811812 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ff365-5bfc-4183-9f1e-bf4ad1597037 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:26:15.811930 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ff365-5bfc-4183-9f1e-bf4ad1597037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:26:15.834051 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-d33ff365-5bfc-4183-9f1e-bf4ad1597037 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:26:15.835229 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-d33ff365-5bfc-4183-9f1e-bf4ad1597037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:26:15.905045 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 589/1187] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:26:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:26:15.931690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4288480-09dd-4de1-8e7f-b1e6c59402a4 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:26:16.016267 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:26:16.040575 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4288480-09dd-4de1-8e7f-b1e6c59402a4 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:26:16.082911 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee138de2-9a45-47ef-ade3-ed4417ecc434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:26:16.083983 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee138de2-9a45-47ef-ade3-ed4417ecc434 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:26:16.084422 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee138de2-9a45-47ef-ade3-ed4417ecc434 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:26:16.084852 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee138de2-9a45-47ef-ade3-ed4417ecc434 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:26:16.097000 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee138de2-9a45-47ef-ade3-ed4417ecc434 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:26:16.105169 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-ee138de2-9a45-47ef-ade3-ed4417ecc434 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:26:16.105169 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:26:16.105169 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:26:16.105169 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:26:16.105169 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:26:16.105169 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:26:16.105169 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:26:16.105169 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:26:16.105169 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:26:16.105169 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:26:16.105169 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:26:16.105169 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:26:16.105169 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:26:16.105169 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:26:16.105169 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:26:16.105169 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:26:16.106359 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:26:16.106359 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:26:16.106359 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:26:16.106359 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:26:16.106359 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:26:16.106359 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:26:16.106359 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:26:16.106359 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:26:16.106359 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:26:16.106359 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:26:16.106359 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:26:16.106359 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:26:16.106359 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:26:16.106359 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:26:16.106359 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:26:16.106359 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:26:16.107290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:26:16.107290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:26:16.107290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:26:16.107290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:26:16.107290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:26:16.107290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:26:16.107290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:26:16.107290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:26:16.107290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:26:16.107290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:26:16.107290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:26:16.107290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:26:16.107290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 599/1188] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jul 15 17:26:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:26:16.112679 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ff365-5bfc-4183-9f1e-bf4ad1597037 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:26:16.139233 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:26:16.228278 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ff365-5bfc-4183-9f1e-bf4ad1597037 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:26:16.264433 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78014172-c2cb-449f-9c26-8a800834477f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:26:16.265094 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78014172-c2cb-449f-9c26-8a800834477f None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:26:16.265374 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78014172-c2cb-449f-9c26-8a800834477f None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:26:16.265643 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78014172-c2cb-449f-9c26-8a800834477f None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:26:16.266417 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78014172-c2cb-449f-9c26-8a800834477f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:26:16.266727 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78014172-c2cb-449f-9c26-8a800834477f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:26:16.268098 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78014172-c2cb-449f-9c26-8a800834477f None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:26:16.276427 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 590/1189] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:26:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:26:16.285288 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee138de2-9a45-47ef-ade3-ed4417ecc434 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:26:16.397040 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee138de2-9a45-47ef-ade3-ed4417ecc434 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:26:16.439165 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bc69d-4bec-4df2-af38-3366005751ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:26:16.440053 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bc69d-4bec-4df2-af38-3366005751ec None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:26:16.440337 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bc69d-4bec-4df2-af38-3366005751ec None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:26:16.440611 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bc69d-4bec-4df2-af38-3366005751ec None admin] PATH_INFO: `/v3/users/9ac591ff0706485f9069de50510d766d` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:26:16.441973 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497bc69d-4bec-4df2-af38-3366005751ec None admin] RBAC: Authorizing `identity:get_user(user_id=9ac591ff0706485f9069de50510d766d)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:26:16.443399 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497bc69d-4bec-4df2-af38-3366005751ec None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:26:16.445027 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 600/1190] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:26:16 2022] GET /identity/v3/users/9ac591ff0706485f9069de50510d766d => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:26:16.451904 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78014172-c2cb-449f-9c26-8a800834477f None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:26:16.548309 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:26:16.570398 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78014172-c2cb-449f-9c26-8a800834477f None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:26:16.606261 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b953fcd-050b-4dce-8849-690bee69b4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:26:16.607122 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b953fcd-050b-4dce-8849-690bee69b4d1 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:26:16.607402 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b953fcd-050b-4dce-8849-690bee69b4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:26:16.607680 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b953fcd-050b-4dce-8849-690bee69b4d1 None admin] PATH_INFO: `/v3/projects/e6d5f96535144e058f91dc1ae5a7e1d6` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:26:16.608904 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b953fcd-050b-4dce-8849-690bee69b4d1 None admin] RBAC: Authorizing `identity:get_project(project_id=e6d5f96535144e058f91dc1ae5a7e1d6)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:26:16.610359 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b953fcd-050b-4dce-8849-690bee69b4d1 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:26:16.612082 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 591/1191] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:26:16 2022] GET /identity/v3/projects/e6d5f96535144e058f91dc1ae5a7e1d6 => generated 361 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:26:16.618981 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bc69d-4bec-4df2-af38-3366005751ec None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:26:16.634565 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:26:16.739058 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bc69d-4bec-4df2-af38-3366005751ec None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:26:16.774695 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab799f2-6089-4d03-8cb6-9216b27938e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:26:16.775803 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab799f2-6089-4d03-8cb6-9216b27938e3 None admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:26:16.776082 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab799f2-6089-4d03-8cb6-9216b27938e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:26:16.776358 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab799f2-6089-4d03-8cb6-9216b27938e3 None admin] PATH_INFO: `/v3/projects/e6d5f96535144e058f91dc1ae5a7e1d6/users/9ac591ff0706485f9069de50510d766d/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:26:16.778610 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab799f2-6089-4d03-8cb6-9216b27938e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=e6d5f96535144e058f91dc1ae5a7e1d6, user_id=9ac591ff0706485f9069de50510d766d, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:26:16.780029 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab799f2-6089-4d03-8cb6-9216b27938e3 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:26:16.795296 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 601/1192] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Jul 15 17:26:16 2022] PUT /identity/v3/projects/e6d5f96535144e058f91dc1ae5a7e1d6/users/9ac591ff0706485f9069de50510d766d/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:26:18.757745 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bec95f-5856-4bcd-a009-ed2def738189 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:26:18.758625 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bec95f-5856-4bcd-a009-ed2def738189 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:26:18.758777 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bec95f-5856-4bcd-a009-ed2def738189 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:26:18.761752 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 592/1193] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:26:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:26:18.767985 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524afe45-b48d-43f6-99b1-01a9f3c185d8 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:26:18.768694 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524afe45-b48d-43f6-99b1-01a9f3c185d8 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:26:18.768838 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524afe45-b48d-43f6-99b1-01a9f3c185d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:26:18.794634 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-524afe45-b48d-43f6-99b1-01a9f3c185d8 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:26:18.795815 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-524afe45-b48d-43f6-99b1-01a9f3c185d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:26:18.861317 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:26:18.875163 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 602/1194] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:26:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:26:18.902216 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bec95f-5856-4bcd-a009-ed2def738189 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:26:19.002521 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bec95f-5856-4bcd-a009-ed2def738189 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:26:19.037418 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e2681-6a54-4db9-8e00-6e4799e01f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:26:19.038231 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e2681-6a54-4db9-8e00-6e4799e01f4c None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:26:19.038508 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e2681-6a54-4db9-8e00-6e4799e01f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:26:19.038777 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e2681-6a54-4db9-8e00-6e4799e01f4c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:26:19.049910 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600e2681-6a54-4db9-8e00-6e4799e01f4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:26:19.057557 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-600e2681-6a54-4db9-8e00-6e4799e01f4c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:26:19.057557 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:26:19.057557 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:26:19.057557 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:26:19.057557 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:26:19.057557 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:26:19.057557 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:26:19.057557 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:26:19.057557 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:26:19.057557 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:26:19.057557 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:26:19.057557 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:26:19.057557 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:26:19.057557 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:26:19.057557 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:26:19.057557 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:26:19.058630 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:26:19.058630 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:26:19.058630 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:26:19.058630 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:26:19.058630 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:26:19.058630 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:26:19.058630 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:26:19.058630 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:26:19.058630 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:26:19.058630 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:26:19.058630 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:26:19.058630 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:26:19.058630 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:26:19.058630 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:26:19.058630 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:26:19.058630 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:26:19.059632 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:26:19.059632 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:26:19.059632 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:26:19.059632 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:26:19.059632 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:26:19.059632 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:26:19.059632 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:26:19.059632 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:26:19.059632 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:26:19.059632 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:26:19.059632 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:26:19.059632 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:26:19.059632 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 593/1195] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jul 15 17:26:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:26:19.067204 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524afe45-b48d-43f6-99b1-01a9f3c185d8 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:26:19.182280 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524afe45-b48d-43f6-99b1-01a9f3c185d8 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:26:19.225449 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253c29b-fbb3-4204-8abd-5eb20939ad01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:26:19.226154 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253c29b-fbb3-4204-8abd-5eb20939ad01 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:26:19.226441 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253c29b-fbb3-4204-8abd-5eb20939ad01 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:26:19.226718 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253c29b-fbb3-4204-8abd-5eb20939ad01 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:26:19.227473 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253c29b-fbb3-4204-8abd-5eb20939ad01 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:26:19.227780 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253c29b-fbb3-4204-8abd-5eb20939ad01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:26:19.229151 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253c29b-fbb3-4204-8abd-5eb20939ad01 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:26:19.237395 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 603/1196] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:26:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:26:19.243493 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e2681-6a54-4db9-8e00-6e4799e01f4c None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:26:19.257612 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:26:19.355940 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e2681-6a54-4db9-8e00-6e4799e01f4c None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:26:19.393426 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651cf9f4-4c82-46f0-ba0d-94838f72b932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:26:19.394342 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cf9f4-4c82-46f0-ba0d-94838f72b932 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:26:19.394627 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cf9f4-4c82-46f0-ba0d-94838f72b932 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:26:19.394898 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cf9f4-4c82-46f0-ba0d-94838f72b932 None admin] PATH_INFO: `/v3/users/9ac591ff0706485f9069de50510d766d` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:26:19.396149 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651cf9f4-4c82-46f0-ba0d-94838f72b932 None admin] RBAC: Authorizing `identity:get_user(user_id=9ac591ff0706485f9069de50510d766d)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:26:19.397601 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651cf9f4-4c82-46f0-ba0d-94838f72b932 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:26:19.399319 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 594/1197] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Jul 15 17:26:19 2022] GET /identity/v3/users/9ac591ff0706485f9069de50510d766d => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:26:19.405799 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253c29b-fbb3-4204-8abd-5eb20939ad01 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:26:19.467170 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:26:19.510531 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253c29b-fbb3-4204-8abd-5eb20939ad01 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:26:19.545754 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1043e8e-2b31-400d-9556-657c8e7cf5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:26:19.546419 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1043e8e-2b31-400d-9556-657c8e7cf5d2 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:26:19.546693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1043e8e-2b31-400d-9556-657c8e7cf5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:26:19.546970 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1043e8e-2b31-400d-9556-657c8e7cf5d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:26:19.616526 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1043e8e-2b31-400d-9556-657c8e7cf5d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:26:19.617921 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1043e8e-2b31-400d-9556-657c8e7cf5d2 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:26:19.676041 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:26:19.719436 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 604/1198] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:26:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 17:26:19.728284 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651cf9f4-4c82-46f0-ba0d-94838f72b932 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:26:19.813803 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:26:19.836382 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651cf9f4-4c82-46f0-ba0d-94838f72b932 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:26:19.870565 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f932aae-c9a2-4c13-a852-c1088829ee9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:26:19.871360 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f932aae-c9a2-4c13-a852-c1088829ee9f None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:26:19.871637 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f932aae-c9a2-4c13-a852-c1088829ee9f None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:26:19.871905 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f932aae-c9a2-4c13-a852-c1088829ee9f None admin] PATH_INFO: `/v3/projects/e6d5f96535144e058f91dc1ae5a7e1d6` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:26:19.873201 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f932aae-c9a2-4c13-a852-c1088829ee9f None admin] RBAC: Authorizing `identity:get_project(project_id=e6d5f96535144e058f91dc1ae5a7e1d6)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:26:19.874666 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f932aae-c9a2-4c13-a852-c1088829ee9f None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:26:19.876382 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 595/1199] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Jul 15 17:26:19 2022] GET /identity/v3/projects/e6d5f96535144e058f91dc1ae5a7e1d6 => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:26:19.883132 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1043e8e-2b31-400d-9556-657c8e7cf5d2 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:26:19.991441 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1043e8e-2b31-400d-9556-657c8e7cf5d2 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:26:20.026264 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80faab61-968b-4f25-83c1-cb14d6cd19de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:26:20.026898 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80faab61-968b-4f25-83c1-cb14d6cd19de None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:26:20.027179 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80faab61-968b-4f25-83c1-cb14d6cd19de None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:26:20.027451 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80faab61-968b-4f25-83c1-cb14d6cd19de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:26:20.028245 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80faab61-968b-4f25-83c1-cb14d6cd19de None admin] RBAC: Adding query filter params (role.id=70d242b29ede4648b639c7ddae5eaead, scope.project.id=e6d5f96535144e058f91dc1ae5a7e1d6, user.id=9ac591ff0706485f9069de50510d766d) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:26:20.028551 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80faab61-968b-4f25-83c1-cb14d6cd19de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:26:20.029995 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80faab61-968b-4f25-83c1-cb14d6cd19de None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:26:20.035900 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 605/1200] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jul 15 17:26:19 2022] GET /identity/v3/role_assignments?user.id=9ac591ff0706485f9069de50510d766d&scope.project.id=e6d5f96535144e058f91dc1ae5a7e1d6&role.id=70d242b29ede4648b639c7ddae5eaead => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:26:29.866134 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=27 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:26:30.033137 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:15.167895 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aefe1d-a01b-4295-889b-e2daa14d1a79 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:15.167895 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aefe1d-a01b-4295-889b-e2daa14d1a79 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:15.167895 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aefe1d-a01b-4295-889b-e2daa14d1a79 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:15.167895 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 596/1201] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:27:15.172510 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d812c-ad4e-4c19-8038-dc77353c5e39 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:15.172993 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d812c-ad4e-4c19-8038-dc77353c5e39 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:15.173187 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d812c-ad4e-4c19-8038-dc77353c5e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:15.196304 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-540d812c-ad4e-4c19-8038-dc77353c5e39 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:27:15.197659 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-540d812c-ad4e-4c19-8038-dc77353c5e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:27:15.289814 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 606/1202] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:27:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:27:15.312475 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aefe1d-a01b-4295-889b-e2daa14d1a79 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:15.438868 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aefe1d-a01b-4295-889b-e2daa14d1a79 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:15.482567 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b5ffa-61e4-4e1d-b0e6-0e85dbd6acf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:15.483407 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b5ffa-61e4-4e1d-b0e6-0e85dbd6acf4 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:15.483686 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b5ffa-61e4-4e1d-b0e6-0e85dbd6acf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:15.483957 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b5ffa-61e4-4e1d-b0e6-0e85dbd6acf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:15.499398 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186b5ffa-61e4-4e1d-b0e6-0e85dbd6acf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:15.501089 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186b5ffa-61e4-4e1d-b0e6-0e85dbd6acf4 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:15.523545 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-186b5ffa-61e4-4e1d-b0e6-0e85dbd6acf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:27:15.523545 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:27:15.523545 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:27:15.523545 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:27:15.523545 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:27:15.523545 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:27:15.523545 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:27:15.523545 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:27:15.523545 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:27:15.523545 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:27:15.523545 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:27:15.523545 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:27:15.523545 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:27:15.523545 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:27:15.523545 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:27:15.524843 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:27:15.524843 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:27:15.524843 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:27:15.524843 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:27:15.524843 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:27:15.524843 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:27:15.524843 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:27:15.524843 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:27:15.524843 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:27:15.524843 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:27:15.524843 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:27:15.524843 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:27:15.524843 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:27:15.524843 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:27:15.524843 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:27:15.524843 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:27:15.524843 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:27:15.525867 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:27:15.525867 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:27:15.525867 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:27:15.525867 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:27:15.527366 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 597/1203] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:27:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:27:15.533478 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d812c-ad4e-4c19-8038-dc77353c5e39 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:15.665416 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d812c-ad4e-4c19-8038-dc77353c5e39 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:15.703020 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:15.712129 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a039ab3a-1772-4156-ad92-cb1a1b20bf19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:15.713236 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039ab3a-1772-4156-ad92-cb1a1b20bf19 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:15.713672 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039ab3a-1772-4156-ad92-cb1a1b20bf19 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:15.714120 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039ab3a-1772-4156-ad92-cb1a1b20bf19 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:15.715011 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a039ab3a-1772-4156-ad92-cb1a1b20bf19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:27:15.715476 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a039ab3a-1772-4156-ad92-cb1a1b20bf19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:15.717247 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a039ab3a-1772-4156-ad92-cb1a1b20bf19 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:15.735318 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 607/1204] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:27:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:27:15.741193 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b5ffa-61e4-4e1d-b0e6-0e85dbd6acf4 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:15.811912 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:15.869865 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b5ffa-61e4-4e1d-b0e6-0e85dbd6acf4 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:15.910889 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e3916-be9b-4192-b41a-0649fb295aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:15.911566 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e3916-be9b-4192-b41a-0649fb295aec None admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:15.911857 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e3916-be9b-4192-b41a-0649fb295aec None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:15.912125 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e3916-be9b-4192-b41a-0649fb295aec None admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:15.912829 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291e3916-be9b-4192-b41a-0649fb295aec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:15.914279 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291e3916-be9b-4192-b41a-0649fb295aec None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:15.949926 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 598/1205] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Jul 15 17:27:15 2022] POST /identity/v3/users => generated 251 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:27:18.180397 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdca1fb-74ed-4137-8175-e9409e36aaf1 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:18.181114 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdca1fb-74ed-4137-8175-e9409e36aaf1 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:18.181114 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdca1fb-74ed-4137-8175-e9409e36aaf1 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:18.182419 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 608/1206] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:27:18.188228 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbb519-e8e7-4d33-9a92-b7ad6da94cc7 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:18.188768 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbb519-e8e7-4d33-9a92-b7ad6da94cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:18.188925 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbb519-e8e7-4d33-9a92-b7ad6da94cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:18.213828 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-7bfbb519-e8e7-4d33-9a92-b7ad6da94cc7 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:27:18.215166 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-7bfbb519-e8e7-4d33-9a92-b7ad6da94cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:27:18.301821 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 599/1207] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:27:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 17:27:18.330708 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdca1fb-74ed-4137-8175-e9409e36aaf1 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:18.445702 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdca1fb-74ed-4137-8175-e9409e36aaf1 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:18.486276 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf88e3e-9539-4a88-aaa7-8534b96e53bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:18.487241 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf88e3e-9539-4a88-aaa7-8534b96e53bd None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:18.487518 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf88e3e-9539-4a88-aaa7-8534b96e53bd None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:18.487814 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf88e3e-9539-4a88-aaa7-8534b96e53bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:18.499543 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf88e3e-9539-4a88-aaa7-8534b96e53bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:27:18.508040 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-2cf88e3e-9539-4a88-aaa7-8534b96e53bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 17:27:18.508040 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:27:18.508040 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:27:18.508040 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:27:18.508040 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:27:18.508040 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:27:18.508040 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:27:18.508040 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:27:18.508040 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:27:18.508040 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:27:18.508040 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:27:18.508040 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:27:18.508040 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:27:18.508040 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:27:18.508040 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:27:18.508040 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:27:18.509394 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:27:18.509394 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:27:18.509394 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:27:18.509394 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:27:18.509394 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:27:18.509394 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:27:18.509394 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:27:18.509394 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:27:18.509394 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:27:18.509394 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:27:18.509394 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:27:18.509394 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:27:18.509394 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:27:18.509394 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:27:18.509394 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:27:18.509394 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:27:18.510353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:27:18.510353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:27:18.510353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:27:18.510353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:27:18.510353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:27:18.510353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:27:18.510353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:27:18.510353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:27:18.510353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:27:18.510353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:27:18.510353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 17:27:18.510353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:27:18.510353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 609/1208] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Jul 15 17:27:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:27:18.515988 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfbb519-e8e7-4d33-9a92-b7ad6da94cc7 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:18.563372 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:18.634665 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfbb519-e8e7-4d33-9a92-b7ad6da94cc7 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:18.681794 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53647559-cc36-4b93-98c1-757238193d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:18.682538 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53647559-cc36-4b93-98c1-757238193d33 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:18.682871 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53647559-cc36-4b93-98c1-757238193d33 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:18.683124 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53647559-cc36-4b93-98c1-757238193d33 None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:18.683888 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53647559-cc36-4b93-98c1-757238193d33 None admin] RBAC: Adding query filter params (name=service) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:27:18.684208 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53647559-cc36-4b93-98c1-757238193d33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:18.685662 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53647559-cc36-4b93-98c1-757238193d33 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:18.695480 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 600/1209] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Jul 15 17:27:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:27:18.703219 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf88e3e-9539-4a88-aaa7-8534b96e53bd None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:18.768267 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:18.826354 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf88e3e-9539-4a88-aaa7-8534b96e53bd None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:18.870188 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b91640-1728-47a7-b853-9f99a4c7d2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:18.873299 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b91640-1728-47a7-b853-9f99a4c7d2fe None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:18.873299 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b91640-1728-47a7-b853-9f99a4c7d2fe None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:18.873299 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b91640-1728-47a7-b853-9f99a4c7d2fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:18.883771 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b91640-1728-47a7-b853-9f99a4c7d2fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:18.885249 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b91640-1728-47a7-b853-9f99a4c7d2fe None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:18.905383 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-69b91640-1728-47a7-b853-9f99a4c7d2fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:27:18.905383 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:27:18.905383 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:27:18.905383 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:27:18.905383 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:27:18.905383 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:27:18.905383 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:27:18.905383 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:27:18.905383 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:27:18.905383 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:27:18.905383 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:27:18.905383 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:27:18.905383 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:27:18.905383 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:27:18.905383 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:27:18.906633 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:27:18.906633 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:27:18.906633 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:27:18.906633 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:27:18.906633 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:27:18.906633 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:27:18.906633 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:27:18.906633 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:27:18.906633 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:27:18.906633 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:27:18.906633 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:27:18.906633 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:27:18.906633 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:27:18.906633 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:27:18.906633 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:27:18.906633 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:27:18.906633 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:27:18.912170 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:27:18.912170 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:27:18.912170 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:27:18.912170 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:27:18.912170 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 610/1210] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:27:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:27:18.912459 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53647559-cc36-4b93-98c1-757238193d33 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:19.022513 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:19.025461 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53647559-cc36-4b93-98c1-757238193d33 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:19.068187 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74abb6f9-4f5a-45a2-8685-cc1280ef3c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:19.068894 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abb6f9-4f5a-45a2-8685-cc1280ef3c92 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:19.069170 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abb6f9-4f5a-45a2-8685-cc1280ef3c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:19.069439 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abb6f9-4f5a-45a2-8685-cc1280ef3c92 None admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:19.070411 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74abb6f9-4f5a-45a2-8685-cc1280ef3c92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:27:19.070800 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74abb6f9-4f5a-45a2-8685-cc1280ef3c92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:19.072651 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74abb6f9-4f5a-45a2-8685-cc1280ef3c92 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:19.091633 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 601/1211] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:27:19.093467 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b91640-1728-47a7-b853-9f99a4c7d2fe None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:19.218315 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b91640-1728-47a7-b853-9f99a4c7d2fe None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:19.223399 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:19.258778 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7b06e-82be-4c36-9b7c-68c14f826dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:19.260074 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7b06e-82be-4c36-9b7c-68c14f826dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:19.260074 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7b06e-82be-4c36-9b7c-68c14f826dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:19.260074 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7b06e-82be-4c36-9b7c-68c14f826dc1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:19.267944 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a7b06e-82be-4c36-9b7c-68c14f826dc1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:19.269496 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a7b06e-82be-4c36-9b7c-68c14f826dc1 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:19.284882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-e2a7b06e-82be-4c36-9b7c-68c14f826dc1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 17:27:19.284882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:27:19.284882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:27:19.284882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:27:19.284882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:27:19.284882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:27:19.284882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:27:19.284882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:27:19.284882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:27:19.284882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:27:19.284882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:27:19.284882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:27:19.284882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 17:27:19.284882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 17:27:19.284882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 17:27:19.284882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 17:27:19.285964 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:27:19.285964 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:27:19.285964 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 17:27:19.285964 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:27:19.285964 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 17:27:19.285964 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:27:19.285964 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:27:19.285964 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:27:19.285964 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:27:19.285964 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:27:19.285964 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:27:19.285964 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:27:19.285964 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:27:19.285964 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:27:19.285964 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:27:19.285964 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:27:19.285964 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:27:19.285964 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:27:19.291986 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:27:19.291986 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:27:19.291986 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 17:27:19.291986 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 17:27:19.291986 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 17:27:19.291986 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 17:27:19.291986 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 17:27:19.291986 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 17:27:19.291986 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 17:27:19.291986 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:27:19.291986 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 611/1212] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:27:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:27:19.292717 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74abb6f9-4f5a-45a2-8685-cc1280ef3c92 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:19.401574 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74abb6f9-4f5a-45a2-8685-cc1280ef3c92 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:19.444901 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63093f9d-09ad-4b90-b077-f2882ee482da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:19.445884 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63093f9d-09ad-4b90-b077-f2882ee482da None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:19.446468 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63093f9d-09ad-4b90-b077-f2882ee482da None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:19.446468 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63093f9d-09ad-4b90-b077-f2882ee482da None admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:19.447246 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63093f9d-09ad-4b90-b077-f2882ee482da None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:27:19.447539 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63093f9d-09ad-4b90-b077-f2882ee482da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:19.449130 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63093f9d-09ad-4b90-b077-f2882ee482da None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:19.468245 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 602/1213] 10.222.0.27 () {56 vars in 1143 bytes} [Fri Jul 15 17:27:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:27:19.473618 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7b06e-82be-4c36-9b7c-68c14f826dc1 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:19.597418 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7b06e-82be-4c36-9b7c-68c14f826dc1 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:19.634413 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c01be-910a-48bf-952e-bb8f2d4d117a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:19.635092 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c01be-910a-48bf-952e-bb8f2d4d117a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:19.635378 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c01be-910a-48bf-952e-bb8f2d4d117a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:19.635654 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c01be-910a-48bf-952e-bb8f2d4d117a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:19.674061 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:19.713817 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c01be-910a-48bf-952e-bb8f2d4d117a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:19.716574 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c01be-910a-48bf-952e-bb8f2d4d117a None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:19.836671 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 612/1214] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:27:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 15 17:27:19.838195 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63093f9d-09ad-4b90-b077-f2882ee482da None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:19.858049 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:19.955416 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63093f9d-09ad-4b90-b077-f2882ee482da None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:19.993117 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce42a0-5424-426f-bf9e-adaa6ce96b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:19.994041 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce42a0-5424-426f-bf9e-adaa6ce96b58 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:19.994324 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce42a0-5424-426f-bf9e-adaa6ce96b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:19.995484 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce42a0-5424-426f-bf9e-adaa6ce96b58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:20.009517 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ce42a0-5424-426f-bf9e-adaa6ce96b58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:20.011295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ce42a0-5424-426f-bf9e-adaa6ce96b58 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:20.031860 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-b6ce42a0-5424-426f-bf9e-adaa6ce96b58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:27:20.031860 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:27:20.031860 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:27:20.031860 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:27:20.031860 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:27:20.031860 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:27:20.031860 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:27:20.031860 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:27:20.031860 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:27:20.031860 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:27:20.031860 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:27:20.031860 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:27:20.031860 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:27:20.031860 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:27:20.031860 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:27:20.032984 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:27:20.032984 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:27:20.032984 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:27:20.032984 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:27:20.032984 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:27:20.032984 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:27:20.032984 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:27:20.032984 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:27:20.032984 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:27:20.032984 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:27:20.032984 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:27:20.032984 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:27:20.032984 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:27:20.032984 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:27:20.032984 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:27:20.032984 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:27:20.032984 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:27:20.034131 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:27:20.034131 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:27:20.034131 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:27:20.034131 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:27:20.038416 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 603/1215] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:27:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:27:20.039816 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c01be-910a-48bf-952e-bb8f2d4d117a None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:20.111085 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:20.160617 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c01be-910a-48bf-952e-bb8f2d4d117a None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:20.202462 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18162bdb-0ff8-45f9-a38b-865742954d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:20.203450 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18162bdb-0ff8-45f9-a38b-865742954d94 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:20.203733 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18162bdb-0ff8-45f9-a38b-865742954d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:20.204008 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18162bdb-0ff8-45f9-a38b-865742954d94 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:20.204747 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18162bdb-0ff8-45f9-a38b-865742954d94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:27:20.205072 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18162bdb-0ff8-45f9-a38b-865742954d94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:20.206637 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18162bdb-0ff8-45f9-a38b-865742954d94 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:20.219758 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 613/1216] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:27:20.225603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce42a0-5424-426f-bf9e-adaa6ce96b58 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:20.315640 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:20.355673 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce42a0-5424-426f-bf9e-adaa6ce96b58 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:20.399910 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865a8dd-6608-4845-84af-e600518c344f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:20.400642 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865a8dd-6608-4845-84af-e600518c344f None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:20.400918 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865a8dd-6608-4845-84af-e600518c344f None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:20.401181 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865a8dd-6608-4845-84af-e600518c344f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:20.408385 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7865a8dd-6608-4845-84af-e600518c344f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:20.409823 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7865a8dd-6608-4845-84af-e600518c344f None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:20.423701 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-7865a8dd-6608-4845-84af-e600518c344f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:27:20.423701 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:27:20.423701 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:27:20.423701 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:27:20.423701 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:27:20.423701 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:27:20.423701 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:27:20.423701 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:27:20.423701 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:27:20.423701 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:27:20.423701 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:27:20.423701 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:27:20.423701 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 17:27:20.423701 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 17:27:20.423701 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 17:27:20.424946 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 17:27:20.424946 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:27:20.424946 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:27:20.424946 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:27:20.424946 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:27:20.424946 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:27:20.424946 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:27:20.424946 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:27:20.424946 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:27:20.424946 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:27:20.424946 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:27:20.424946 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:27:20.424946 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:27:20.424946 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:27:20.424946 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:27:20.424946 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:27:20.424946 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:27:20.425998 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 17:27:20.425998 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 17:27:20.425998 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 17:27:20.425998 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 17:27:20.425998 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 17:27:20.425998 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 17:27:20.425998 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:27:20.425998 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:27:20.425998 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 604/1217] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:27:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:27:20.431172 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18162bdb-0ff8-45f9-a38b-865742954d94 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:20.538315 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18162bdb-0ff8-45f9-a38b-865742954d94 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:20.561999 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:20.574583 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786fa0a-a514-4bde-8a97-568d24cbff13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:20.575278 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786fa0a-a514-4bde-8a97-568d24cbff13 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:20.575570 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786fa0a-a514-4bde-8a97-568d24cbff13 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:20.575846 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786fa0a-a514-4bde-8a97-568d24cbff13 None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:20.576632 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7786fa0a-a514-4bde-8a97-568d24cbff13 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:27:20.576942 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7786fa0a-a514-4bde-8a97-568d24cbff13 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:20.578746 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7786fa0a-a514-4bde-8a97-568d24cbff13 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:20.593988 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 614/1218] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jul 15 17:27:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:27:20.600305 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865a8dd-6608-4845-84af-e600518c344f None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:20.702220 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865a8dd-6608-4845-84af-e600518c344f None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:20.731566 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:20.738651 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56174267-df4d-4e1c-ad6f-89d5c4e29e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:20.739345 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56174267-df4d-4e1c-ad6f-89d5c4e29e42 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:20.739789 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56174267-df4d-4e1c-ad6f-89d5c4e29e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:20.740112 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56174267-df4d-4e1c-ad6f-89d5c4e29e42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:20.741063 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56174267-df4d-4e1c-ad6f-89d5c4e29e42 None admin] RBAC: Adding query filter params (role.id=1a453be279744db09ef4e2fcf580beac, scope.project.id=19cc5221b8074f48b5f73dc9c4289b03, user.id=96b2105f8d29443383ed51a8fd5cec6e) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:27:20.741483 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56174267-df4d-4e1c-ad6f-89d5c4e29e42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:20.743392 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56174267-df4d-4e1c-ad6f-89d5c4e29e42 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:20.749444 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 605/1219] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jul 15 17:27:20 2022] GET /identity/v3/role_assignments?user.id=96b2105f8d29443383ed51a8fd5cec6e&scope.project.id=19cc5221b8074f48b5f73dc9c4289b03&role.id=1a453be279744db09ef4e2fcf580beac => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:27:22.748864 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855ae7e-3a6c-4eb3-ac95-4a2731bb5d41 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:22.749411 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855ae7e-3a6c-4eb3-ac95-4a2731bb5d41 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:22.749411 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855ae7e-3a6c-4eb3-ac95-4a2731bb5d41 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:22.750748 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 615/1220] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:27:22.756249 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaaae24-bc80-4ef5-8cf6-45642911669c None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:22.756646 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaaae24-bc80-4ef5-8cf6-45642911669c None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:22.756803 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaaae24-bc80-4ef5-8cf6-45642911669c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:22.776980 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-cfaaae24-bc80-4ef5-8cf6-45642911669c None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:27:22.778366 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-cfaaae24-bc80-4ef5-8cf6-45642911669c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:27:22.855909 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 606/1221] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:27:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:27:22.879598 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855ae7e-3a6c-4eb3-ac95-4a2731bb5d41 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:22.988316 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855ae7e-3a6c-4eb3-ac95-4a2731bb5d41 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:23.032813 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52e2cf-0a52-4de1-82d6-b9a2b286c76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:23.033706 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52e2cf-0a52-4de1-82d6-b9a2b286c76c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:23.034044 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52e2cf-0a52-4de1-82d6-b9a2b286c76c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:23.034337 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52e2cf-0a52-4de1-82d6-b9a2b286c76c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:23.045712 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f52e2cf-0a52-4de1-82d6-b9a2b286c76c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:27:23.053516 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-7f52e2cf-0a52-4de1-82d6-b9a2b286c76c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 17:27:23.053516 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:27:23.053516 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:27:23.053516 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:27:23.053516 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:27:23.053516 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:27:23.053516 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:27:23.053516 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:27:23.053516 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:27:23.053516 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:27:23.053516 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:27:23.053516 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:27:23.053516 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:27:23.053516 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:27:23.053516 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:27:23.053516 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:27:23.054738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:27:23.054738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:27:23.054738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:27:23.054738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:27:23.054738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:27:23.054738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:27:23.054738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:27:23.054738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:27:23.054738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:27:23.054738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:27:23.054738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:27:23.054738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:27:23.054738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:27:23.054738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:27:23.054738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:27:23.054738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:27:23.055641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:27:23.055641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:27:23.055641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:27:23.055641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:27:23.055641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:27:23.055641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:27:23.055641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:27:23.055641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:27:23.055641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:27:23.055641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:27:23.055641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 17:27:23.055641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:27:23.055641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 616/1222] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Jul 15 17:27:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:27:23.061222 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaaae24-bc80-4ef5-8cf6-45642911669c None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:23.182510 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaaae24-bc80-4ef5-8cf6-45642911669c None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:23.208761 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:23.221287 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84194fb-e5c8-449d-bd92-ebb870df0540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:23.222007 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84194fb-e5c8-449d-bd92-ebb870df0540 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:23.222285 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84194fb-e5c8-449d-bd92-ebb870df0540 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:23.222553 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84194fb-e5c8-449d-bd92-ebb870df0540 None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:23.223289 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84194fb-e5c8-449d-bd92-ebb870df0540 None admin] RBAC: Adding query filter params (name=service) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:27:23.223591 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84194fb-e5c8-449d-bd92-ebb870df0540 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:23.224955 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84194fb-e5c8-449d-bd92-ebb870df0540 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:23.234745 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 607/1223] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Jul 15 17:27:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:27:23.240881 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52e2cf-0a52-4de1-82d6-b9a2b286c76c None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:23.289903 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:23.361378 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52e2cf-0a52-4de1-82d6-b9a2b286c76c None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:23.399417 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9277ff99-2a9a-4767-bf9d-c57d31eaac76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:23.400271 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277ff99-2a9a-4767-bf9d-c57d31eaac76 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:23.400590 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277ff99-2a9a-4767-bf9d-c57d31eaac76 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:23.400890 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277ff99-2a9a-4767-bf9d-c57d31eaac76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:23.412267 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9277ff99-2a9a-4767-bf9d-c57d31eaac76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:23.414317 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9277ff99-2a9a-4767-bf9d-c57d31eaac76 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:23.432808 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-9277ff99-2a9a-4767-bf9d-c57d31eaac76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:27:23.432808 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:27:23.432808 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:27:23.432808 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:27:23.432808 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:27:23.432808 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:27:23.432808 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:27:23.432808 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:27:23.432808 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:27:23.432808 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:27:23.432808 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:27:23.432808 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:27:23.432808 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:27:23.432808 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:27:23.432808 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:27:23.433957 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:27:23.433957 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:27:23.433957 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:27:23.433957 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:27:23.433957 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:27:23.433957 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:27:23.433957 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:27:23.433957 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:27:23.433957 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:27:23.433957 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:27:23.433957 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:27:23.433957 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:27:23.433957 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:27:23.433957 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:27:23.433957 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:27:23.433957 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:27:23.433957 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:27:23.434872 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:27:23.434872 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:27:23.434872 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:27:23.434872 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:27:23.434872 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 617/1224] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:27:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 17:27:23.440204 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84194fb-e5c8-449d-bd92-ebb870df0540 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:23.543076 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84194fb-e5c8-449d-bd92-ebb870df0540 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:23.576458 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a6734-4067-45e6-8fe7-0a819b607b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:23.577118 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a6734-4067-45e6-8fe7-0a819b607b9d None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:23.577395 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a6734-4067-45e6-8fe7-0a819b607b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:23.578007 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a6734-4067-45e6-8fe7-0a819b607b9d None admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:23.578716 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a6734-4067-45e6-8fe7-0a819b607b9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:27:23.579014 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a6734-4067-45e6-8fe7-0a819b607b9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:23.580367 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a6734-4067-45e6-8fe7-0a819b607b9d None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:23.592301 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 608/1225] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:27:23.598800 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9277ff99-2a9a-4767-bf9d-c57d31eaac76 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:23.703930 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:23.713044 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9277ff99-2a9a-4767-bf9d-c57d31eaac76 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:23.748145 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e73a73d-fc2b-4528-bfdf-e93fa9439eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:23.748993 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73a73d-fc2b-4528-bfdf-e93fa9439eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:23.749533 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73a73d-fc2b-4528-bfdf-e93fa9439eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:23.749533 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73a73d-fc2b-4528-bfdf-e93fa9439eb2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:23.757169 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e73a73d-fc2b-4528-bfdf-e93fa9439eb2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:23.758732 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e73a73d-fc2b-4528-bfdf-e93fa9439eb2 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:23.774135 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-4e73a73d-fc2b-4528-bfdf-e93fa9439eb2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 17:27:23.774135 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:27:23.774135 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:27:23.774135 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:27:23.774135 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:27:23.774135 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:27:23.774135 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:27:23.774135 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:27:23.774135 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:27:23.774135 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:27:23.774135 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:27:23.774135 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:27:23.774135 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 17:27:23.774135 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 17:27:23.774135 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 17:27:23.774135 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 17:27:23.775295 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:27:23.775295 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:27:23.775295 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 17:27:23.775295 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:27:23.775295 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 17:27:23.775295 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:27:23.775295 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:27:23.775295 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:27:23.775295 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:27:23.775295 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:27:23.775295 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:27:23.775295 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:27:23.775295 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:27:23.775295 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:27:23.775295 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:27:23.775295 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:27:23.775295 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:27:23.775295 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:27:23.776382 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:27:23.776382 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:27:23.776382 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 17:27:23.776382 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 17:27:23.776382 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 17:27:23.776382 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 17:27:23.776382 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 17:27:23.776382 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 17:27:23.776382 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 17:27:23.776382 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:27:23.776382 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 618/1226] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:27:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:27:23.781392 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a6734-4067-45e6-8fe7-0a819b607b9d None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:23.837426 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:23.895319 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a6734-4067-45e6-8fe7-0a819b607b9d None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:23.933814 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce21c7b-da10-4a5a-9812-86dd90450696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:23.934597 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce21c7b-da10-4a5a-9812-86dd90450696 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:23.934864 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce21c7b-da10-4a5a-9812-86dd90450696 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:23.935092 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce21c7b-da10-4a5a-9812-86dd90450696 None admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:23.935986 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce21c7b-da10-4a5a-9812-86dd90450696 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:27:23.936308 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce21c7b-da10-4a5a-9812-86dd90450696 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:23.937724 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce21c7b-da10-4a5a-9812-86dd90450696 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:23.955349 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 609/1227] 10.222.0.27 () {56 vars in 1143 bytes} [Fri Jul 15 17:27:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:27:23.961348 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e73a73d-fc2b-4528-bfdf-e93fa9439eb2 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:24.064783 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e73a73d-fc2b-4528-bfdf-e93fa9439eb2 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:24.108399 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f658b4-a3e2-48d3-bc75-50c41fea2307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:24.109142 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f658b4-a3e2-48d3-bc75-50c41fea2307 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:24.109433 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f658b4-a3e2-48d3-bc75-50c41fea2307 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:24.109719 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f658b4-a3e2-48d3-bc75-50c41fea2307 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:24.124906 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f658b4-a3e2-48d3-bc75-50c41fea2307 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:24.126401 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f658b4-a3e2-48d3-bc75-50c41fea2307 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:24.145533 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-89f658b4-a3e2-48d3-bc75-50c41fea2307 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:27:24.145533 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:27:24.145533 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:27:24.145533 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:27:24.145533 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:27:24.145533 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:27:24.145533 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:27:24.145533 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:27:24.145533 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:27:24.145533 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:27:24.145533 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:27:24.145533 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:27:24.145533 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:27:24.145533 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:27:24.145533 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:27:24.146692 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:27:24.146692 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:27:24.146692 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:27:24.146692 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:27:24.146692 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:27:24.146692 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:27:24.146692 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:27:24.146692 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:27:24.146692 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:27:24.146692 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:27:24.146692 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:27:24.146692 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:27:24.146692 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:27:24.146692 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:27:24.146692 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:27:24.146692 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:27:24.146692 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:27:24.147778 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:27:24.147778 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:27:24.147778 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:27:24.147778 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:27:24.147778 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 619/1228] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:27:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:27:24.153029 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce21c7b-da10-4a5a-9812-86dd90450696 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:24.259465 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce21c7b-da10-4a5a-9812-86dd90450696 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:24.261858 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:24.296163 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d5cb3-a068-407a-859e-d9b36a51e7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:24.296838 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d5cb3-a068-407a-859e-d9b36a51e7e0 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:24.297192 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d5cb3-a068-407a-859e-d9b36a51e7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:24.297474 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d5cb3-a068-407a-859e-d9b36a51e7e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:24.298333 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13d5cb3-a068-407a-859e-d9b36a51e7e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:27:24.298638 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13d5cb3-a068-407a-859e-d9b36a51e7e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:24.300049 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13d5cb3-a068-407a-859e-d9b36a51e7e0 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:24.318221 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 610/1229] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:27:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:27:24.318809 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f658b4-a3e2-48d3-bc75-50c41fea2307 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:24.329153 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:24.425373 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f658b4-a3e2-48d3-bc75-50c41fea2307 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:24.462186 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2921ba-4154-4bbf-996a-f9598b9f9c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:24.462988 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2921ba-4154-4bbf-996a-f9598b9f9c38 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:24.463263 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2921ba-4154-4bbf-996a-f9598b9f9c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:24.463529 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2921ba-4154-4bbf-996a-f9598b9f9c38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:24.470691 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2921ba-4154-4bbf-996a-f9598b9f9c38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:24.472132 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2921ba-4154-4bbf-996a-f9598b9f9c38 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:24.487075 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-dd2921ba-4154-4bbf-996a-f9598b9f9c38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:27:24.487075 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:27:24.487075 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:27:24.487075 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:27:24.487075 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:27:24.487075 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:27:24.487075 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:27:24.487075 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:27:24.487075 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:27:24.487075 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:27:24.487075 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:27:24.487075 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:27:24.487075 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 17:27:24.487075 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 17:27:24.487075 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 17:27:24.488263 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 17:27:24.488263 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:27:24.488263 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:27:24.488263 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:27:24.488263 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:27:24.488263 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:27:24.488263 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:27:24.488263 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:27:24.488263 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:27:24.488263 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:27:24.488263 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:27:24.488263 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:27:24.488263 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:27:24.488263 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:27:24.488263 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:27:24.488263 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:27:24.488263 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:27:24.489302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 17:27:24.489302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 17:27:24.489302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 17:27:24.489302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 17:27:24.489302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 17:27:24.489302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 17:27:24.489302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:27:24.489302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:27:24.489302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 620/1230] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:27:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 17:27:24.494862 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d5cb3-a068-407a-859e-d9b36a51e7e0 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:24.608242 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d5cb3-a068-407a-859e-d9b36a51e7e0 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:24.649746 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b1b20-1cae-495f-b792-3973d4a08994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:24.650490 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b1b20-1cae-495f-b792-3973d4a08994 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:24.650851 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b1b20-1cae-495f-b792-3973d4a08994 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:24.651041 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b1b20-1cae-495f-b792-3973d4a08994 None admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:24.651820 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b1b20-1cae-495f-b792-3973d4a08994 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:27:24.652127 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b1b20-1cae-495f-b792-3973d4a08994 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:24.653600 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b1b20-1cae-495f-b792-3973d4a08994 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:24.672339 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 611/1231] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jul 15 17:27:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:27:24.673559 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2921ba-4154-4bbf-996a-f9598b9f9c38 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:24.745543 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:24.782697 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2921ba-4154-4bbf-996a-f9598b9f9c38 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:24.819020 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49f2b0-48e0-4c32-8ac2-de5234edd9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:24.819908 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49f2b0-48e0-4c32-8ac2-de5234edd9b8 None admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:24.820186 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49f2b0-48e0-4c32-8ac2-de5234edd9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:24.820617 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49f2b0-48e0-4c32-8ac2-de5234edd9b8 None admin] PATH_INFO: `/v3/projects/19cc5221b8074f48b5f73dc9c4289b03/users/96b2105f8d29443383ed51a8fd5cec6e/roles/1a453be279744db09ef4e2fcf580beac` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:24.837176 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa49f2b0-48e0-4c32-8ac2-de5234edd9b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=19cc5221b8074f48b5f73dc9c4289b03, user_id=96b2105f8d29443383ed51a8fd5cec6e, role_id=1a453be279744db09ef4e2fcf580beac)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:24.838781 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa49f2b0-48e0-4c32-8ac2-de5234edd9b8 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:24.855245 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 621/1232] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Jul 15 17:27:24 2022] PUT /identity/v3/projects/19cc5221b8074f48b5f73dc9c4289b03/users/96b2105f8d29443383ed51a8fd5cec6e/roles/1a453be279744db09ef4e2fcf580beac => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:27:26.951316 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b62dfd-88a3-4948-872b-6511280d84f6 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:26.951912 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b62dfd-88a3-4948-872b-6511280d84f6 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:26.951912 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b62dfd-88a3-4948-872b-6511280d84f6 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:26.953656 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 612/1233] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:27:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:27:26.959627 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc3414-87aa-42b1-b0b0-f7f4e6053bf5 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:26.960031 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc3414-87aa-42b1-b0b0-f7f4e6053bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:26.960185 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc3414-87aa-42b1-b0b0-f7f4e6053bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:26.978753 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-fadc3414-87aa-42b1-b0b0-f7f4e6053bf5 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:27:26.979942 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-fadc3414-87aa-42b1-b0b0-f7f4e6053bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:27:27.047478 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 622/1234] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:27:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:27:27.070631 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b62dfd-88a3-4948-872b-6511280d84f6 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:27.098880 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:27.182859 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b62dfd-88a3-4948-872b-6511280d84f6 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:27.218803 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a73c76-e4c8-4bda-880e-9b9a47366300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:27.219520 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a73c76-e4c8-4bda-880e-9b9a47366300 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:27.219800 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a73c76-e4c8-4bda-880e-9b9a47366300 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:27.220078 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a73c76-e4c8-4bda-880e-9b9a47366300 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:27.231384 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a73c76-e4c8-4bda-880e-9b9a47366300 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:27:27.240655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-e1a73c76-e4c8-4bda-880e-9b9a47366300 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 17:27:27.240655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:27:27.240655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:27:27.240655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:27:27.240655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:27:27.240655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:27:27.240655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:27:27.240655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:27:27.240655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:27:27.240655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:27:27.240655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:27:27.240655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:27:27.240655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:27:27.240655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:27:27.240655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:27:27.240655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:27:27.241861 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:27:27.241861 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:27:27.241861 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:27:27.241861 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:27:27.241861 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:27:27.241861 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:27:27.241861 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:27:27.241861 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:27:27.241861 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:27:27.241861 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:27:27.241861 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:27:27.241861 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:27:27.241861 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:27:27.241861 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:27:27.241861 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:27:27.241861 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:27:27.243127 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:27:27.243127 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:27:27.243127 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:27:27.243127 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:27:27.243127 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:27:27.243127 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:27:27.243127 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:27:27.243127 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:27:27.243127 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:27:27.243127 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:27:27.243127 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 17:27:27.243127 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:27:27.243775 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 613/1235] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Jul 15 17:27:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:27:27.249652 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc3414-87aa-42b1-b0b0-f7f4e6053bf5 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:27.297207 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:27.355071 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc3414-87aa-42b1-b0b0-f7f4e6053bf5 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:27.391397 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6f83c-c38c-472e-9400-8cfed7018739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:27.392175 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6f83c-c38c-472e-9400-8cfed7018739 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:27.392496 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6f83c-c38c-472e-9400-8cfed7018739 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:27.392764 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6f83c-c38c-472e-9400-8cfed7018739 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:27.393493 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6f83c-c38c-472e-9400-8cfed7018739 None admin] RBAC: Adding query filter params (name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:27:27.393821 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6f83c-c38c-472e-9400-8cfed7018739 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:27.395215 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6f83c-c38c-472e-9400-8cfed7018739 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:27.403832 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 623/1236] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Jul 15 17:27:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:27:27.409623 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a73c76-e4c8-4bda-880e-9b9a47366300 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:27.499850 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:27.518433 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a73c76-e4c8-4bda-880e-9b9a47366300 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:27.556321 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2414d9b-c7db-4951-8cc7-c2abf5db5d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:27.557115 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2414d9b-c7db-4951-8cc7-c2abf5db5d56 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:27.557392 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2414d9b-c7db-4951-8cc7-c2abf5db5d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:27.557712 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2414d9b-c7db-4951-8cc7-c2abf5db5d56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:27.568458 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2414d9b-c7db-4951-8cc7-c2abf5db5d56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:27.569936 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2414d9b-c7db-4951-8cc7-c2abf5db5d56 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:27.587853 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-b2414d9b-c7db-4951-8cc7-c2abf5db5d56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:27:27.587853 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:27:27.587853 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:27:27.587853 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:27:27.587853 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:27:27.587853 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:27:27.587853 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:27:27.587853 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:27:27.587853 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:27:27.587853 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:27:27.587853 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:27:27.587853 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:27:27.587853 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:27:27.587853 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:27:27.587853 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:27:27.588896 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:27:27.588896 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:27:27.588896 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:27:27.588896 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:27:27.588896 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:27:27.588896 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:27:27.588896 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:27:27.588896 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:27:27.588896 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:27:27.588896 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:27:27.588896 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:27:27.588896 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:27:27.588896 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:27:27.588896 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:27:27.588896 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:27:27.588896 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:27:27.588896 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:27:27.590215 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:27:27.590215 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:27:27.590215 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:27:27.590215 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:27:27.590662 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 614/1237] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:27:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:27:27.595170 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6f83c-c38c-472e-9400-8cfed7018739 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:27.706351 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6f83c-c38c-472e-9400-8cfed7018739 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:27.715562 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:27.744904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1191308-b55c-4528-9e79-a362c45cd6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:27.745641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1191308-b55c-4528-9e79-a362c45cd6c0 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:27.745906 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1191308-b55c-4528-9e79-a362c45cd6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:27.746214 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1191308-b55c-4528-9e79-a362c45cd6c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:27.747011 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1191308-b55c-4528-9e79-a362c45cd6c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:27:27.747317 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1191308-b55c-4528-9e79-a362c45cd6c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:27.748769 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1191308-b55c-4528-9e79-a362c45cd6c0 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:27.762085 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 624/1238] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:27:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:27:27.767908 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2414d9b-c7db-4951-8cc7-c2abf5db5d56 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:27.880739 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2414d9b-c7db-4951-8cc7-c2abf5db5d56 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:27.916260 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a84f2f-262e-4633-8ad1-d1ef857ab453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:27.917085 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a84f2f-262e-4633-8ad1-d1ef857ab453 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:27.917366 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a84f2f-262e-4633-8ad1-d1ef857ab453 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:27.917646 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a84f2f-262e-4633-8ad1-d1ef857ab453 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:27.921350 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:27.928091 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a84f2f-262e-4633-8ad1-d1ef857ab453 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:27.929660 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a84f2f-262e-4633-8ad1-d1ef857ab453 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:27.944985 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-c4a84f2f-262e-4633-8ad1-d1ef857ab453 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 17:27:27.944985 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:27:27.944985 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:27:27.944985 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:27:27.944985 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:27:27.944985 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:27:27.944985 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:27:27.944985 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:27:27.944985 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:27:27.944985 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:27:27.944985 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:27:27.944985 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:27:27.944985 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 17:27:27.944985 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 17:27:27.944985 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 17:27:27.944985 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 17:27:27.946384 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:27:27.946384 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:27:27.946384 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 17:27:27.946384 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:27:27.946384 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 17:27:27.946384 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:27:27.946384 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:27:27.946384 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:27:27.946384 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:27:27.946384 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:27:27.946384 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:27:27.946384 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:27:27.946384 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:27:27.946384 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:27:27.946384 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:27:27.946384 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:27:27.946384 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:27:27.946384 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:27:27.947640 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:27:27.947640 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:27:27.947640 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 17:27:27.947640 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 17:27:27.947640 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 17:27:27.947640 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 17:27:27.947640 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 17:27:27.947640 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 17:27:27.947640 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 17:27:27.947640 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:27:27.947640 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 615/1239] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:27:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 17:27:27.954897 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1191308-b55c-4528-9e79-a362c45cd6c0 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:28.065968 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1191308-b55c-4528-9e79-a362c45cd6c0 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:28.112631 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ee076-22ca-4793-a85a-c2145002ba12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:28.114008 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ee076-22ca-4793-a85a-c2145002ba12 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:28.114511 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ee076-22ca-4793-a85a-c2145002ba12 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:28.114869 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ee076-22ca-4793-a85a-c2145002ba12 None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:28.116017 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ee076-22ca-4793-a85a-c2145002ba12 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:27:28.116490 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ee076-22ca-4793-a85a-c2145002ba12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:28.119005 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ee076-22ca-4793-a85a-c2145002ba12 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:28.144885 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 625/1240] 10.222.0.27 () {56 vars in 1143 bytes} [Fri Jul 15 17:27:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:27:28.150872 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a84f2f-262e-4633-8ad1-d1ef857ab453 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:28.269407 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a84f2f-262e-4633-8ad1-d1ef857ab453 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:28.304836 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830be67b-7b23-448a-bb68-57a725dba295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:28.305512 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830be67b-7b23-448a-bb68-57a725dba295 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:28.305888 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830be67b-7b23-448a-bb68-57a725dba295 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:28.306136 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830be67b-7b23-448a-bb68-57a725dba295 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:28.377301 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:28.385043 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830be67b-7b23-448a-bb68-57a725dba295 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:28.386574 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830be67b-7b23-448a-bb68-57a725dba295 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:28.488766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 616/1241] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:27:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 15 17:27:28.494910 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ee076-22ca-4793-a85a-c2145002ba12 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:28.521846 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:28.601639 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ee076-22ca-4793-a85a-c2145002ba12 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:28.644250 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41601004-9906-40e1-872d-2b1324e66c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:28.644975 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41601004-9906-40e1-872d-2b1324e66c17 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:28.645254 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41601004-9906-40e1-872d-2b1324e66c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:28.645527 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41601004-9906-40e1-872d-2b1324e66c17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:28.656242 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41601004-9906-40e1-872d-2b1324e66c17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:28.657898 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41601004-9906-40e1-872d-2b1324e66c17 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:28.680253 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-41601004-9906-40e1-872d-2b1324e66c17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:27:28.680253 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:27:28.680253 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:27:28.680253 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:27:28.680253 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:27:28.680253 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:27:28.680253 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:27:28.680253 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:27:28.680253 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:27:28.680253 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:27:28.680253 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:27:28.680253 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:27:28.680253 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:27:28.680253 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:27:28.680253 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:27:28.681302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:27:28.681302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:27:28.681302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:27:28.681302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:27:28.681302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:27:28.681302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:27:28.681302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:27:28.681302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:27:28.681302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:27:28.681302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:27:28.681302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:27:28.681302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:27:28.681302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:27:28.681302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:27:28.681302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:27:28.681302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:27:28.681302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:27:28.682240 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:27:28.682240 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:27:28.682240 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:27:28.682240 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:27:28.682240 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 626/1242] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:27:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:27:28.687518 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830be67b-7b23-448a-bb68-57a725dba295 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:28.790106 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:28.797124 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830be67b-7b23-448a-bb68-57a725dba295 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:28.834908 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f83fb71-06f8-427a-9059-962f3d17b3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:28.835593 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83fb71-06f8-427a-9059-962f3d17b3fd None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:28.835891 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83fb71-06f8-427a-9059-962f3d17b3fd None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:28.836158 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83fb71-06f8-427a-9059-962f3d17b3fd None admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:28.836878 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f83fb71-06f8-427a-9059-962f3d17b3fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:27:28.837177 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f83fb71-06f8-427a-9059-962f3d17b3fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:28.838573 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f83fb71-06f8-427a-9059-962f3d17b3fd None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:28.852421 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 617/1243] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:27:28.858346 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41601004-9906-40e1-872d-2b1324e66c17 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:28.944944 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:28.971501 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41601004-9906-40e1-872d-2b1324e66c17 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:29.009062 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c7acf-c95f-4ffc-ba2a-d5c9302ac61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:29.010226 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c7acf-c95f-4ffc-ba2a-d5c9302ac61b None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:29.010615 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c7acf-c95f-4ffc-ba2a-d5c9302ac61b None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:29.010923 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c7acf-c95f-4ffc-ba2a-d5c9302ac61b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:29.019478 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c7acf-c95f-4ffc-ba2a-d5c9302ac61b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:29.021004 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c7acf-c95f-4ffc-ba2a-d5c9302ac61b None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:29.035181 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-073c7acf-c95f-4ffc-ba2a-d5c9302ac61b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:27:29.035181 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:27:29.035181 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:27:29.035181 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:27:29.035181 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:27:29.035181 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:27:29.035181 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:27:29.035181 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:27:29.035181 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:27:29.035181 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:27:29.035181 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:27:29.035181 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:27:29.035181 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 17:27:29.035181 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 17:27:29.035181 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 17:27:29.036262 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 17:27:29.036262 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:27:29.036262 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:27:29.036262 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:27:29.036262 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:27:29.036262 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:27:29.036262 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:27:29.036262 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:27:29.036262 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:27:29.036262 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:27:29.036262 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:27:29.036262 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:27:29.036262 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:27:29.036262 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:27:29.036262 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:27:29.036262 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:27:29.036262 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:27:29.037267 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 17:27:29.037267 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 17:27:29.037267 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 17:27:29.037267 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 17:27:29.037267 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 17:27:29.037267 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 17:27:29.037267 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:27:29.037267 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:27:29.037267 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 627/1244] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:27:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:27:29.042693 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f83fb71-06f8-427a-9059-962f3d17b3fd None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:29.154825 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f83fb71-06f8-427a-9059-962f3d17b3fd None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:29.190683 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffab48d-22c1-4eb4-b120-483f4e395c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:29.191300 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffab48d-22c1-4eb4-b120-483f4e395c39 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:29.191575 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffab48d-22c1-4eb4-b120-483f4e395c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:29.191840 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffab48d-22c1-4eb4-b120-483f4e395c39 None admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:29.192616 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffab48d-22c1-4eb4-b120-483f4e395c39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:27:29.192920 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffab48d-22c1-4eb4-b120-483f4e395c39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:29.194457 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffab48d-22c1-4eb4-b120-483f4e395c39 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:29.211002 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 618/1245] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jul 15 17:27:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:27:29.217170 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c7acf-c95f-4ffc-ba2a-d5c9302ac61b None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:29.328333 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c7acf-c95f-4ffc-ba2a-d5c9302ac61b None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:29.363345 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802220e-912c-41fa-b2e9-e4b698bcc87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:29.364003 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802220e-912c-41fa-b2e9-e4b698bcc87d None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:29.364280 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802220e-912c-41fa-b2e9-e4b698bcc87d None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:29.364551 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802220e-912c-41fa-b2e9-e4b698bcc87d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:29.365375 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802220e-912c-41fa-b2e9-e4b698bcc87d None admin] RBAC: Adding query filter params (role.id=1a453be279744db09ef4e2fcf580beac, scope.project.id=19cc5221b8074f48b5f73dc9c4289b03, user.id=96b2105f8d29443383ed51a8fd5cec6e) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:27:29.365676 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802220e-912c-41fa-b2e9-e4b698bcc87d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:29.367204 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802220e-912c-41fa-b2e9-e4b698bcc87d None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:29.373656 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 628/1246] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jul 15 17:27:29 2022] GET /identity/v3/role_assignments?user.id=96b2105f8d29443383ed51a8fd5cec6e&scope.project.id=19cc5221b8074f48b5f73dc9c4289b03&role.id=1a453be279744db09ef4e2fcf580beac => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:27:31.567419 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f735c-9bd1-488e-b39a-9e8ecfc8cdfb None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:31.567929 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f735c-9bd1-488e-b39a-9e8ecfc8cdfb None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:31.568014 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f735c-9bd1-488e-b39a-9e8ecfc8cdfb None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:31.570066 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 619/1247] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:27:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:27:31.575749 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87f927-5e3d-490c-9e18-ee1a6a592876 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:31.576198 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87f927-5e3d-490c-9e18-ee1a6a592876 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:31.576319 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87f927-5e3d-490c-9e18-ee1a6a592876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:31.581815 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:31.594889 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-5f87f927-5e3d-490c-9e18-ee1a6a592876 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:27:31.596004 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5f87f927-5e3d-490c-9e18-ee1a6a592876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:27:31.670182 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 629/1248] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:27:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:27:31.693825 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f735c-9bd1-488e-b39a-9e8ecfc8cdfb None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:31.714772 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:31.804877 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f735c-9bd1-488e-b39a-9e8ecfc8cdfb None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:31.846449 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d25c5-23d3-470a-af08-16dd2af6a573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:31.847177 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d25c5-23d3-470a-af08-16dd2af6a573 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:31.847466 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d25c5-23d3-470a-af08-16dd2af6a573 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:31.847744 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d25c5-23d3-470a-af08-16dd2af6a573 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:31.860491 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d25c5-23d3-470a-af08-16dd2af6a573 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:27:31.868625 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-699d25c5-23d3-470a-af08-16dd2af6a573 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:27:31.868625 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:27:31.868625 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:27:31.868625 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:27:31.868625 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:27:31.868625 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:27:31.868625 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:27:31.868625 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:27:31.868625 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:27:31.868625 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:27:31.868625 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:27:31.868625 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:27:31.868625 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:27:31.868625 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:27:31.868625 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:27:31.868625 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:27:31.870586 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:27:31.870586 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:27:31.870586 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:27:31.870586 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:27:31.870586 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:27:31.870586 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:27:31.870586 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:27:31.870586 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:27:31.870586 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:27:31.870586 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:27:31.870586 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:27:31.870586 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:27:31.870586 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:27:31.870586 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:27:31.870586 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:27:31.870586 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:27:31.871796 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:27:31.871796 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:27:31.871796 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:27:31.871796 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:27:31.871796 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:27:31.871796 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:27:31.871796 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:27:31.871796 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:27:31.871796 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:27:31.871796 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:27:31.871796 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:27:31.871796 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:27:31.871796 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 620/1249] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jul 15 17:27:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:27:31.876740 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87f927-5e3d-490c-9e18-ee1a6a592876 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:31.991445 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87f927-5e3d-490c-9e18-ee1a6a592876 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:32.023061 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:32.028782 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86fc22a-75f0-47fd-bdf5-91f536172591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:32.029493 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86fc22a-75f0-47fd-bdf5-91f536172591 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:32.029797 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86fc22a-75f0-47fd-bdf5-91f536172591 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:32.030086 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86fc22a-75f0-47fd-bdf5-91f536172591 None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:32.030882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86fc22a-75f0-47fd-bdf5-91f536172591 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:27:32.031450 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86fc22a-75f0-47fd-bdf5-91f536172591 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:32.032836 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86fc22a-75f0-47fd-bdf5-91f536172591 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:32.041540 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 630/1250] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:27:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:27:32.047433 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d25c5-23d3-470a-af08-16dd2af6a573 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:32.134625 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:32.159985 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d25c5-23d3-470a-af08-16dd2af6a573 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:32.193894 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046fdd2-b8bf-473a-a2c1-4d8124e462ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:32.194785 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046fdd2-b8bf-473a-a2c1-4d8124e462ad None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:32.195185 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046fdd2-b8bf-473a-a2c1-4d8124e462ad None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:32.195526 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046fdd2-b8bf-473a-a2c1-4d8124e462ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:32.206509 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046fdd2-b8bf-473a-a2c1-4d8124e462ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:32.208155 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046fdd2-b8bf-473a-a2c1-4d8124e462ad None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:32.226555 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-4046fdd2-b8bf-473a-a2c1-4d8124e462ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:27:32.226555 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:27:32.226555 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:27:32.226555 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:27:32.226555 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:27:32.226555 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:27:32.226555 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:27:32.226555 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:27:32.226555 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:27:32.226555 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:27:32.226555 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:27:32.226555 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:27:32.226555 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:27:32.226555 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:27:32.226555 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:27:32.227748 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:27:32.227748 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:27:32.227748 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:27:32.227748 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:27:32.227748 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:27:32.227748 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:27:32.227748 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:27:32.227748 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:27:32.227748 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:27:32.227748 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:27:32.227748 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:27:32.227748 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:27:32.227748 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:27:32.227748 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:27:32.227748 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:27:32.227748 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:27:32.227748 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:27:32.228654 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:27:32.228654 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:27:32.228654 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:27:32.228654 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:27:32.228654 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 621/1251] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:27:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:27:32.233923 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86fc22a-75f0-47fd-bdf5-91f536172591 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:32.343889 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86fc22a-75f0-47fd-bdf5-91f536172591 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:32.380476 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f329eff9-89dd-4a01-b9ec-805355f54543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:32.381178 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329eff9-89dd-4a01-b9ec-805355f54543 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:32.381497 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329eff9-89dd-4a01-b9ec-805355f54543 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:32.381840 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329eff9-89dd-4a01-b9ec-805355f54543 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:32.382886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f329eff9-89dd-4a01-b9ec-805355f54543 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:27:32.383260 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f329eff9-89dd-4a01-b9ec-805355f54543 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:32.384852 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f329eff9-89dd-4a01-b9ec-805355f54543 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:32.397043 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 631/1252] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:27:32.403266 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046fdd2-b8bf-473a-a2c1-4d8124e462ad None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:32.506974 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046fdd2-b8bf-473a-a2c1-4d8124e462ad None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:32.537015 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:32.546205 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50fbaf-c889-42c1-b40b-c6973b1e574e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:32.547265 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50fbaf-c889-42c1-b40b-c6973b1e574e None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:32.547572 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50fbaf-c889-42c1-b40b-c6973b1e574e None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:32.547870 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50fbaf-c889-42c1-b40b-c6973b1e574e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:32.557409 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e50fbaf-c889-42c1-b40b-c6973b1e574e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:32.558122 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e50fbaf-c889-42c1-b40b-c6973b1e574e None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:32.574593 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-8e50fbaf-c889-42c1-b40b-c6973b1e574e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 17:27:32.574593 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:27:32.574593 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:27:32.574593 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:27:32.574593 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:27:32.574593 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:27:32.574593 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:27:32.574593 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:27:32.574593 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:27:32.574593 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:27:32.574593 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:27:32.574593 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:27:32.574593 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 17:27:32.574593 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 17:27:32.574593 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 17:27:32.574593 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 17:27:32.576274 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:27:32.576274 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:27:32.576274 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 17:27:32.576274 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:27:32.576274 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 17:27:32.576274 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:27:32.576274 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:27:32.576274 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:27:32.576274 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:27:32.576274 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:27:32.576274 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:27:32.576274 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:27:32.576274 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:27:32.576274 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:27:32.576274 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:27:32.576274 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:27:32.576274 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:27:32.576274 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:27:32.577741 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:27:32.577741 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:27:32.577741 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 17:27:32.577741 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 17:27:32.577741 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 17:27:32.577741 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 17:27:32.577741 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 17:27:32.577741 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 17:27:32.577741 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 17:27:32.577741 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:27:32.577741 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 622/1253] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:27:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:27:32.583311 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f329eff9-89dd-4a01-b9ec-805355f54543 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:32.651646 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:32.703485 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f329eff9-89dd-4a01-b9ec-805355f54543 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:32.742728 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db25d6a-996e-43dc-a72f-1e1233319ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:32.743465 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db25d6a-996e-43dc-a72f-1e1233319ebf None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:32.743782 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db25d6a-996e-43dc-a72f-1e1233319ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:32.744057 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db25d6a-996e-43dc-a72f-1e1233319ebf None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:32.745009 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db25d6a-996e-43dc-a72f-1e1233319ebf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:27:32.745315 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db25d6a-996e-43dc-a72f-1e1233319ebf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:32.746899 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db25d6a-996e-43dc-a72f-1e1233319ebf None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:32.767246 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 632/1254] 10.222.0.27 () {56 vars in 1143 bytes} [Fri Jul 15 17:27:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:27:32.773517 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50fbaf-c889-42c1-b40b-c6973b1e574e None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:32.897930 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50fbaf-c889-42c1-b40b-c6973b1e574e None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:32.943860 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e80aa50-9042-4c4a-a17c-317451907b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:32.944425 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80aa50-9042-4c4a-a17c-317451907b60 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:32.944699 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80aa50-9042-4c4a-a17c-317451907b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:32.945047 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80aa50-9042-4c4a-a17c-317451907b60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:33.020553 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:33.036819 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e80aa50-9042-4c4a-a17c-317451907b60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:33.038438 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e80aa50-9042-4c4a-a17c-317451907b60 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:33.182864 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 623/1255] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:27:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 17:27:33.189369 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db25d6a-996e-43dc-a72f-1e1233319ebf None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:33.329623 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db25d6a-996e-43dc-a72f-1e1233319ebf None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:33.346325 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:33.372642 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b96298-8dcf-4f2c-b922-4e032a3e0a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:33.373482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b96298-8dcf-4f2c-b922-4e032a3e0a0c None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:33.373770 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b96298-8dcf-4f2c-b922-4e032a3e0a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:33.374103 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b96298-8dcf-4f2c-b922-4e032a3e0a0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:33.387832 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b96298-8dcf-4f2c-b922-4e032a3e0a0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:33.389366 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b96298-8dcf-4f2c-b922-4e032a3e0a0c None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:33.416053 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-38b96298-8dcf-4f2c-b922-4e032a3e0a0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:27:33.416053 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:27:33.416053 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:27:33.416053 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:27:33.416053 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:27:33.416053 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:27:33.416053 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:27:33.416053 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:27:33.416053 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:27:33.416053 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:27:33.416053 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:27:33.416053 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:27:33.416053 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:27:33.416053 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:27:33.416053 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:27:33.417167 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:27:33.417167 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:27:33.417167 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:27:33.417167 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:27:33.417167 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:27:33.417167 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:27:33.417167 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:27:33.417167 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:27:33.417167 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:27:33.417167 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:27:33.417167 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:27:33.417167 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:27:33.417167 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:27:33.417167 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:27:33.417167 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:27:33.417167 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:27:33.417167 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:27:33.418568 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:27:33.418568 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:27:33.418568 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:27:33.418568 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:27:33.418568 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 633/1256] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:27:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:27:33.427844 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e80aa50-9042-4c4a-a17c-317451907b60 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:33.550420 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:33.566099 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e80aa50-9042-4c4a-a17c-317451907b60 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:33.611301 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0442580e-c13e-4adb-a07e-f9409705ec52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:33.612026 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442580e-c13e-4adb-a07e-f9409705ec52 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:33.612260 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442580e-c13e-4adb-a07e-f9409705ec52 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:33.612580 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442580e-c13e-4adb-a07e-f9409705ec52 None admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:33.613670 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0442580e-c13e-4adb-a07e-f9409705ec52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:27:33.614159 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0442580e-c13e-4adb-a07e-f9409705ec52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:33.616302 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0442580e-c13e-4adb-a07e-f9409705ec52 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:33.630932 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 624/1257] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:27:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:27:33.638238 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b96298-8dcf-4f2c-b922-4e032a3e0a0c None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:33.758127 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b96298-8dcf-4f2c-b922-4e032a3e0a0c None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:33.795518 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56208b92-2053-4676-8179-5f1d16da5e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:33.796501 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56208b92-2053-4676-8179-5f1d16da5e9f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:33.797247 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56208b92-2053-4676-8179-5f1d16da5e9f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:33.797619 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56208b92-2053-4676-8179-5f1d16da5e9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:33.805527 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56208b92-2053-4676-8179-5f1d16da5e9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:33.807153 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56208b92-2053-4676-8179-5f1d16da5e9f None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:33.823021 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-56208b92-2053-4676-8179-5f1d16da5e9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:27:33.823021 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:27:33.823021 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:27:33.823021 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:27:33.823021 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:27:33.823021 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:27:33.823021 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:27:33.823021 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:27:33.823021 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:27:33.823021 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:27:33.823021 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:27:33.823021 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:27:33.823021 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 17:27:33.823021 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 17:27:33.823021 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 17:27:33.824364 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 17:27:33.824364 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:27:33.824364 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:27:33.824364 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:27:33.824364 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:27:33.824364 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:27:33.824364 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:27:33.824364 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:27:33.824364 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:27:33.824364 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:27:33.824364 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:27:33.824364 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:27:33.824364 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:27:33.824364 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:27:33.824364 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:27:33.824364 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:27:33.824364 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:27:33.825466 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 17:27:33.825466 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 17:27:33.825466 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 17:27:33.825466 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 17:27:33.825466 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 17:27:33.825466 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 17:27:33.825466 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:27:33.825466 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:27:33.825466 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 634/1258] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:27:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:27:33.832319 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0442580e-c13e-4adb-a07e-f9409705ec52 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:33.948344 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0442580e-c13e-4adb-a07e-f9409705ec52 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:33.995162 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0342a3c6-499a-44cb-afad-f91578f83df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:33.995829 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342a3c6-499a-44cb-afad-f91578f83df8 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:33.996105 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342a3c6-499a-44cb-afad-f91578f83df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:33.996373 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342a3c6-499a-44cb-afad-f91578f83df8 None admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:33.997164 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0342a3c6-499a-44cb-afad-f91578f83df8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:27:33.998741 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0342a3c6-499a-44cb-afad-f91578f83df8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:33.998912 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0342a3c6-499a-44cb-afad-f91578f83df8 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:34.012480 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 625/1259] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jul 15 17:27:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:27:34.018875 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56208b92-2053-4676-8179-5f1d16da5e9f None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:34.048334 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:34.148068 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56208b92-2053-4676-8179-5f1d16da5e9f None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:34.185343 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889954a-2bbd-465f-9ecd-8f947de3704d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:34.186055 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889954a-2bbd-465f-9ecd-8f947de3704d None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:34.186417 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889954a-2bbd-465f-9ecd-8f947de3704d None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:34.186695 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889954a-2bbd-465f-9ecd-8f947de3704d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:34.187658 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9889954a-2bbd-465f-9ecd-8f947de3704d None admin] RBAC: Adding query filter params (role.id=70d242b29ede4648b639c7ddae5eaead, scope.project.id=19cc5221b8074f48b5f73dc9c4289b03, user.id=96b2105f8d29443383ed51a8fd5cec6e) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:27:34.188042 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9889954a-2bbd-465f-9ecd-8f947de3704d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:34.189718 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9889954a-2bbd-465f-9ecd-8f947de3704d None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:34.195947 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 635/1260] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jul 15 17:27:34 2022] GET /identity/v3/role_assignments?user.id=96b2105f8d29443383ed51a8fd5cec6e&scope.project.id=19cc5221b8074f48b5f73dc9c4289b03&role.id=70d242b29ede4648b639c7ddae5eaead => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:27:36.226283 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e5de0-f783-44e1-bc0b-d30969a151c3 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:36.226884 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e5de0-f783-44e1-bc0b-d30969a151c3 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:36.226884 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e5de0-f783-44e1-bc0b-d30969a151c3 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:36.228215 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 626/1261] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:27:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:27:36.233827 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f33a7e-8d05-4aa9-80d6-2d816515e738 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:36.234285 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f33a7e-8d05-4aa9-80d6-2d816515e738 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:36.234373 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f33a7e-8d05-4aa9-80d6-2d816515e738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:36.252180 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-a8f33a7e-8d05-4aa9-80d6-2d816515e738 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:27:36.253364 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a8f33a7e-8d05-4aa9-80d6-2d816515e738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:27:36.324723 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 636/1262] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:27:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 17:27:36.347147 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e5de0-f783-44e1-bc0b-d30969a151c3 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:36.358451 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:36.451129 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e5de0-f783-44e1-bc0b-d30969a151c3 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:36.486783 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1207c64-431b-4a1f-83ea-a82dddf257fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:36.487514 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1207c64-431b-4a1f-83ea-a82dddf257fb None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:36.487779 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1207c64-431b-4a1f-83ea-a82dddf257fb None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:36.488051 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1207c64-431b-4a1f-83ea-a82dddf257fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:36.498796 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1207c64-431b-4a1f-83ea-a82dddf257fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:27:36.506462 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-f1207c64-431b-4a1f-83ea-a82dddf257fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:27:36.506462 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:27:36.506462 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:27:36.506462 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:27:36.506462 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:27:36.506462 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:27:36.506462 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:27:36.506462 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:27:36.506462 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:27:36.506462 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:27:36.506462 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:27:36.506462 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:27:36.506462 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:27:36.506462 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:27:36.506462 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:27:36.506462 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:27:36.507690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:27:36.507690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:27:36.507690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:27:36.507690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:27:36.507690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:27:36.507690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:27:36.507690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:27:36.507690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:27:36.507690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:27:36.507690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:27:36.507690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:27:36.507690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:27:36.507690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:27:36.507690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:27:36.507690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:27:36.507690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:27:36.508668 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:27:36.508668 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:27:36.508668 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:27:36.508668 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:27:36.508668 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:27:36.508668 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:27:36.508668 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:27:36.508668 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:27:36.508668 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:27:36.508668 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:27:36.508668 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:27:36.508668 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:27:36.508668 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 627/1263] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jul 15 17:27:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:27:36.514382 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f33a7e-8d05-4aa9-80d6-2d816515e738 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:36.534389 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:36.617382 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f33a7e-8d05-4aa9-80d6-2d816515e738 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:36.652211 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a9fda-0b12-4f1a-a82d-ec7f001b06ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:36.652861 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a9fda-0b12-4f1a-a82d-ec7f001b06ed None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:36.653137 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a9fda-0b12-4f1a-a82d-ec7f001b06ed None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:36.653405 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a9fda-0b12-4f1a-a82d-ec7f001b06ed None admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:36.654170 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a9fda-0b12-4f1a-a82d-ec7f001b06ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:27:36.654469 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a9fda-0b12-4f1a-a82d-ec7f001b06ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:36.655801 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a9fda-0b12-4f1a-a82d-ec7f001b06ed None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:36.664115 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 637/1264] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:27:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:27:36.672925 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1207c64-431b-4a1f-83ea-a82dddf257fb None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:36.745994 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:36.780206 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1207c64-431b-4a1f-83ea-a82dddf257fb None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:36.814657 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d052e7-e5e5-4461-8230-baf0c4f0c357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:36.815446 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d052e7-e5e5-4461-8230-baf0c4f0c357 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:36.815728 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d052e7-e5e5-4461-8230-baf0c4f0c357 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:36.815997 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d052e7-e5e5-4461-8230-baf0c4f0c357 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:36.828336 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d052e7-e5e5-4461-8230-baf0c4f0c357 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:36.829803 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d052e7-e5e5-4461-8230-baf0c4f0c357 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:36.848805 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-33d052e7-e5e5-4461-8230-baf0c4f0c357 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:27:36.848805 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:27:36.848805 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:27:36.848805 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:27:36.848805 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:27:36.848805 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:27:36.848805 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:27:36.848805 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:27:36.848805 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:27:36.848805 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:27:36.848805 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:27:36.848805 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:27:36.848805 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:27:36.848805 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:27:36.848805 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:27:36.849840 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:27:36.849840 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:27:36.849840 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:27:36.849840 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:27:36.849840 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:27:36.849840 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:27:36.849840 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:27:36.849840 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:27:36.849840 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:27:36.849840 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:27:36.849840 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:27:36.849840 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:27:36.849840 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:27:36.849840 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:27:36.849840 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:27:36.849840 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:27:36.849840 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:27:36.851320 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:27:36.851320 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:27:36.851320 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:27:36.851320 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:27:36.851320 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 628/1265] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:27:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:27:36.859382 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a9fda-0b12-4f1a-a82d-ec7f001b06ed None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:36.951799 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:36.976829 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a9fda-0b12-4f1a-a82d-ec7f001b06ed None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:37.012551 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4171ea-78cf-4f6c-9038-d605acad025f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:37.013135 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4171ea-78cf-4f6c-9038-d605acad025f None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:37.013417 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4171ea-78cf-4f6c-9038-d605acad025f None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:37.013691 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4171ea-78cf-4f6c-9038-d605acad025f None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:37.014449 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4171ea-78cf-4f6c-9038-d605acad025f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:27:37.014757 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4171ea-78cf-4f6c-9038-d605acad025f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:37.016098 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4171ea-78cf-4f6c-9038-d605acad025f None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:37.027921 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 638/1266] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:27:37.034504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d052e7-e5e5-4461-8230-baf0c4f0c357 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:37.155677 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d052e7-e5e5-4461-8230-baf0c4f0c357 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:37.175886 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:37.191755 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa93bed-0b56-4aa6-8b70-c0dbf85bdb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:37.192555 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa93bed-0b56-4aa6-8b70-c0dbf85bdb18 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:37.192827 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa93bed-0b56-4aa6-8b70-c0dbf85bdb18 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:37.193099 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa93bed-0b56-4aa6-8b70-c0dbf85bdb18 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:37.200722 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa93bed-0b56-4aa6-8b70-c0dbf85bdb18 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:37.202468 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa93bed-0b56-4aa6-8b70-c0dbf85bdb18 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:37.216951 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-ffa93bed-0b56-4aa6-8b70-c0dbf85bdb18 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 17:27:37.216951 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:27:37.216951 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:27:37.216951 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:27:37.216951 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:27:37.216951 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:27:37.216951 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:27:37.216951 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:27:37.216951 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:27:37.216951 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:27:37.216951 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:27:37.216951 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:27:37.216951 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 17:27:37.216951 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 17:27:37.216951 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 17:27:37.216951 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 17:27:37.218050 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:27:37.218050 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:27:37.218050 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 17:27:37.218050 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:27:37.218050 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 17:27:37.218050 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:27:37.218050 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:27:37.218050 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:27:37.218050 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:27:37.218050 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:27:37.218050 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:27:37.218050 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:27:37.218050 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:27:37.218050 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:27:37.218050 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:27:37.218050 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:27:37.218050 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:27:37.218050 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:27:37.219381 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:27:37.219381 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:27:37.219381 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 17:27:37.219381 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 17:27:37.219381 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 17:27:37.219381 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 17:27:37.219381 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 17:27:37.219381 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 17:27:37.219381 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 17:27:37.219381 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:27:37.219381 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 629/1267] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:27:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:27:37.224287 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4171ea-78cf-4f6c-9038-d605acad025f None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:37.340050 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4171ea-78cf-4f6c-9038-d605acad025f None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:37.377027 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a53d81-1c88-42df-8fe0-92654a22d470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:37.377691 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a53d81-1c88-42df-8fe0-92654a22d470 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:37.378014 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a53d81-1c88-42df-8fe0-92654a22d470 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:37.378290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a53d81-1c88-42df-8fe0-92654a22d470 None admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:37.379129 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a53d81-1c88-42df-8fe0-92654a22d470 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:27:37.379435 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a53d81-1c88-42df-8fe0-92654a22d470 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:37.380876 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a53d81-1c88-42df-8fe0-92654a22d470 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:37.389564 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:37.402889 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 639/1268] 10.222.0.27 () {56 vars in 1143 bytes} [Fri Jul 15 17:27:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:27:37.411788 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa93bed-0b56-4aa6-8b70-c0dbf85bdb18 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:37.519086 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa93bed-0b56-4aa6-8b70-c0dbf85bdb18 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:37.554153 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68e454-d4a7-45ca-bd32-b9b421334b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:37.554940 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68e454-d4a7-45ca-bd32-b9b421334b2e None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:37.555214 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68e454-d4a7-45ca-bd32-b9b421334b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:37.555480 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68e454-d4a7-45ca-bd32-b9b421334b2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:37.567249 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b68e454-d4a7-45ca-bd32-b9b421334b2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:37.568613 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b68e454-d4a7-45ca-bd32-b9b421334b2e None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:37.586026 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-6b68e454-d4a7-45ca-bd32-b9b421334b2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:27:37.586026 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:27:37.586026 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:27:37.586026 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:27:37.586026 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:27:37.586026 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:27:37.586026 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:27:37.586026 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:27:37.586026 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:27:37.586026 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:27:37.586026 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:27:37.586026 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:27:37.586026 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:27:37.586026 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:27:37.586026 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:27:37.587042 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:27:37.587042 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:27:37.587042 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:27:37.587042 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:27:37.587042 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:27:37.587042 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:27:37.587042 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:27:37.587042 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:27:37.587042 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:27:37.587042 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:27:37.587042 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:27:37.587042 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:27:37.587042 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:27:37.587042 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:27:37.587042 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:27:37.587042 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:27:37.587042 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:27:37.592983 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:27:37.592983 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:27:37.592983 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:27:37.592983 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:27:37.592983 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 630/1269] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:27:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:27:37.593331 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a53d81-1c88-42df-8fe0-92654a22d470 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:37.700415 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a53d81-1c88-42df-8fe0-92654a22d470 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:37.736248 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7901f2c-d9ca-4e4f-b21e-4b0c7a385457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:37.736890 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7901f2c-d9ca-4e4f-b21e-4b0c7a385457 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:37.737169 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7901f2c-d9ca-4e4f-b21e-4b0c7a385457 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:37.737440 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7901f2c-d9ca-4e4f-b21e-4b0c7a385457 None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:37.738189 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7901f2c-d9ca-4e4f-b21e-4b0c7a385457 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:27:37.738494 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7901f2c-d9ca-4e4f-b21e-4b0c7a385457 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:37.739848 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7901f2c-d9ca-4e4f-b21e-4b0c7a385457 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:37.751145 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 640/1270] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:27:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:27:37.757716 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68e454-d4a7-45ca-bd32-b9b421334b2e None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:37.798156 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:37.869821 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68e454-d4a7-45ca-bd32-b9b421334b2e None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:37.905206 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac16a1c-3ceb-4b8d-a94b-644f7646485d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:37.906162 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac16a1c-3ceb-4b8d-a94b-644f7646485d None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:37.906397 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac16a1c-3ceb-4b8d-a94b-644f7646485d None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:37.906608 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac16a1c-3ceb-4b8d-a94b-644f7646485d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:37.913550 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac16a1c-3ceb-4b8d-a94b-644f7646485d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:37.915036 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac16a1c-3ceb-4b8d-a94b-644f7646485d None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:37.930630 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-5ac16a1c-3ceb-4b8d-a94b-644f7646485d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:27:37.930630 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:27:37.930630 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:27:37.930630 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:27:37.930630 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:27:37.930630 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:27:37.930630 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:27:37.930630 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:27:37.930630 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:27:37.930630 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:27:37.930630 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:27:37.930630 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:27:37.930630 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 17:27:37.930630 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 17:27:37.930630 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 17:27:37.931607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 17:27:37.931607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:27:37.931607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:27:37.931607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:27:37.931607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:27:37.931607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:27:37.931607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:27:37.931607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:27:37.931607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:27:37.931607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:27:37.931607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:27:37.931607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:27:37.931607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:27:37.931607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:27:37.931607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:27:37.931607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:27:37.931607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:27:37.933031 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 17:27:37.933031 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 17:27:37.933031 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 17:27:37.933031 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 17:27:37.933031 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 17:27:37.933031 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 17:27:37.933031 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:27:37.933031 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:27:37.933031 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 631/1271] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:27:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:27:37.941435 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7901f2c-d9ca-4e4f-b21e-4b0c7a385457 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:38.013355 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:38.056687 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7901f2c-d9ca-4e4f-b21e-4b0c7a385457 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:38.098735 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc14883-93d6-4a10-a671-274e57a147bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:38.099397 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc14883-93d6-4a10-a671-274e57a147bf None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:38.099678 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc14883-93d6-4a10-a671-274e57a147bf None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:38.099954 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc14883-93d6-4a10-a671-274e57a147bf None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:38.101179 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc14883-93d6-4a10-a671-274e57a147bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:27:38.101773 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc14883-93d6-4a10-a671-274e57a147bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:38.104765 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc14883-93d6-4a10-a671-274e57a147bf None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:38.128849 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 641/1272] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jul 15 17:27:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:27:38.134950 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac16a1c-3ceb-4b8d-a94b-644f7646485d None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:38.231857 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:38.242990 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac16a1c-3ceb-4b8d-a94b-644f7646485d None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:38.281507 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1fd05-d877-4ea0-933c-97b5ffd75b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:38.282419 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1fd05-d877-4ea0-933c-97b5ffd75b17 None admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:38.282702 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1fd05-d877-4ea0-933c-97b5ffd75b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:38.282973 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1fd05-d877-4ea0-933c-97b5ffd75b17 None admin] PATH_INFO: `/v3/projects/19cc5221b8074f48b5f73dc9c4289b03/users/96b2105f8d29443383ed51a8fd5cec6e/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:38.284882 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c1fd05-d877-4ea0-933c-97b5ffd75b17 None admin] RBAC: Authorizing `identity:create_grant(project_id=19cc5221b8074f48b5f73dc9c4289b03, user_id=96b2105f8d29443383ed51a8fd5cec6e, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:38.286342 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c1fd05-d877-4ea0-933c-97b5ffd75b17 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:38.301926 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 632/1273] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Jul 15 17:27:38 2022] PUT /identity/v3/projects/19cc5221b8074f48b5f73dc9c4289b03/users/96b2105f8d29443383ed51a8fd5cec6e/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:27:40.259425 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2290389-b1fb-4040-9c63-f2c70910543c None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:40.260291 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2290389-b1fb-4040-9c63-f2c70910543c None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:40.260291 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2290389-b1fb-4040-9c63-f2c70910543c None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:40.262491 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 642/1274] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:27:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:27:40.268872 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3207fd9-db3d-4b16-93a1-cded7190d891 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:40.269634 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3207fd9-db3d-4b16-93a1-cded7190d891 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:40.269836 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3207fd9-db3d-4b16-93a1-cded7190d891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:40.290056 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-f3207fd9-db3d-4b16-93a1-cded7190d891 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:27:40.291267 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-f3207fd9-db3d-4b16-93a1-cded7190d891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:27:40.361533 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 633/1275] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:27:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:27:40.385553 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2290389-b1fb-4040-9c63-f2c70910543c None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:40.500741 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2290389-b1fb-4040-9c63-f2c70910543c None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:40.518682 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:40.543850 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b17b271-5c9b-4e8d-818f-a79e22ef6024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:40.544637 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17b271-5c9b-4e8d-818f-a79e22ef6024 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:40.544918 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17b271-5c9b-4e8d-818f-a79e22ef6024 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:40.545184 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17b271-5c9b-4e8d-818f-a79e22ef6024 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:40.556372 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b17b271-5c9b-4e8d-818f-a79e22ef6024 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 17:27:40.564018 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-3b17b271-5c9b-4e8d-818f-a79e22ef6024 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:27:40.564018 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:27:40.564018 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:27:40.564018 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:27:40.564018 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:27:40.564018 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:27:40.564018 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:27:40.564018 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:27:40.564018 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:27:40.564018 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:27:40.564018 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:27:40.564018 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:27:40.564018 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 17:27:40.564018 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 17:27:40.564018 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 17:27:40.564018 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 17:27:40.565035 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 17:27:40.565035 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 17:27:40.565035 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 17:27:40.565035 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 17:27:40.565035 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:27:40.565035 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:27:40.565035 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:27:40.565035 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:27:40.565035 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:27:40.565035 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:27:40.565035 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:27:40.565035 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:27:40.565035 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:27:40.565035 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:27:40.565035 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:27:40.565035 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:27:40.565952 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:27:40.565952 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:27:40.565952 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:27:40.565952 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:27:40.565952 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 17:27:40.565952 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 17:27:40.565952 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 17:27:40.565952 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 17:27:40.565952 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 17:27:40.565952 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 17:27:40.565952 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 17:27:40.565952 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:27:40.565952 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 643/1276] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Jul 15 17:27:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:27:40.572964 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3207fd9-db3d-4b16-93a1-cded7190d891 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:40.657356 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:40.681664 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3207fd9-db3d-4b16-93a1-cded7190d891 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:40.718218 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617292b-320e-428b-8081-bdff3f950a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:40.718877 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617292b-320e-428b-8081-bdff3f950a8e None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:40.719149 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617292b-320e-428b-8081-bdff3f950a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:40.719417 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617292b-320e-428b-8081-bdff3f950a8e None admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:40.720158 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617292b-320e-428b-8081-bdff3f950a8e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:27:40.720459 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617292b-320e-428b-8081-bdff3f950a8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:40.721826 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617292b-320e-428b-8081-bdff3f950a8e None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:40.730089 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 634/1277] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Jul 15 17:27:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:27:40.736634 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b17b271-5c9b-4e8d-818f-a79e22ef6024 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:40.845122 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b17b271-5c9b-4e8d-818f-a79e22ef6024 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:40.880660 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54099e98-c18c-48d9-92b2-3283be0483ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:40.881444 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54099e98-c18c-48d9-92b2-3283be0483ab None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:40.881725 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54099e98-c18c-48d9-92b2-3283be0483ab None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:40.882055 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54099e98-c18c-48d9-92b2-3283be0483ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:40.893039 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54099e98-c18c-48d9-92b2-3283be0483ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:40.894537 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54099e98-c18c-48d9-92b2-3283be0483ab None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:40.912014 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-54099e98-c18c-48d9-92b2-3283be0483ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:27:40.912014 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:27:40.912014 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:27:40.912014 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:27:40.912014 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:27:40.912014 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:27:40.912014 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:27:40.912014 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:27:40.912014 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:27:40.912014 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:27:40.912014 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:27:40.912014 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:27:40.912014 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:27:40.912014 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:27:40.912014 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:27:40.913205 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:27:40.913205 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:27:40.913205 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:27:40.913205 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:27:40.913205 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:27:40.913205 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:27:40.913205 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:27:40.913205 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:27:40.913205 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:27:40.913205 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:27:40.913205 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:27:40.913205 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:27:40.913205 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:27:40.913205 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:27:40.913205 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:27:40.913205 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:27:40.913205 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:27:40.914118 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:27:40.914118 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:27:40.914118 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:27:40.914118 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:27:40.914118 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 644/1278] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:27:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:27:40.922017 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617292b-320e-428b-8081-bdff3f950a8e None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:41.028954 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617292b-320e-428b-8081-bdff3f950a8e None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:41.065428 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c18d1-bc37-478f-b7e7-83de09507c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:41.066115 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c18d1-bc37-478f-b7e7-83de09507c40 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:41.066391 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c18d1-bc37-478f-b7e7-83de09507c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:41.066662 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c18d1-bc37-478f-b7e7-83de09507c40 None admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:41.067426 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c18d1-bc37-478f-b7e7-83de09507c40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:27:41.067673 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c18d1-bc37-478f-b7e7-83de09507c40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:41.069131 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c18d1-bc37-478f-b7e7-83de09507c40 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:41.082880 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 635/1279] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:27:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:27:41.089927 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54099e98-c18c-48d9-92b2-3283be0483ab None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:41.123843 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:41.198591 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54099e98-c18c-48d9-92b2-3283be0483ab None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:41.232865 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d028ed6-a7ad-450e-b16a-3bd81758c6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:41.233668 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d028ed6-a7ad-450e-b16a-3bd81758c6f6 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:41.233978 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d028ed6-a7ad-450e-b16a-3bd81758c6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:41.234253 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d028ed6-a7ad-450e-b16a-3bd81758c6f6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:41.241724 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d028ed6-a7ad-450e-b16a-3bd81758c6f6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:41.243269 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d028ed6-a7ad-450e-b16a-3bd81758c6f6 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:41.257813 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-4d028ed6-a7ad-450e-b16a-3bd81758c6f6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 17:27:41.257813 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:27:41.257813 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:27:41.257813 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:27:41.257813 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:27:41.257813 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:27:41.257813 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:27:41.257813 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:27:41.257813 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:27:41.257813 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:27:41.257813 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:27:41.257813 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:27:41.257813 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 17:27:41.257813 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 17:27:41.257813 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 17:27:41.257813 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 17:27:41.258862 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:27:41.258862 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:27:41.258862 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 17:27:41.258862 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:27:41.258862 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 17:27:41.258862 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 17:27:41.258862 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:27:41.258862 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:27:41.258862 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:27:41.258862 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:27:41.258862 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:27:41.258862 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:27:41.258862 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:27:41.258862 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:27:41.258862 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:27:41.258862 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:27:41.258862 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:27:41.258862 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:27:41.260406 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:27:41.260406 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:27:41.260406 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 17:27:41.260406 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 17:27:41.260406 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 17:27:41.260406 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 17:27:41.260406 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 17:27:41.260406 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 17:27:41.260406 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 17:27:41.260406 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:27:41.260406 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 645/1280] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:27:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:27:41.265208 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c18d1-bc37-478f-b7e7-83de09507c40 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:41.269194 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:41.379960 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c18d1-bc37-478f-b7e7-83de09507c40 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:41.415739 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36122ff5-bcf6-4925-8901-7ed0703915d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:41.416392 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36122ff5-bcf6-4925-8901-7ed0703915d2 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:41.416672 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36122ff5-bcf6-4925-8901-7ed0703915d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:41.416943 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36122ff5-bcf6-4925-8901-7ed0703915d2 None admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:41.417773 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36122ff5-bcf6-4925-8901-7ed0703915d2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:27:41.418109 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36122ff5-bcf6-4925-8901-7ed0703915d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:41.419520 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36122ff5-bcf6-4925-8901-7ed0703915d2 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:41.436836 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 636/1281] 10.222.0.27 () {56 vars in 1143 bytes} [Fri Jul 15 17:27:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:27:41.442902 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d028ed6-a7ad-450e-b16a-3bd81758c6f6 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:41.544671 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:41.554630 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d028ed6-a7ad-450e-b16a-3bd81758c6f6 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:41.589748 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da3575-17de-4507-a2ff-25101db072d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:41.590399 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da3575-17de-4507-a2ff-25101db072d7 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:41.590673 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da3575-17de-4507-a2ff-25101db072d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:41.590942 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da3575-17de-4507-a2ff-25101db072d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:41.658374 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da3575-17de-4507-a2ff-25101db072d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:41.659752 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da3575-17de-4507-a2ff-25101db072d7 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:41.749078 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:41.765806 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 646/1282] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Jul 15 17:27:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 17:27:41.772456 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36122ff5-bcf6-4925-8901-7ed0703915d2 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:41.838077 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:41.879766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36122ff5-bcf6-4925-8901-7ed0703915d2 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:41.927065 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755dcc3d-1540-459d-9f8d-a530da58135e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:41.927916 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755dcc3d-1540-459d-9f8d-a530da58135e None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:41.928201 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755dcc3d-1540-459d-9f8d-a530da58135e None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:41.928528 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755dcc3d-1540-459d-9f8d-a530da58135e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:41.940095 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755dcc3d-1540-459d-9f8d-a530da58135e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:41.941537 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755dcc3d-1540-459d-9f8d-a530da58135e None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:41.959603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-755dcc3d-1540-459d-9f8d-a530da58135e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:27:41.959603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:27:41.959603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:27:41.959603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:27:41.959603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:27:41.959603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:27:41.959603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:27:41.959603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:27:41.959603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:27:41.959603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:27:41.959603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:27:41.959603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:27:41.959603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 17:27:41.959603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 17:27:41.959603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 17:27:41.960777 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 17:27:41.960777 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:27:41.960777 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:27:41.960777 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:27:41.960777 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:27:41.960777 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:27:41.960777 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:27:41.960777 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:27:41.960777 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:27:41.960777 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:27:41.960777 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:27:41.960777 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:27:41.960777 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:27:41.960777 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:27:41.960777 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:27:41.960777 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:27:41.960777 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:27:41.961677 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 17:27:41.961677 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 17:27:41.961677 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 17:27:41.961677 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:27:41.961677 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 637/1283] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:27:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:27:41.968065 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da3575-17de-4507-a2ff-25101db072d7 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:42.094298 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da3575-17de-4507-a2ff-25101db072d7 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:42.129818 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ebd79-3ab1-4178-bf87-6b7762c12a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:42.130520 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ebd79-3ab1-4178-bf87-6b7762c12a2a None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:42.130802 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ebd79-3ab1-4178-bf87-6b7762c12a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:42.131081 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ebd79-3ab1-4178-bf87-6b7762c12a2a None admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:42.131808 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ebd79-3ab1-4178-bf87-6b7762c12a2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:27:42.132159 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ebd79-3ab1-4178-bf87-6b7762c12a2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:42.133588 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ebd79-3ab1-4178-bf87-6b7762c12a2a None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:42.145815 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 647/1284] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Jul 15 17:27:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:27:42.152105 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755dcc3d-1540-459d-9f8d-a530da58135e None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:42.274931 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755dcc3d-1540-459d-9f8d-a530da58135e None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:42.288702 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:42.311120 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a15efc5-e5f6-4927-aedc-79a4336b2451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:42.311916 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15efc5-e5f6-4927-aedc-79a4336b2451 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:42.312192 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15efc5-e5f6-4927-aedc-79a4336b2451 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:42.312940 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15efc5-e5f6-4927-aedc-79a4336b2451 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:42.319859 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a15efc5-e5f6-4927-aedc-79a4336b2451 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:42.321407 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a15efc5-e5f6-4927-aedc-79a4336b2451 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:42.336081 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application [None req-4a15efc5-e5f6-4927-aedc-79a4336b2451 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:27:42.336081 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:27:42.336081 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:27:42.336081 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:27:42.336081 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:27:42.336081 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:27:42.336081 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:27:42.336081 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:27:42.336081 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:27:42.336081 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:27:42.336081 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:27:42.336081 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:27:42.336081 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 17:27:42.336081 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 17:27:42.336081 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 17:27:42.337070 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 17:27:42.337070 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:27:42.337070 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:27:42.337070 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:27:42.337070 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:27:42.337070 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:27:42.337070 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:27:42.337070 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:27:42.337070 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application with Lock( Jul 15 17:27:42.337070 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:27:42.337070 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:27:42.337070 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:27:42.337070 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:27:42.337070 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:27:42.337070 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:27:42.337070 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:27:42.337070 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:27:42.342744 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 17:27:42.342744 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 17:27:42.342744 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 17:27:42.342744 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 17:27:42.342744 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 17:27:42.342744 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 17:27:42.342744 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 17:27:42.342744 dv-cinder-836973-11-smb devstack@keystone.service[80150]: ERROR keystone.server.flask.application Jul 15 17:27:42.342744 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 638/1285] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Jul 15 17:27:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:27:42.343310 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ebd79-3ab1-4178-bf87-6b7762c12a2a None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:42.393768 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:42.447804 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ebd79-3ab1-4178-bf87-6b7762c12a2a None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:42.495539 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce716a92-a086-44d5-8e20-bfef3f483186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:42.496187 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce716a92-a086-44d5-8e20-bfef3f483186 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:42.496469 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce716a92-a086-44d5-8e20-bfef3f483186 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:42.496741 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce716a92-a086-44d5-8e20-bfef3f483186 None admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:42.497519 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce716a92-a086-44d5-8e20-bfef3f483186 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:27:42.497824 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce716a92-a086-44d5-8e20-bfef3f483186 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:42.499277 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce716a92-a086-44d5-8e20-bfef3f483186 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:42.511841 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 648/1286] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Jul 15 17:27:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:27:42.518155 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a15efc5-e5f6-4927-aedc-79a4336b2451 None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:42.630730 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a15efc5-e5f6-4927-aedc-79a4336b2451 None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:42.666485 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374acc0-bf23-4d92-ae96-14825d37b6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:42.667130 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374acc0-bf23-4d92-ae96-14825d37b6fd None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:42.667410 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374acc0-bf23-4d92-ae96-14825d37b6fd None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:42.667682 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374acc0-bf23-4d92-ae96-14825d37b6fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:42.668506 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4374acc0-bf23-4d92-ae96-14825d37b6fd None admin] RBAC: Adding query filter params (role.id=70d242b29ede4648b639c7ddae5eaead, scope.project.id=19cc5221b8074f48b5f73dc9c4289b03, user.id=96b2105f8d29443383ed51a8fd5cec6e) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:27:42.668815 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4374acc0-bf23-4d92-ae96-14825d37b6fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:42.670269 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4374acc0-bf23-4d92-ae96-14825d37b6fd None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:42.676168 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 639/1287] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Jul 15 17:27:42 2022] GET /identity/v3/role_assignments?user.id=96b2105f8d29443383ed51a8fd5cec6e&scope.project.id=19cc5221b8074f48b5f73dc9c4289b03&role.id=70d242b29ede4648b639c7ddae5eaead => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:27:44.693515 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b6613-eb3c-46b8-bf47-d15cd2f8d23e None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:44.694709 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b6613-eb3c-46b8-bf47-d15cd2f8d23e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:44.694709 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b6613-eb3c-46b8-bf47-d15cd2f8d23e None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:44.696503 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 649/1288] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:27:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:27:44.702283 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36c488-be11-46a7-afae-69ed7a04a922 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:44.702718 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36c488-be11-46a7-afae-69ed7a04a922 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:44.702823 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36c488-be11-46a7-afae-69ed7a04a922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:44.720599 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-8a36c488-be11-46a7-afae-69ed7a04a922 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:27:44.721809 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-8a36c488-be11-46a7-afae-69ed7a04a922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:27:44.752028 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:44.792916 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 640/1289] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:27:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:27:44.815509 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b6613-eb3c-46b8-bf47-d15cd2f8d23e None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:44.938877 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b6613-eb3c-46b8-bf47-d15cd2f8d23e None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:44.950634 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:44.976765 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97af189-61eb-4339-b7fb-d0b28aab6347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:44.977563 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97af189-61eb-4339-b7fb-d0b28aab6347 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:44.977860 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97af189-61eb-4339-b7fb-d0b28aab6347 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:44.978132 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97af189-61eb-4339-b7fb-d0b28aab6347 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:44.978777 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97af189-61eb-4339-b7fb-d0b28aab6347 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:44.980143 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97af189-61eb-4339-b7fb-d0b28aab6347 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:44.992349 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-a97af189-61eb-4339-b7fb-d0b28aab6347 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 17:27:44.992349 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:27:44.992349 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 17:27:44.992349 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 17:27:44.992349 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 17:27:44.992349 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 17:27:44.992349 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 17:27:44.992349 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:27:44.992349 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 17:27:44.992349 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:27:44.992349 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 17:27:44.992349 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:27:44.992349 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:27:44.992349 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:27:44.992349 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:27:44.992349 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:27:44.992349 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:27:44.997859 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:27:44.997859 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:27:44.997859 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:27:44.997859 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:27:44.997859 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:27:44.997859 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:27:44.997859 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 17:27:44.997859 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 17:27:44.997859 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 17:27:44.997859 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 17:27:44.997859 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:27:44.997859 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:27:44.997859 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:27:44.997859 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:27:44.997859 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:27:44.997859 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:27:44.999711 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:27:44.999711 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:27:44.999711 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:27:44.999711 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:27:44.999711 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:27:44.999711 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:27:44.999711 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:27:44.999711 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:27:44.999711 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:27:44.999711 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:27:44.999711 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 17:27:44.999711 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:27:44.999711 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 17:27:44.999711 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:27:44.999711 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 650/1290] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Jul 15 17:27:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:27:45.003670 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36c488-be11-46a7-afae-69ed7a04a922 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:45.113273 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36c488-be11-46a7-afae-69ed7a04a922 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:45.152208 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf2523-dfcb-4f8d-b480-b6eab07158d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:45.152979 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf2523-dfcb-4f8d-b480-b6eab07158d1 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:45.153353 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf2523-dfcb-4f8d-b480-b6eab07158d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:45.153691 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf2523-dfcb-4f8d-b480-b6eab07158d1 None admin] PATH_INFO: `/v3/services` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:45.154556 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf2523-dfcb-4f8d-b480-b6eab07158d1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:27:45.154893 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf2523-dfcb-4f8d-b480-b6eab07158d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:45.156566 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf2523-dfcb-4f8d-b480-b6eab07158d1 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:45.162540 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 641/1291] 10.222.0.27 () {56 vars in 1116 bytes} [Fri Jul 15 17:27:45 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:27:45.168498 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97af189-61eb-4339-b7fb-d0b28aab6347 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:45.288288 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97af189-61eb-4339-b7fb-d0b28aab6347 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:45.325924 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ebab83-cfa1-48c8-8aae-a3c6ae11e094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:45.326593 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ebab83-cfa1-48c8-8aae-a3c6ae11e094 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:45.326875 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ebab83-cfa1-48c8-8aae-a3c6ae11e094 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:45.327465 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ebab83-cfa1-48c8-8aae-a3c6ae11e094 None admin] PATH_INFO: `/v3/services` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:45.328165 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ebab83-cfa1-48c8-8aae-a3c6ae11e094 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:27:45.328466 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ebab83-cfa1-48c8-8aae-a3c6ae11e094 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:45.329816 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ebab83-cfa1-48c8-8aae-a3c6ae11e094 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:45.334644 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 651/1292] 10.222.0.27 () {56 vars in 1116 bytes} [Fri Jul 15 17:27:45 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:27:47.297547 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f9878-ce11-4167-b5d4-1c7bd1666120 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:47.298544 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f9878-ce11-4167-b5d4-1c7bd1666120 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:47.298544 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f9878-ce11-4167-b5d4-1c7bd1666120 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:47.300628 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 642/1293] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:27:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:27:47.308379 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a3bba-4737-4032-ae48-1c9432ca4942 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:47.308826 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a3bba-4737-4032-ae48-1c9432ca4942 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:47.308912 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a3bba-4737-4032-ae48-1c9432ca4942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:47.327368 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-1d1a3bba-4737-4032-ae48-1c9432ca4942 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:27:47.328546 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1d1a3bba-4737-4032-ae48-1c9432ca4942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:27:47.359211 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:47.400984 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 652/1294] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:27:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 17:27:47.423486 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f9878-ce11-4167-b5d4-1c7bd1666120 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:47.457894 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:47.532492 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f9878-ce11-4167-b5d4-1c7bd1666120 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:47.568855 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c88139e-1bc1-408b-930c-ca32b99cb353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:47.569541 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88139e-1bc1-408b-930c-ca32b99cb353 None admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:47.569883 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88139e-1bc1-408b-930c-ca32b99cb353 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:47.570107 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88139e-1bc1-408b-930c-ca32b99cb353 None admin] PATH_INFO: `/v3/services` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:47.570823 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c88139e-1bc1-408b-930c-ca32b99cb353 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:47.572163 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c88139e-1bc1-408b-930c-ca32b99cb353 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:47.589199 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 643/1295] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Jul 15 17:27:47 2022] POST /identity/v3/services => generated 246 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:27:49.601453 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ed0ff-2dfe-44ed-8fc1-21862a492108 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:49.602016 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ed0ff-2dfe-44ed-8fc1-21862a492108 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:49.602016 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ed0ff-2dfe-44ed-8fc1-21862a492108 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:49.603373 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 653/1296] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:27:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:27:49.609657 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118d52c-052f-4f4f-b7fc-27bf3f5cf7e1 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:49.610382 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118d52c-052f-4f4f-b7fc-27bf3f5cf7e1 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:49.610483 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118d52c-052f-4f4f-b7fc-27bf3f5cf7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:49.635993 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-1118d52c-052f-4f4f-b7fc-27bf3f5cf7e1 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:27:49.637164 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-1118d52c-052f-4f4f-b7fc-27bf3f5cf7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:27:49.725026 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 644/1297] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:27:49 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:27:49.747067 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ed0ff-2dfe-44ed-8fc1-21862a492108 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:49.854906 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ed0ff-2dfe-44ed-8fc1-21862a492108 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:49.890158 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24557660-e2b6-4ada-a5de-e68887a07166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:49.890941 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24557660-e2b6-4ada-a5de-e68887a07166 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:49.891216 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24557660-e2b6-4ada-a5de-e68887a07166 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:49.891481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24557660-e2b6-4ada-a5de-e68887a07166 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:49.892117 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24557660-e2b6-4ada-a5de-e68887a07166 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:49.893470 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24557660-e2b6-4ada-a5de-e68887a07166 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:49.905992 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-24557660-e2b6-4ada-a5de-e68887a07166 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 17:27:49.905992 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:27:49.905992 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 17:27:49.905992 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 17:27:49.905992 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 17:27:49.905992 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 17:27:49.905992 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 17:27:49.905992 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:27:49.905992 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 17:27:49.905992 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:27:49.905992 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 17:27:49.905992 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:27:49.905992 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:27:49.905992 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:27:49.905992 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:27:49.905992 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:27:49.905992 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:27:49.907170 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:27:49.907170 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:27:49.907170 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:27:49.907170 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:27:49.907170 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:27:49.907170 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:27:49.907170 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 17:27:49.907170 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 17:27:49.907170 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 17:27:49.907170 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 17:27:49.907170 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:27:49.907170 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:27:49.907170 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:27:49.907170 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:27:49.907170 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:27:49.907170 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:27:49.908078 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:27:49.908078 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:27:49.908078 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:27:49.908078 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:27:49.908078 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:27:49.908078 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:27:49.908078 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:27:49.908078 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:27:49.908078 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:27:49.908078 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:27:49.908078 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 17:27:49.908078 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:27:49.908078 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 17:27:49.908078 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:27:49.908078 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 654/1298] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Jul 15 17:27:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:27:49.915304 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118d52c-052f-4f4f-b7fc-27bf3f5cf7e1 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:49.940280 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:50.033453 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118d52c-052f-4f4f-b7fc-27bf3f5cf7e1 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:50.075503 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b42b3c-eb7c-42f1-925c-8105931c12aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:50.076178 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b42b3c-eb7c-42f1-925c-8105931c12aa None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:50.076467 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b42b3c-eb7c-42f1-925c-8105931c12aa None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:50.076750 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b42b3c-eb7c-42f1-925c-8105931c12aa None admin] PATH_INFO: `/v3/services` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:50.077929 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b42b3c-eb7c-42f1-925c-8105931c12aa None admin] RBAC: Adding query filter params (name=placement) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:27:50.078235 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b42b3c-eb7c-42f1-925c-8105931c12aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:50.079616 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b42b3c-eb7c-42f1-925c-8105931c12aa None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:50.085680 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 645/1299] 10.222.0.27 () {56 vars in 1116 bytes} [Fri Jul 15 17:27:49 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:27:50.092663 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24557660-e2b6-4ada-a5de-e68887a07166 None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:50.130163 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:50.200956 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24557660-e2b6-4ada-a5de-e68887a07166 None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:50.236462 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173190a7-7824-433a-aed8-28cf90ba0e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:50.237112 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173190a7-7824-433a-aed8-28cf90ba0e73 None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:50.237389 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173190a7-7824-433a-aed8-28cf90ba0e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:50.237662 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173190a7-7824-433a-aed8-28cf90ba0e73 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:50.238479 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173190a7-7824-433a-aed8-28cf90ba0e73 None admin] RBAC: Adding query filter params (interface=public, service_id=a40f8bf29e0c40e695e9ceabc4d12b73, region_id=RegionOne) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:27:50.238789 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173190a7-7824-433a-aed8-28cf90ba0e73 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:50.240160 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173190a7-7824-433a-aed8-28cf90ba0e73 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:50.245360 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 655/1300] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Jul 15 17:27:50 2022] GET /identity/v3/endpoints?service_id=a40f8bf29e0c40e695e9ceabc4d12b73&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:27:50.251806 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b42b3c-eb7c-42f1-925c-8105931c12aa None admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:50.340148 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:50.359969 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b42b3c-eb7c-42f1-925c-8105931c12aa None admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:50.395990 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa6e235-e311-425e-9cb9-2e592ba16019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:50.396586 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6e235-e311-425e-9cb9-2e592ba16019 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:50.396867 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6e235-e311-425e-9cb9-2e592ba16019 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:50.397162 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6e235-e311-425e-9cb9-2e592ba16019 None admin] PATH_INFO: `/v3/services` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:50.397998 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa6e235-e311-425e-9cb9-2e592ba16019 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:50.399375 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa6e235-e311-425e-9cb9-2e592ba16019 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:50.406323 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 646/1301] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Jul 15 17:27:50 2022] GET /identity/v3/services => generated 2191 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:27:52.382408 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547acbd-6d51-4288-87f8-0b55e18da02c None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:52.382955 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547acbd-6d51-4288-87f8-0b55e18da02c None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:52.382955 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547acbd-6d51-4288-87f8-0b55e18da02c None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:52.384381 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 656/1302] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:27:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:27:52.389709 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f4f76-0be6-4950-b723-46bebc652a29 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:52.390165 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f4f76-0be6-4950-b723-46bebc652a29 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:52.390267 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f4f76-0be6-4950-b723-46bebc652a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:52.408782 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-537f4f76-0be6-4950-b723-46bebc652a29 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:27:52.410000 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-537f4f76-0be6-4950-b723-46bebc652a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:27:52.478917 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 647/1303] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:27:52 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 17:27:52.502501 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547acbd-6d51-4288-87f8-0b55e18da02c None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:52.618762 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:52.626403 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547acbd-6d51-4288-87f8-0b55e18da02c None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:52.661948 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb6ea4-4e7b-443e-a446-3b02e68ef7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:52.663011 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb6ea4-4e7b-443e-a446-3b02e68ef7cb None admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:52.663617 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb6ea4-4e7b-443e-a446-3b02e68ef7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:52.663894 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb6ea4-4e7b-443e-a446-3b02e68ef7cb None admin] PATH_INFO: `/v3/services/placement` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:52.664545 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cb6ea4-4e7b-443e-a446-3b02e68ef7cb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:52.665934 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cb6ea4-4e7b-443e-a446-3b02e68ef7cb None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:52.678161 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application [None req-50cb6ea4-4e7b-443e-a446-3b02e68ef7cb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 17:27:52.678161 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:27:52.678161 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 17:27:52.678161 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 17:27:52.678161 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 17:27:52.678161 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 17:27:52.678161 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 17:27:52.678161 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:27:52.678161 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 17:27:52.678161 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:27:52.678161 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 17:27:52.678161 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:27:52.678161 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 17:27:52.678161 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 17:27:52.678161 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 17:27:52.678161 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 17:27:52.678161 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 17:27:52.679547 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 17:27:52.679547 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 17:27:52.679547 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 17:27:52.679547 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 17:27:52.679547 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 17:27:52.679547 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 17:27:52.679547 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 17:27:52.679547 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 17:27:52.679547 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 17:27:52.679547 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 17:27:52.679547 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 17:27:52.679547 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 17:27:52.679547 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 17:27:52.679547 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 17:27:52.679547 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 17:27:52.679547 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 17:27:52.680895 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 17:27:52.680895 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application with Lock( Jul 15 17:27:52.680895 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 17:27:52.680895 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self._enter() Jul 15 17:27:52.680895 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 17:27:52.680895 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 17:27:52.680895 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 17:27:52.680895 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application return self.creator() Jul 15 17:27:52.680895 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 17:27:52.680895 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application created_value = creator( Jul 15 17:27:52.680895 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 17:27:52.680895 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 17:27:52.680895 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 17:27:52.680895 dv-cinder-836973-11-smb devstack@keystone.service[80149]: ERROR keystone.server.flask.application Jul 15 17:27:52.680895 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 657/1304] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Jul 15 17:27:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 17:27:52.689836 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f4f76-0be6-4950-b723-46bebc652a29 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:52.782094 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:27:52.806899 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f4f76-0be6-4950-b723-46bebc652a29 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:52.842649 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127fb22-9499-4c70-9fac-88d94e97b4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:52.843317 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127fb22-9499-4c70-9fac-88d94e97b4f0 None admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:52.843594 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127fb22-9499-4c70-9fac-88d94e97b4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:52.843872 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127fb22-9499-4c70-9fac-88d94e97b4f0 None admin] PATH_INFO: `/v3/services` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:52.844585 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e127fb22-9499-4c70-9fac-88d94e97b4f0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:27:52.844886 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e127fb22-9499-4c70-9fac-88d94e97b4f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:52.846287 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e127fb22-9499-4c70-9fac-88d94e97b4f0 None admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:52.851830 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 648/1305] 10.222.0.27 () {56 vars in 1116 bytes} [Fri Jul 15 17:27:52 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:27:52.858362 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb6ea4-4e7b-443e-a446-3b02e68ef7cb None admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:27:52.963120 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb6ea4-4e7b-443e-a446-3b02e68ef7cb None admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:27:53.002293 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441298c-e28b-4f96-8ce0-b5cc628a0e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:27:53.002949 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441298c-e28b-4f96-8ce0-b5cc628a0e67 None admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:27:53.003237 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441298c-e28b-4f96-8ce0-b5cc628a0e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:27:53.003514 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441298c-e28b-4f96-8ce0-b5cc628a0e67 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:27:53.004255 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441298c-e28b-4f96-8ce0-b5cc628a0e67 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:27:53.005625 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441298c-e28b-4f96-8ce0-b5cc628a0e67 None admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:27:53.029410 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 658/1306] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Jul 15 17:27:52 2022] POST /identity/v3/endpoints => generated 331 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:28:02.848415 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=30 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:28:03.024597 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:28:56.194283 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423c4d4-6cf5-4264-b674-36e24338ffe1 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:28:56.194754 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423c4d4-6cf5-4264-b674-36e24338ffe1 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:28:56.194754 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423c4d4-6cf5-4264-b674-36e24338ffe1 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:28:56.199847 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 649/1307] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:28:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:28:56.201556 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b997263-55ff-40c5-aab1-d869cd4e2849 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:28:56.202020 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b997263-55ff-40c5-aab1-d869cd4e2849 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:28:56.202298 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b997263-55ff-40c5-aab1-d869cd4e2849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:28:56.339457 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-7b997263-55ff-40c5-aab1-d869cd4e2849 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:28:56.341053 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7b997263-55ff-40c5-aab1-d869cd4e2849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:28:56.465951 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 659/1308] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:28:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:28:56.505225 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92d843-da00-4eb2-8b49-764c66ef01fe None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:28:56.505507 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92d843-da00-4eb2-8b49-764c66ef01fe None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:28:56.505819 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92d843-da00-4eb2-8b49-764c66ef01fe None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:28:56.507225 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 650/1309] 10.222.0.27 () {54 vars in 964 bytes} [Fri Jul 15 17:28:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:28:56.513544 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323832a-5d05-4ac8-811c-43451b660a8a None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:28:56.513923 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323832a-5d05-4ac8-811c-43451b660a8a None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:28:56.514149 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323832a-5d05-4ac8-811c-43451b660a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:28:56.595438 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-7323832a-5d05-4ac8-811c-43451b660a8a None None] MFA Rules not processed for user `989272e5e803405d87d0833d503bb572`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:28:56.596630 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7323832a-5d05-4ac8-811c-43451b660a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:28:56.618593 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:28:56.679103 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 660/1310] 10.222.0.27 () {58 vars in 1061 bytes} [Fri Jul 15 17:28:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:28:56.688068 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92d843-da00-4eb2-8b49-764c66ef01fe None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:28:56.689888 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-6e92d843-da00-4eb2-8b49-764c66ef01fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:28:56.808800 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92d843-da00-4eb2-8b49-764c66ef01fe None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:28:56.890891 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66944304-94c7-44b2-ab8f-284ca22ff3be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:28:56.891652 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66944304-94c7-44b2-ab8f-284ca22ff3be service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:28:56.891997 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66944304-94c7-44b2-ab8f-284ca22ff3be service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:28:56.892333 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66944304-94c7-44b2-ab8f-284ca22ff3be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:28:56.894186 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-66944304-94c7-44b2-ab8f-284ca22ff3be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:28:56.952730 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:28:57.010929 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66944304-94c7-44b2-ab8f-284ca22ff3be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:28:57.012381 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66944304-94c7-44b2-ab8f-284ca22ff3be service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:28:57.032334 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 651/1311] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:28:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:28:59.318463 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461dcbb-f662-4764-88e8-9451eeab29e0 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:28:59.318975 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461dcbb-f662-4764-88e8-9451eeab29e0 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:28:59.318975 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461dcbb-f662-4764-88e8-9451eeab29e0 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:28:59.320545 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 661/1312] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:28:59.326041 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ade7f-8789-4d21-985b-af5e78b68945 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:28:59.326471 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ade7f-8789-4d21-985b-af5e78b68945 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:28:59.326776 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ade7f-8789-4d21-985b-af5e78b68945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:28:59.420201 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-9a1ade7f-8789-4d21-985b-af5e78b68945 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:28:59.421425 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-9a1ade7f-8789-4d21-985b-af5e78b68945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:28:59.545874 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 652/1313] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:28:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:28:59.597284 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037a451-04c9-42e3-a108-9a3eb07751bd None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:28:59.597721 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037a451-04c9-42e3-a108-9a3eb07751bd None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:28:59.598116 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037a451-04c9-42e3-a108-9a3eb07751bd None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:28:59.599792 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 662/1314] 10.222.0.27 () {54 vars in 964 bytes} [Fri Jul 15 17:28:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:28:59.606250 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ae377-384c-4a7d-901b-0067142e333b None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:28:59.606549 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ae377-384c-4a7d-901b-0067142e333b None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:28:59.606805 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ae377-384c-4a7d-901b-0067142e333b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:28:59.620902 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:28:59.687059 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-5c2ae377-384c-4a7d-901b-0067142e333b None None] MFA Rules not processed for user `989272e5e803405d87d0833d503bb572`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:28:59.688289 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-5c2ae377-384c-4a7d-901b-0067142e333b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:28:59.782782 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 653/1315] 10.222.0.27 () {58 vars in 1061 bytes} [Fri Jul 15 17:28:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:28:59.792399 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6037a451-04c9-42e3-a108-9a3eb07751bd None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:28:59.794310 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-6037a451-04c9-42e3-a108-9a3eb07751bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:28:59.925875 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6037a451-04c9-42e3-a108-9a3eb07751bd None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:28:59.999626 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:29:00.002515 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee22d968-ce4c-41d7-b7ac-add6ea607363 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:29:00.003512 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22d968-ce4c-41d7-b7ac-add6ea607363 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:00.004113 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22d968-ce4c-41d7-b7ac-add6ea607363 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:00.004472 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22d968-ce4c-41d7-b7ac-add6ea607363 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:00.006661 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ee22d968-ce4c-41d7-b7ac-add6ea607363 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:00.118025 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee22d968-ce4c-41d7-b7ac-add6ea607363 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:29:00.119379 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee22d968-ce4c-41d7-b7ac-add6ea607363 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:29:00.138756 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 663/1316] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:28:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:29:02.678561 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395de60-cd97-4fc2-b680-f653fb45a1af None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:02.679370 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395de60-cd97-4fc2-b680-f653fb45a1af None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:02.679370 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395de60-cd97-4fc2-b680-f653fb45a1af None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:02.681454 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 654/1317] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:29:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:29:02.690225 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0cc3d-f756-4aee-a613-dbe9286a8c39 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:02.690714 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0cc3d-f756-4aee-a613-dbe9286a8c39 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:02.690823 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0cc3d-f756-4aee-a613-dbe9286a8c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:02.765815 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-83d0cc3d-f756-4aee-a613-dbe9286a8c39 None None] MFA Rules not processed for user `2ac9dd996a9f4a0b9387f409d44f60f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:29:02.767081 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-83d0cc3d-f756-4aee-a613-dbe9286a8c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:02.832679 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:29:02.883070 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 664/1318] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:29:02 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:29:02.923856 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395de60-cd97-4fc2-b680-f653fb45a1af None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:29:02.926336 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-a395de60-cd97-4fc2-b680-f653fb45a1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:03.047068 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395de60-cd97-4fc2-b680-f653fb45a1af None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:29:03.050100 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:29:03.121561 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a26cf5d-8fd6-4aad-8c86-64a0b071c321 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:29:03.122301 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26cf5d-8fd6-4aad-8c86-64a0b071c321 service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:03.122576 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26cf5d-8fd6-4aad-8c86-64a0b071c321 service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:03.122842 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26cf5d-8fd6-4aad-8c86-64a0b071c321 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:03.124468 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-8a26cf5d-8fd6-4aad-8c86-64a0b071c321 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:03.244043 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a26cf5d-8fd6-4aad-8c86-64a0b071c321 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:29:03.245493 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a26cf5d-8fd6-4aad-8c86-64a0b071c321 service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:29:03.265078 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 655/1319] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:29:02 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:29:06.029258 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b9a90-687a-4e22-8dc9-66ed58d3e2dc None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:06.030199 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b9a90-687a-4e22-8dc9-66ed58d3e2dc None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:06.030199 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b9a90-687a-4e22-8dc9-66ed58d3e2dc None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:06.032427 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 665/1320] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:29:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:29:06.038731 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322421b3-b6b8-45b8-a2b3-978e317938ce None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:06.039183 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322421b3-b6b8-45b8-a2b3-978e317938ce None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:06.039278 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322421b3-b6b8-45b8-a2b3-978e317938ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:06.079934 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:29:06.106372 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-322421b3-b6b8-45b8-a2b3-978e317938ce None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:29:06.107595 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-322421b3-b6b8-45b8-a2b3-978e317938ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:06.215355 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 656/1321] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:29:06 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:29:06.262954 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b9a90-687a-4e22-8dc9-66ed58d3e2dc None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:29:06.264487 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e38b9a90-687a-4e22-8dc9-66ed58d3e2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:06.371915 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b9a90-687a-4e22-8dc9-66ed58d3e2dc None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:29:06.461827 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6f7e7-4b9e-43ad-8d31-3e4b6a35bc1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:29:06.462477 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6f7e7-4b9e-43ad-8d31-3e4b6a35bc1b service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:06.462753 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6f7e7-4b9e-43ad-8d31-3e4b6a35bc1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:06.463025 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6f7e7-4b9e-43ad-8d31-3e4b6a35bc1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:06.464646 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d9d6f7e7-4b9e-43ad-8d31-3e4b6a35bc1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:06.472446 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:29:06.579517 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d6f7e7-4b9e-43ad-8d31-3e4b6a35bc1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:29:06.580977 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d6f7e7-4b9e-43ad-8d31-3e4b6a35bc1b service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:29:06.602285 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 666/1322] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:29:06 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:29:09.283389 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc572316-3569-4727-90aa-4fd0e03618b2 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:09.284023 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc572316-3569-4727-90aa-4fd0e03618b2 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:09.284023 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc572316-3569-4727-90aa-4fd0e03618b2 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:09.285391 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 657/1323] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:29:09.291111 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9b226-fa29-4b64-b097-c56529f96a6c None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:09.291585 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9b226-fa29-4b64-b097-c56529f96a6c None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:09.291714 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9b226-fa29-4b64-b097-c56529f96a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:09.361162 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-b4c9b226-fa29-4b64-b097-c56529f96a6c None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:29:09.362450 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b4c9b226-fa29-4b64-b097-c56529f96a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:09.422130 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:29:09.463767 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 667/1324] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:29:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:29:09.499901 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc572316-3569-4727-90aa-4fd0e03618b2 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:29:09.501565 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-fc572316-3569-4727-90aa-4fd0e03618b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:09.621746 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc572316-3569-4727-90aa-4fd0e03618b2 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:29:09.641006 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:29:09.708038 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c179a-9060-4442-8d87-0d59a40242bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:29:09.708707 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c179a-9060-4442-8d87-0d59a40242bf service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:09.708983 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c179a-9060-4442-8d87-0d59a40242bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:09.709251 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c179a-9060-4442-8d87-0d59a40242bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:09.711040 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-4d4c179a-9060-4442-8d87-0d59a40242bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:09.823673 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4c179a-9060-4442-8d87-0d59a40242bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:29:09.825455 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4c179a-9060-4442-8d87-0d59a40242bf service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:29:09.844173 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 658/1325] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:29:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:29:11.906969 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35587460-54ec-449e-8d25-b9c278ab5b1e None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:11.907541 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35587460-54ec-449e-8d25-b9c278ab5b1e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:11.907541 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35587460-54ec-449e-8d25-b9c278ab5b1e None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:11.908985 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 668/1326] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:29:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:29:11.914352 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32041656-2d3c-4923-9047-232030129826 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:11.914792 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32041656-2d3c-4923-9047-232030129826 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:11.914904 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32041656-2d3c-4923-9047-232030129826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:11.964019 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:29:11.982766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-32041656-2d3c-4923-9047-232030129826 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:29:11.983938 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-32041656-2d3c-4923-9047-232030129826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:12.087990 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 659/1327] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:29:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:29:12.125195 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35587460-54ec-449e-8d25-b9c278ab5b1e None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:29:12.126864 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-35587460-54ec-449e-8d25-b9c278ab5b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:12.235321 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35587460-54ec-449e-8d25-b9c278ab5b1e None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:29:12.326995 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547fa817-7d09-41c4-96f9-98aa3923703e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:29:12.327664 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fa817-7d09-41c4-96f9-98aa3923703e service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:12.327951 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fa817-7d09-41c4-96f9-98aa3923703e service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:12.328227 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fa817-7d09-41c4-96f9-98aa3923703e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:12.329928 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-547fa817-7d09-41c4-96f9-98aa3923703e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:12.347885 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:29:12.450352 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547fa817-7d09-41c4-96f9-98aa3923703e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:29:12.451805 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547fa817-7d09-41c4-96f9-98aa3923703e service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:29:12.472466 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 669/1328] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:29:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:29:14.521630 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf85d5a-6bc9-464b-896e-e9b14840da9f None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:14.522252 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf85d5a-6bc9-464b-896e-e9b14840da9f None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:14.522505 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf85d5a-6bc9-464b-896e-e9b14840da9f None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:14.523925 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 660/1329] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:29:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:29:14.529570 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb55d3-3e23-48a0-a92c-3371b00ef220 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:14.530088 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb55d3-3e23-48a0-a92c-3371b00ef220 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:14.530181 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb55d3-3e23-48a0-a92c-3371b00ef220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:14.602930 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-eeeb55d3-3e23-48a0-a92c-3371b00ef220 None None] MFA Rules not processed for user `2ac9dd996a9f4a0b9387f409d44f60f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:29:14.604069 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-eeeb55d3-3e23-48a0-a92c-3371b00ef220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:14.673075 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:29:14.707472 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 670/1330] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:29:14 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:29:14.745723 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf85d5a-6bc9-464b-896e-e9b14840da9f None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:29:14.747287 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-2bf85d5a-6bc9-464b-896e-e9b14840da9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:14.862270 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf85d5a-6bc9-464b-896e-e9b14840da9f None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:29:14.883313 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:29:14.941467 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd02b8-290c-45d1-9b4b-a637de648b5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:29:14.942170 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd02b8-290c-45d1-9b4b-a637de648b5a service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:14.942448 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd02b8-290c-45d1-9b4b-a637de648b5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:14.942715 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd02b8-290c-45d1-9b4b-a637de648b5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:14.944372 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-a3bd02b8-290c-45d1-9b4b-a637de648b5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:15.059965 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd02b8-290c-45d1-9b4b-a637de648b5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:29:15.061419 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd02b8-290c-45d1-9b4b-a637de648b5a service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:29:15.080722 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 661/1331] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:29:14 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:29:17.361303 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a22cf-d34f-4e0b-9576-4bc3a1996c8b None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:17.361942 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a22cf-d34f-4e0b-9576-4bc3a1996c8b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:17.361942 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a22cf-d34f-4e0b-9576-4bc3a1996c8b None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:17.363484 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 671/1332] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:29:17.371668 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e8816-4d7f-4fbc-85fd-70e95e3d9e94 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:17.373261 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e8816-4d7f-4fbc-85fd-70e95e3d9e94 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:17.373261 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e8816-4d7f-4fbc-85fd-70e95e3d9e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:17.436873 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:29:17.440126 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-6c5e8816-4d7f-4fbc-85fd-70e95e3d9e94 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:29:17.441922 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-6c5e8816-4d7f-4fbc-85fd-70e95e3d9e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:17.540251 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 662/1333] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:29:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:29:17.576126 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a22cf-d34f-4e0b-9576-4bc3a1996c8b None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:29:17.577735 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-530a22cf-d34f-4e0b-9576-4bc3a1996c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:17.704366 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a22cf-d34f-4e0b-9576-4bc3a1996c8b None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:29:17.803108 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdfff03-f165-464c-b882-a06ffbdcdfd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:29:17.803758 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfff03-f165-464c-b882-a06ffbdcdfd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:17.804035 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfff03-f165-464c-b882-a06ffbdcdfd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:17.804305 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfff03-f165-464c-b882-a06ffbdcdfd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:17.805980 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-0bdfff03-f165-464c-b882-a06ffbdcdfd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:17.834112 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:29:17.918707 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdfff03-f165-464c-b882-a06ffbdcdfd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:29:17.920139 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdfff03-f165-464c-b882-a06ffbdcdfd6 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:29:17.939675 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 672/1334] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:29:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:29:20.028638 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5c0f5-2c7d-488e-a83a-b796b5442bd8 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:20.029522 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5c0f5-2c7d-488e-a83a-b796b5442bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:20.029522 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5c0f5-2c7d-488e-a83a-b796b5442bd8 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:20.031761 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 663/1335] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:29:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:29:20.038268 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadb989-0246-42f6-9f44-7842123e61a0 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:20.038718 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadb989-0246-42f6-9f44-7842123e61a0 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:20.038817 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadb989-0246-42f6-9f44-7842123e61a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:20.113280 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-8cadb989-0246-42f6-9f44-7842123e61a0 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:29:20.114553 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8cadb989-0246-42f6-9f44-7842123e61a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:20.198422 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:29:20.223111 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 673/1336] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:29:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:29:20.267140 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa5c0f5-2c7d-488e-a83a-b796b5442bd8 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:29:20.269604 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-6fa5c0f5-2c7d-488e-a83a-b796b5442bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:20.391801 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa5c0f5-2c7d-488e-a83a-b796b5442bd8 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:29:20.424840 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:29:20.473559 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b0b0d-9cd9-4d45-8f24-b131cedf1bd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:29:20.474149 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b0b0d-9cd9-4d45-8f24-b131cedf1bd9 service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:20.474428 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b0b0d-9cd9-4d45-8f24-b131cedf1bd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:20.474698 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b0b0d-9cd9-4d45-8f24-b131cedf1bd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:20.476340 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-c55b0b0d-9cd9-4d45-8f24-b131cedf1bd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:20.593667 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b0b0d-9cd9-4d45-8f24-b131cedf1bd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:29:20.595222 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b0b0d-9cd9-4d45-8f24-b131cedf1bd9 service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:29:20.615041 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 664/1337] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:29:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:29:23.171550 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256b0b4-25f6-4542-9681-3e3fa8daef16 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:23.172134 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256b0b4-25f6-4542-9681-3e3fa8daef16 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:23.172134 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256b0b4-25f6-4542-9681-3e3fa8daef16 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:23.174779 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 674/1338] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:29:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:29:23.184598 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db837791-6cdc-4d19-b980-961b104345ab None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:23.185366 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db837791-6cdc-4d19-b980-961b104345ab None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:23.185515 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db837791-6cdc-4d19-b980-961b104345ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:23.255675 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-db837791-6cdc-4d19-b980-961b104345ab None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:29:23.256899 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-db837791-6cdc-4d19-b980-961b104345ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:23.265358 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:29:23.362889 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 665/1339] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:29:23 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:29:23.402740 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256b0b4-25f6-4542-9681-3e3fa8daef16 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:29:23.405249 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7256b0b4-25f6-4542-9681-3e3fa8daef16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:23.519240 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256b0b4-25f6-4542-9681-3e3fa8daef16 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:29:23.602665 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50d5aa-df6d-4794-8862-638a14d32e3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:29:23.603600 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50d5aa-df6d-4794-8862-638a14d32e3b service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:23.603972 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50d5aa-df6d-4794-8862-638a14d32e3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:23.604339 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50d5aa-df6d-4794-8862-638a14d32e3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:23.606914 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-3b50d5aa-df6d-4794-8862-638a14d32e3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:23.656506 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:29:23.742119 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b50d5aa-df6d-4794-8862-638a14d32e3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:29:23.743566 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b50d5aa-df6d-4794-8862-638a14d32e3b service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:29:23.762812 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 675/1340] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:29:23 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:29:27.863548 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a25199-f921-419e-b693-c98432f3b748 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:27.864111 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a25199-f921-419e-b693-c98432f3b748 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:27.864225 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a25199-f921-419e-b693-c98432f3b748 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:27.865801 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 666/1341] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:29:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:29:27.871255 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed0215-1206-46dc-b817-8044611be7f8 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:27.871696 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed0215-1206-46dc-b817-8044611be7f8 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:27.871783 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed0215-1206-46dc-b817-8044611be7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:27.940490 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-27ed0215-1206-46dc-b817-8044611be7f8 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:29:27.941726 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-27ed0215-1206-46dc-b817-8044611be7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:28.030596 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:29:28.043232 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 676/1342] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:29:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:29:28.083336 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a25199-f921-419e-b693-c98432f3b748 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:29:28.085204 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-65a25199-f921-419e-b693-c98432f3b748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:28.192420 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a25199-f921-419e-b693-c98432f3b748 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:29:28.234434 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:29:28.274780 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642aac7-947d-416f-920c-d65b8cceb683 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:29:28.275536 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642aac7-947d-416f-920c-d65b8cceb683 service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:28.275899 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642aac7-947d-416f-920c-d65b8cceb683 service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:28.276268 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642aac7-947d-416f-920c-d65b8cceb683 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:28.278205 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-5642aac7-947d-416f-920c-d65b8cceb683 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:28.396587 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5642aac7-947d-416f-920c-d65b8cceb683 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:29:28.398071 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5642aac7-947d-416f-920c-d65b8cceb683 service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:29:28.417329 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 667/1343] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:29:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:29:31.006934 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3931787-14a3-453c-a4dd-ac20eec20659 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:31.007523 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3931787-14a3-453c-a4dd-ac20eec20659 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:31.007523 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3931787-14a3-453c-a4dd-ac20eec20659 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:31.008944 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 677/1344] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:29:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:29:31.015005 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc917dc-88fe-48e6-8d9c-a700f4b81720 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:31.015608 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc917dc-88fe-48e6-8d9c-a700f4b81720 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:31.015608 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc917dc-88fe-48e6-8d9c-a700f4b81720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:31.090967 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-4fc917dc-88fe-48e6-8d9c-a700f4b81720 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:29:31.092205 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-4fc917dc-88fe-48e6-8d9c-a700f4b81720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:31.112768 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:29:31.201222 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 668/1345] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:29:31 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:29:31.239403 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3931787-14a3-453c-a4dd-ac20eec20659 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:29:31.241033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b3931787-14a3-453c-a4dd-ac20eec20659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:31.351934 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3931787-14a3-453c-a4dd-ac20eec20659 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:29:31.427828 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51b16c-75d7-4a1c-9d15-a96c7f33967c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:29:31.428398 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51b16c-75d7-4a1c-9d15-a96c7f33967c service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:31.428637 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51b16c-75d7-4a1c-9d15-a96c7f33967c service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:31.428950 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51b16c-75d7-4a1c-9d15-a96c7f33967c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:31.430609 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-bd51b16c-75d7-4a1c-9d15-a96c7f33967c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:31.475831 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:29:31.546154 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51b16c-75d7-4a1c-9d15-a96c7f33967c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:29:31.547598 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51b16c-75d7-4a1c-9d15-a96c7f33967c service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:29:31.567663 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 678/1346] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:29:31 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:29:35.642371 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b5e4d-a8e2-4d51-8876-4c025a3fb282 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:35.642968 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b5e4d-a8e2-4d51-8876-4c025a3fb282 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:35.643094 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b5e4d-a8e2-4d51-8876-4c025a3fb282 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:35.644475 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 669/1347] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:29:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:29:35.652432 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16aa859-91fc-4170-a9b7-fc70ba36eaa9 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:35.652881 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16aa859-91fc-4170-a9b7-fc70ba36eaa9 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:35.653010 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16aa859-91fc-4170-a9b7-fc70ba36eaa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:35.731976 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-e16aa859-91fc-4170-a9b7-fc70ba36eaa9 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:29:35.733228 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e16aa859-91fc-4170-a9b7-fc70ba36eaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:35.875110 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:29:35.879439 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 679/1348] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:29:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:29:35.918090 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b5e4d-a8e2-4d51-8876-4c025a3fb282 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:29:35.919985 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-0e1b5e4d-a8e2-4d51-8876-4c025a3fb282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:36.050334 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b5e4d-a8e2-4d51-8876-4c025a3fb282 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:29:36.121278 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:29:36.161681 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae95ada-3fdb-43d2-820e-b780a18c7b9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:29:36.162486 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae95ada-3fdb-43d2-820e-b780a18c7b9e service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:36.163320 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae95ada-3fdb-43d2-820e-b780a18c7b9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:36.163677 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae95ada-3fdb-43d2-820e-b780a18c7b9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:36.165483 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-aae95ada-3fdb-43d2-820e-b780a18c7b9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:36.306918 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae95ada-3fdb-43d2-820e-b780a18c7b9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:29:36.308800 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae95ada-3fdb-43d2-820e-b780a18c7b9e service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:29:36.335460 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 670/1349] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:29:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:29:41.351924 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb0724-f676-420c-b4bb-1300189290e6 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:41.352440 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb0724-f676-420c-b4bb-1300189290e6 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:41.352558 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb0724-f676-420c-b4bb-1300189290e6 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:41.358016 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 680/1350] 10.222.0.27 () {54 vars in 921 bytes} [Fri Jul 15 17:29:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:29:41.367531 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7ada3-f004-41f1-a23c-ebcae3dbb93f None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:41.367993 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7ada3-f004-41f1-a23c-ebcae3dbb93f None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:41.368077 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7ada3-f004-41f1-a23c-ebcae3dbb93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:41.505117 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-a8d7ada3-f004-41f1-a23c-ebcae3dbb93f None None] MFA Rules not processed for user `96b2105f8d29443383ed51a8fd5cec6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:29:41.506423 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-a8d7ada3-f004-41f1-a23c-ebcae3dbb93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:41.542178 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:29:41.618906 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 671/1351] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Jul 15 17:29:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:29:45.642477 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305c4a5-3c76-4a33-b80b-4ad6b1bc97ee None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:45.643072 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305c4a5-3c76-4a33-b80b-4ad6b1bc97ee None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:45.643072 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305c4a5-3c76-4a33-b80b-4ad6b1bc97ee None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:45.644729 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 681/1352] 10.222.0.27 () {54 vars in 921 bytes} [Fri Jul 15 17:29:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:29:45.649830 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd42d4-7745-4a1c-aa8d-ea216032aec7 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:45.650258 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd42d4-7745-4a1c-aa8d-ea216032aec7 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:45.650426 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd42d4-7745-4a1c-aa8d-ea216032aec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:45.729065 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-84cd42d4-7745-4a1c-aa8d-ea216032aec7 None None] MFA Rules not processed for user `96b2105f8d29443383ed51a8fd5cec6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:29:45.730413 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-84cd42d4-7745-4a1c-aa8d-ea216032aec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:45.811430 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:29:45.846720 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 672/1353] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Jul 15 17:29:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:29:47.265426 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e8df0-08ec-4f82-8904-23b6f086458f None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:47.266029 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e8df0-08ec-4f82-8904-23b6f086458f None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:47.266029 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e8df0-08ec-4f82-8904-23b6f086458f None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:47.267941 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 682/1354] 10.222.0.27 () {54 vars in 921 bytes} [Fri Jul 15 17:29:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:29:47.273039 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a2ac4-ed14-4d68-8fe6-926a93957c67 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:47.273503 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a2ac4-ed14-4d68-8fe6-926a93957c67 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:47.273598 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a2ac4-ed14-4d68-8fe6-926a93957c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:47.355915 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-b44a2ac4-ed14-4d68-8fe6-926a93957c67 None None] MFA Rules not processed for user `96b2105f8d29443383ed51a8fd5cec6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:29:47.357101 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-b44a2ac4-ed14-4d68-8fe6-926a93957c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:47.473303 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 673/1355] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Jul 15 17:29:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:29:50.786536 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004faad5-55a9-406b-9670-b8cdb20832d3 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:50.787577 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004faad5-55a9-406b-9670-b8cdb20832d3 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:50.787859 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004faad5-55a9-406b-9670-b8cdb20832d3 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:50.789415 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 683/1356] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:29:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:29:50.795249 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e155df5-0ca1-4d7e-8e01-89a4de5318de None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:50.795725 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e155df5-0ca1-4d7e-8e01-89a4de5318de None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:50.795725 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e155df5-0ca1-4d7e-8e01-89a4de5318de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:50.839028 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:29:50.874894 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-7e155df5-0ca1-4d7e-8e01-89a4de5318de None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:29:50.876282 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-7e155df5-0ca1-4d7e-8e01-89a4de5318de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:50.980595 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 674/1357] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:29:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:29:51.036854 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06dc76-07b9-4588-a835-18d3cb372798 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:51.037506 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06dc76-07b9-4588-a835-18d3cb372798 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:51.038199 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06dc76-07b9-4588-a835-18d3cb372798 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:51.040293 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 684/1358] 10.222.0.27 () {54 vars in 961 bytes} [Fri Jul 15 17:29:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:29:51.050096 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1dd103-3dcf-4b93-af37-e5378d10da11 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:51.051055 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1dd103-3dcf-4b93-af37-e5378d10da11 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:51.051673 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1dd103-3dcf-4b93-af37-e5378d10da11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:51.134727 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-8c1dd103-3dcf-4b93-af37-e5378d10da11 None None] MFA Rules not processed for user `f9d548c8199e4fdbbce7597bebd63421`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:29:51.135913 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-8c1dd103-3dcf-4b93-af37-e5378d10da11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:51.185881 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:29:51.256877 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 675/1359] 10.222.0.27 () {58 vars in 1058 bytes} [Fri Jul 15 17:29:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:29:51.264583 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06dc76-07b9-4588-a835-18d3cb372798 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:29:51.266430 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-be06dc76-07b9-4588-a835-18d3cb372798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:51.415362 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06dc76-07b9-4588-a835-18d3cb372798 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:29:51.491246 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:29:51.538119 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686105e3-653e-4f6f-a194-94f2219c4702 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:29:51.538774 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686105e3-653e-4f6f-a194-94f2219c4702 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:51.539051 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686105e3-653e-4f6f-a194-94f2219c4702 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:51.539322 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686105e3-653e-4f6f-a194-94f2219c4702 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:51.540940 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-686105e3-653e-4f6f-a194-94f2219c4702 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:51.634643 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686105e3-653e-4f6f-a194-94f2219c4702 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:29:51.636242 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686105e3-653e-4f6f-a194-94f2219c4702 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:29:51.655346 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 685/1360] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:29:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:29:53.885052 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e563e-fafe-4e58-a6ee-5853ca2cd9bf None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:53.885601 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e563e-fafe-4e58-a6ee-5853ca2cd9bf None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:53.885601 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e563e-fafe-4e58-a6ee-5853ca2cd9bf None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:53.887152 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 676/1361] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:29:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:29:53.896267 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49da9ee-2dcb-4cb9-a6c4-298f9afcc118 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:53.897065 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49da9ee-2dcb-4cb9-a6c4-298f9afcc118 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:53.897725 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49da9ee-2dcb-4cb9-a6c4-298f9afcc118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:53.974650 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-e49da9ee-2dcb-4cb9-a6c4-298f9afcc118 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:29:53.975839 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e49da9ee-2dcb-4cb9-a6c4-298f9afcc118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:54.015903 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:29:54.092645 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 686/1362] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:29:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:29:54.130736 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e563e-fafe-4e58-a6ee-5853ca2cd9bf None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:29:54.133012 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-e04e563e-fafe-4e58-a6ee-5853ca2cd9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:54.314577 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e563e-fafe-4e58-a6ee-5853ca2cd9bf None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:29:54.324597 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:29:54.434036 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2417ad-7504-4587-bceb-a0860da8ba53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:29:54.434378 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2417ad-7504-4587-bceb-a0860da8ba53 service nova] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:54.434716 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2417ad-7504-4587-bceb-a0860da8ba53 service nova] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:54.434716 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2417ad-7504-4587-bceb-a0860da8ba53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:54.436494 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-4f2417ad-7504-4587-bceb-a0860da8ba53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:54.531725 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2417ad-7504-4587-bceb-a0860da8ba53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:29:54.533629 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2417ad-7504-4587-bceb-a0860da8ba53 service nova] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:29:54.552596 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 677/1363] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:29:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:29:56.871111 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11aa8e-d806-4e26-8069-d7ddddfecb86 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:56.871622 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11aa8e-d806-4e26-8069-d7ddddfecb86 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:56.871622 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11aa8e-d806-4e26-8069-d7ddddfecb86 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:56.872973 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 687/1364] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:29:56.878935 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b94c58-c1cb-4714-88c9-8d1324c53573 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:56.879417 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b94c58-c1cb-4714-88c9-8d1324c53573 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:56.879631 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b94c58-c1cb-4714-88c9-8d1324c53573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:56.896109 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:29:56.956993 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-33b94c58-c1cb-4714-88c9-8d1324c53573 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:29:56.959241 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-33b94c58-c1cb-4714-88c9-8d1324c53573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:57.082148 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 678/1365] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:29:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:29:57.120286 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ae042-afef-47e8-9a0b-2fc39c848522 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:57.120926 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ae042-afef-47e8-9a0b-2fc39c848522 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:57.121417 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ae042-afef-47e8-9a0b-2fc39c848522 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:57.123448 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 688/1366] 10.222.0.27 () {54 vars in 961 bytes} [Fri Jul 15 17:29:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:29:57.130891 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9dab0-4311-4d4c-b4a5-cce878794414 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:57.131200 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9dab0-4311-4d4c-b4a5-cce878794414 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:57.131450 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9dab0-4311-4d4c-b4a5-cce878794414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:57.210754 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-aff9dab0-4311-4d4c-b4a5-cce878794414 None None] MFA Rules not processed for user `f9d548c8199e4fdbbce7597bebd63421`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:29:57.211955 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-aff9dab0-4311-4d4c-b4a5-cce878794414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:57.247946 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:29:57.343454 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 679/1367] 10.222.0.27 () {58 vars in 1058 bytes} [Fri Jul 15 17:29:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:29:57.352249 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ae042-afef-47e8-9a0b-2fc39c848522 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:29:57.354263 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-750ae042-afef-47e8-9a0b-2fc39c848522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:57.526046 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ae042-afef-47e8-9a0b-2fc39c848522 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:29:57.548348 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:29:57.649324 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdbce79-5087-47ed-bfa4-2b4caa1cd88c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:29:57.650180 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbce79-5087-47ed-bfa4-2b4caa1cd88c service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:57.650585 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbce79-5087-47ed-bfa4-2b4caa1cd88c service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:57.650954 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbce79-5087-47ed-bfa4-2b4caa1cd88c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:57.652669 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5bdbce79-5087-47ed-bfa4-2b4caa1cd88c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:57.755266 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdbce79-5087-47ed-bfa4-2b4caa1cd88c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:29:57.757050 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdbce79-5087-47ed-bfa4-2b4caa1cd88c service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:29:57.781444 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 689/1368] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:29:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:29:58.845449 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60e71d-bc8a-4335-9743-f04587ce11be None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:58.846064 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60e71d-bc8a-4335-9743-f04587ce11be None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:58.846064 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60e71d-bc8a-4335-9743-f04587ce11be None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:58.847610 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 680/1369] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:29:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:29:58.852886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5818f-501e-4c05-aeb2-f4c3495d6cc3 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:58.853302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5818f-501e-4c05-aeb2-f4c3495d6cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:58.853502 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5818f-501e-4c05-aeb2-f4c3495d6cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:58.884993 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:29:58.921247 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-7ac5818f-501e-4c05-aeb2-f4c3495d6cc3 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:29:58.922538 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7ac5818f-501e-4c05-aeb2-f4c3495d6cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:59.027221 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 690/1370] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:29:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:29:59.370690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637a452-ab3d-46fe-9169-c9bb7ba985a3 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:59.371092 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637a452-ab3d-46fe-9169-c9bb7ba985a3 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:59.371419 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637a452-ab3d-46fe-9169-c9bb7ba985a3 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:59.372978 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 681/1371] 10.222.0.27 () {54 vars in 963 bytes} [Fri Jul 15 17:29:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:29:59.378465 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47edee7c-0aac-4090-82f2-0f40b54b747d None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:59.378831 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47edee7c-0aac-4090-82f2-0f40b54b747d None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:59.379174 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47edee7c-0aac-4090-82f2-0f40b54b747d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:59.466340 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-47edee7c-0aac-4090-82f2-0f40b54b747d None None] MFA Rules not processed for user `94b8121d0b0d4eef818b2a8b3508df18`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:29:59.467554 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-47edee7c-0aac-4090-82f2-0f40b54b747d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:59.517209 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:29:59.548702 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 691/1372] 10.222.0.27 () {58 vars in 1060 bytes} [Fri Jul 15 17:29:59 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:29:59.556267 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637a452-ab3d-46fe-9169-c9bb7ba985a3 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:29:59.557804 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-a637a452-ab3d-46fe-9169-c9bb7ba985a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:59.670123 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637a452-ab3d-46fe-9169-c9bb7ba985a3 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:29:59.711550 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:29:59.747348 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc455f5-31fb-4868-9e39-12c70616d422 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:29:59.748005 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc455f5-31fb-4868-9e39-12c70616d422 service cinder] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:59.748283 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc455f5-31fb-4868-9e39-12c70616d422 service cinder] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:59.748556 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc455f5-31fb-4868-9e39-12c70616d422 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:59.750273 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-dcc455f5-31fb-4868-9e39-12c70616d422 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:29:59.865269 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc455f5-31fb-4868-9e39-12c70616d422 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:29:59.866865 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc455f5-31fb-4868-9e39-12c70616d422 service cinder] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:29:59.887193 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 682/1373] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:29:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:29:59.917242 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921c446-49e3-4db7-9c43-b3dca862e806 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:59.917693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921c446-49e3-4db7-9c43-b3dca862e806 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:59.917833 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921c446-49e3-4db7-9c43-b3dca862e806 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:29:59.919365 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 692/1374] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:29:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:29:59.925003 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66e53b-b29c-4161-a094-46ce9506b67f None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:29:59.925284 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66e53b-b29c-4161-a094-46ce9506b67f None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:29:59.925575 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66e53b-b29c-4161-a094-46ce9506b67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:00.002520 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-3b66e53b-b29c-4161-a094-46ce9506b67f None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:30:00.003943 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-3b66e53b-b29c-4161-a094-46ce9506b67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:00.027013 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:30:00.113330 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 683/1375] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:29:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:30:00.166660 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921c446-49e3-4db7-9c43-b3dca862e806 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:30:00.173168 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7921c446-49e3-4db7-9c43-b3dca862e806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:00.345358 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921c446-49e3-4db7-9c43-b3dca862e806 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:30:00.397369 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:30:00.461296 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46652040-3a3c-4dfd-ac2e-12417b20a8d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:30:00.461882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46652040-3a3c-4dfd-ac2e-12417b20a8d9 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:00.462150 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46652040-3a3c-4dfd-ac2e-12417b20a8d9 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:00.462426 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46652040-3a3c-4dfd-ac2e-12417b20a8d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:00.464067 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-46652040-3a3c-4dfd-ac2e-12417b20a8d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:00.556860 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46652040-3a3c-4dfd-ac2e-12417b20a8d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:30:00.558722 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46652040-3a3c-4dfd-ac2e-12417b20a8d9 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:30:00.581872 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 693/1376] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:30:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:30:02.648910 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd9307-fd32-4fae-909c-708af92d2609 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:02.649454 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd9307-fd32-4fae-909c-708af92d2609 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:02.649454 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd9307-fd32-4fae-909c-708af92d2609 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:02.650777 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 684/1377] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:30:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:30:02.656017 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e101dea-fc55-4d2b-8e44-244df8147cdf None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:02.656500 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e101dea-fc55-4d2b-8e44-244df8147cdf None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:02.656616 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e101dea-fc55-4d2b-8e44-244df8147cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:02.723874 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-6e101dea-fc55-4d2b-8e44-244df8147cdf None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:30:02.725099 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-6e101dea-fc55-4d2b-8e44-244df8147cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:02.731729 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:30:02.861154 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 694/1378] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:30:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:30:02.917589 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd9307-fd32-4fae-909c-708af92d2609 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:30:02.919521 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-2bdd9307-fd32-4fae-909c-708af92d2609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:03.072700 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd9307-fd32-4fae-909c-708af92d2609 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:30:03.076721 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:30:03.195697 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1c6b20-da61-49b8-af86-f848c166d0b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:30:03.196271 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c6b20-da61-49b8-af86-f848c166d0b1 service nova] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:03.196554 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c6b20-da61-49b8-af86-f848c166d0b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:03.196829 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c6b20-da61-49b8-af86-f848c166d0b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:03.198882 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-af1c6b20-da61-49b8-af86-f848c166d0b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:03.343859 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1c6b20-da61-49b8-af86-f848c166d0b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:30:03.345514 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1c6b20-da61-49b8-af86-f848c166d0b1 service nova] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:30:03.369532 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 685/1379] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:30:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:30:05.461000 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6614572-b194-4bff-a4a8-849f3b06a9ab None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:05.461554 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6614572-b194-4bff-a4a8-849f3b06a9ab None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:05.461554 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6614572-b194-4bff-a4a8-849f3b06a9ab None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:05.463137 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 695/1380] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:30:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:30:05.468668 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526201d3-4eac-4973-877c-148f34a02610 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:05.469116 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526201d3-4eac-4973-877c-148f34a02610 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:05.469539 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526201d3-4eac-4973-877c-148f34a02610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:05.480569 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:30:05.541973 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-526201d3-4eac-4973-877c-148f34a02610 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:30:05.543232 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-526201d3-4eac-4973-877c-148f34a02610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:05.642718 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 686/1381] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:30:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:30:05.686462 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6614572-b194-4bff-a4a8-849f3b06a9ab None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:30:05.688000 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a6614572-b194-4bff-a4a8-849f3b06a9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:05.842392 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:30:05.854575 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6614572-b194-4bff-a4a8-849f3b06a9ab None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:30:05.974246 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e4978-229a-4c24-97af-2553f0f3a3a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:30:05.975016 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e4978-229a-4c24-97af-2553f0f3a3a0 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:05.975358 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e4978-229a-4c24-97af-2553f0f3a3a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:05.975695 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e4978-229a-4c24-97af-2553f0f3a3a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:05.977481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a78e4978-229a-4c24-97af-2553f0f3a3a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:06.072892 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e4978-229a-4c24-97af-2553f0f3a3a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:30:06.074849 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e4978-229a-4c24-97af-2553f0f3a3a0 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:30:06.086695 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:30:06.095869 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 696/1382] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:30:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:30:08.515243 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5935c-e742-4a1e-abdf-432714afab43 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:08.515988 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5935c-e742-4a1e-abdf-432714afab43 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:08.516417 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5935c-e742-4a1e-abdf-432714afab43 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:08.518610 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 687/1383] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:30:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:30:08.524707 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82247c4-077a-4dbc-a6a5-4a9ad8056e4c None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:08.525152 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82247c4-077a-4dbc-a6a5-4a9ad8056e4c None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:08.525248 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82247c4-077a-4dbc-a6a5-4a9ad8056e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:08.603327 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-e82247c4-077a-4dbc-a6a5-4a9ad8056e4c None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:30:08.604927 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e82247c4-077a-4dbc-a6a5-4a9ad8056e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:08.724428 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 697/1384] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:30:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:30:08.779181 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5935c-e742-4a1e-abdf-432714afab43 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:30:08.781180 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-86d5935c-e742-4a1e-abdf-432714afab43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:08.896307 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:30:08.968558 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5935c-e742-4a1e-abdf-432714afab43 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:30:09.123780 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f73b52-1c25-4552-8f5c-b31b63e8fe85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:30:09.124445 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f73b52-1c25-4552-8f5c-b31b63e8fe85 service nova] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:09.124847 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f73b52-1c25-4552-8f5c-b31b63e8fe85 service nova] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:09.125244 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f73b52-1c25-4552-8f5c-b31b63e8fe85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:09.127397 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-74f73b52-1c25-4552-8f5c-b31b63e8fe85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:09.192938 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:30:09.242275 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f73b52-1c25-4552-8f5c-b31b63e8fe85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:30:09.243966 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f73b52-1c25-4552-8f5c-b31b63e8fe85 service nova] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:30:09.265765 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 688/1385] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:30:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:30:11.310795 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611bd5e2-6a24-458c-b4e0-96bfa46c71b6 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:11.311336 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611bd5e2-6a24-458c-b4e0-96bfa46c71b6 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:11.311639 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611bd5e2-6a24-458c-b4e0-96bfa46c71b6 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:11.313627 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 698/1386] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:30:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:30:11.319408 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2b370-4424-4233-8770-d5187d18fbd0 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:11.319938 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2b370-4424-4233-8770-d5187d18fbd0 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:11.320126 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2b370-4424-4233-8770-d5187d18fbd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:11.549210 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-4cd2b370-4424-4233-8770-d5187d18fbd0 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:30:11.550646 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-4cd2b370-4424-4233-8770-d5187d18fbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:11.663236 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 689/1387] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:30:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:30:11.711830 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611bd5e2-6a24-458c-b4e0-96bfa46c71b6 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:30:11.713357 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-611bd5e2-6a24-458c-b4e0-96bfa46c71b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:11.810402 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:30:11.897478 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611bd5e2-6a24-458c-b4e0-96bfa46c71b6 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:30:12.045617 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307d1f9-eb8c-4848-af41-033fbf9ece94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:30:12.046337 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307d1f9-eb8c-4848-af41-033fbf9ece94 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:12.046627 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307d1f9-eb8c-4848-af41-033fbf9ece94 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:12.046915 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307d1f9-eb8c-4848-af41-033fbf9ece94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:12.048650 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-0307d1f9-eb8c-4848-af41-033fbf9ece94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:12.090460 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:30:12.148780 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0307d1f9-eb8c-4848-af41-033fbf9ece94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:30:12.150526 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0307d1f9-eb8c-4848-af41-033fbf9ece94 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:30:12.170460 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 699/1388] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:30:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 17:30:14.479687 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c97238-7f99-4f10-ab98-66e95a7dce62 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:14.480345 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c97238-7f99-4f10-ab98-66e95a7dce62 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:14.480345 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c97238-7f99-4f10-ab98-66e95a7dce62 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:14.487384 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ef0b6-edd4-4a4c-b1cc-fc22b0c46ba4 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:14.487859 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ef0b6-edd4-4a4c-b1cc-fc22b0c46ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:14.487990 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ef0b6-edd4-4a4c-b1cc-fc22b0c46ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:14.489940 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 690/1389] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:30:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:30:14.553956 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-786ef0b6-edd4-4a4c-b1cc-fc22b0c46ba4 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:30:14.555155 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-786ef0b6-edd4-4a4c-b1cc-fc22b0c46ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:14.653951 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 700/1390] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:30:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:30:14.700697 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c97238-7f99-4f10-ab98-66e95a7dce62 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:30:14.702593 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-89c97238-7f99-4f10-ab98-66e95a7dce62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:14.735651 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:30:14.858378 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c97238-7f99-4f10-ab98-66e95a7dce62 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:30:14.974295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:30:14.991543 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f2de8-4389-422a-b7e2-572164ca4606 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:30:14.992207 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f2de8-4389-422a-b7e2-572164ca4606 service nova] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:14.992486 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f2de8-4389-422a-b7e2-572164ca4606 service nova] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:14.992755 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f2de8-4389-422a-b7e2-572164ca4606 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:14.994833 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-0d9f2de8-4389-422a-b7e2-572164ca4606 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:15.015388 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d151d-94fa-4f6d-8824-22d380963a7d None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:15.016035 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d151d-94fa-4f6d-8824-22d380963a7d None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:15.016035 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d151d-94fa-4f6d-8824-22d380963a7d None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:15.017584 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 701/1391] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:30:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 17:30:15.022950 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90751f-bd33-4bd8-9b6b-8ae583b2af33 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:15.023242 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90751f-bd33-4bd8-9b6b-8ae583b2af33 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:15.023521 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90751f-bd33-4bd8-9b6b-8ae583b2af33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:15.039119 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:30:15.096296 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-8a90751f-bd33-4bd8-9b6b-8ae583b2af33 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:30:15.097528 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8a90751f-bd33-4bd8-9b6b-8ae583b2af33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:15.108542 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f2de8-4389-422a-b7e2-572164ca4606 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:30:15.110378 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f2de8-4389-422a-b7e2-572164ca4606 service nova] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:30:15.129582 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 691/1392] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:30:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:30:15.208259 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 702/1393] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:30:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:30:15.267612 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea3201-a36a-49a6-9c31-37117ea61150 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:15.267985 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea3201-a36a-49a6-9c31-37117ea61150 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:15.268175 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea3201-a36a-49a6-9c31-37117ea61150 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:15.269834 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 692/1394] 10.222.0.27 () {54 vars in 960 bytes} [Fri Jul 15 17:30:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:30:15.275392 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89828a-41de-4d31-ae61-bb96f643a501 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:15.275685 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89828a-41de-4d31-ae61-bb96f643a501 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:15.275983 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89828a-41de-4d31-ae61-bb96f643a501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:15.374073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-3a89828a-41de-4d31-ae61-bb96f643a501 None None] MFA Rules not processed for user `14775984c9d4463a8e8848dcf189714b`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:30:15.374073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-3a89828a-41de-4d31-ae61-bb96f643a501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:15.412095 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:30:15.461824 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 703/1395] 10.222.0.27 () {58 vars in 1057 bytes} [Fri Jul 15 17:30:15 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:30:15.469473 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea3201-a36a-49a6-9c31-37117ea61150 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:30:15.471021 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-e1ea3201-a36a-49a6-9c31-37117ea61150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:15.582396 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea3201-a36a-49a6-9c31-37117ea61150 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:30:15.597004 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:30:15.662386 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d98e9b-6fd8-4611-b772-f24e64878a2a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14775984c9d4463a8e8848dcf189714b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:30:15.663057 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d98e9b-6fd8-4611-b772-f24e64878a2a service glance] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:15.663340 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d98e9b-6fd8-4611-b772-f24e64878a2a service glance] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:15.663613 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d98e9b-6fd8-4611-b772-f24e64878a2a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:15.665353 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-73d98e9b-6fd8-4611-b772-f24e64878a2a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:15.780200 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d98e9b-6fd8-4611-b772-f24e64878a2a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:30:15.781916 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d98e9b-6fd8-4611-b772-f24e64878a2a service glance] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:30:15.800871 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 693/1396] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:30:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:30:16.524137 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a03b0-6b29-44b5-887e-96d79d21fbb6 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:16.524640 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a03b0-6b29-44b5-887e-96d79d21fbb6 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:16.524786 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a03b0-6b29-44b5-887e-96d79d21fbb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:16.590504 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-d57a03b0-6b29-44b5-887e-96d79d21fbb6 None None] MFA Rules not processed for user `b73d09bd7c1e4753a45cfdb00cc5abe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:30:16.591715 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d57a03b0-6b29-44b5-887e-96d79d21fbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:16.680414 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 704/1397] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Jul 15 17:30:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:30:16.732690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f4b08-289a-43f1-b636-0eb2623da89a None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:16.733198 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f4b08-289a-43f1-b636-0eb2623da89a None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:16.733313 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f4b08-289a-43f1-b636-0eb2623da89a None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:16.734880 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 694/1398] 10.222.0.27 () {54 vars in 942 bytes} [Fri Jul 15 17:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:30:16.741972 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98256bf8-31b2-4846-8a70-8b5a3b7a7016 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:16.742263 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98256bf8-31b2-4846-8a70-8b5a3b7a7016 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:16.742544 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98256bf8-31b2-4846-8a70-8b5a3b7a7016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:16.799519 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:30:16.818590 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-98256bf8-31b2-4846-8a70-8b5a3b7a7016 None None] MFA Rules not processed for user `9dea565b75784465a8ea073883261d7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:30:16.819784 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-98256bf8-31b2-4846-8a70-8b5a3b7a7016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:16.930815 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 705/1399] 10.222.0.27 () {58 vars in 1039 bytes} [Fri Jul 15 17:30:16 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:30:16.940654 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f4b08-289a-43f1-b636-0eb2623da89a None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:30:16.942237 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-647f4b08-289a-43f1-b636-0eb2623da89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:16.995100 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:30:17.091953 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f4b08-289a-43f1-b636-0eb2623da89a None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:30:17.195255 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627dbf8-f119-497a-a4c5-72c2f1a43013 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:17.195520 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627dbf8-f119-497a-a4c5-72c2f1a43013 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:17.195809 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627dbf8-f119-497a-a4c5-72c2f1a43013 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:17.197213 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 706/1400] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:30:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:30:17.203383 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db787ef9-10f6-4449-a734-ff2aa39d413f None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:17.203529 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408413aa-4697-4fde-8b1b-28622a9738fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dea565b75784465a8ea073883261d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:30:17.203771 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db787ef9-10f6-4449-a734-ff2aa39d413f None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:17.204059 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db787ef9-10f6-4449-a734-ff2aa39d413f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:17.204181 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408413aa-4697-4fde-8b1b-28622a9738fe service swift] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:17.204343 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408413aa-4697-4fde-8b1b-28622a9738fe service swift] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:17.204617 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408413aa-4697-4fde-8b1b-28622a9738fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:17.206334 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-408413aa-4697-4fde-8b1b-28622a9738fe service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:17.236788 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:30:17.271176 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-db787ef9-10f6-4449-a734-ff2aa39d413f None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:30:17.272495 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-db787ef9-10f6-4449-a734-ff2aa39d413f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:17.296936 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408413aa-4697-4fde-8b1b-28622a9738fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:30:17.298584 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408413aa-4697-4fde-8b1b-28622a9738fe service swift] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:30:17.306980 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 695/1401] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Jul 15 17:30:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 17:30:17.335326 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:30:17.380866 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 707/1402] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:30:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:30:17.431074 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408413aa-4697-4fde-8b1b-28622a9738fe service swift] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:30:17.432621 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-408413aa-4697-4fde-8b1b-28622a9738fe service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:17.534003 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408413aa-4697-4fde-8b1b-28622a9738fe service swift] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:30:17.613659 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:30:17.664954 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b6d388-74bd-463a-95b9-4cd0a878d3f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:30:17.666040 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6d388-74bd-463a-95b9-4cd0a878d3f1 service nova] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:17.666311 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6d388-74bd-463a-95b9-4cd0a878d3f1 service nova] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:17.666582 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6d388-74bd-463a-95b9-4cd0a878d3f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:17.668290 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-55b6d388-74bd-463a-95b9-4cd0a878d3f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:17.770055 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b6d388-74bd-463a-95b9-4cd0a878d3f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:30:17.772554 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b6d388-74bd-463a-95b9-4cd0a878d3f1 service nova] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:30:17.799775 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 696/1403] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:30:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:30:19.863086 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589dded-398b-4b93-956e-e81884cf989e None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:19.863666 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589dded-398b-4b93-956e-e81884cf989e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:19.863666 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589dded-398b-4b93-956e-e81884cf989e None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:19.865048 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 708/1404] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:30:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:30:19.870674 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1384e33-5e21-4a67-b163-44206dc233a4 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:19.871109 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1384e33-5e21-4a67-b163-44206dc233a4 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:19.871232 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1384e33-5e21-4a67-b163-44206dc233a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:19.945361 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-e1384e33-5e21-4a67-b163-44206dc233a4 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:30:19.946917 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-e1384e33-5e21-4a67-b163-44206dc233a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:19.984568 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:30:20.052723 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 697/1405] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:30:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:30:20.099042 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589dded-398b-4b93-956e-e81884cf989e None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:30:20.100631 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-6589dded-398b-4b93-956e-e81884cf989e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:20.262990 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589dded-398b-4b93-956e-e81884cf989e None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:30:20.311518 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:30:20.390702 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db0690-a288-4505-b0f5-08e62c273563 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:30:20.391696 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db0690-a288-4505-b0f5-08e62c273563 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:20.391980 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db0690-a288-4505-b0f5-08e62c273563 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:20.392262 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db0690-a288-4505-b0f5-08e62c273563 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:20.393996 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d2db0690-a288-4505-b0f5-08e62c273563 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:20.497879 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db0690-a288-4505-b0f5-08e62c273563 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:30:20.499789 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db0690-a288-4505-b0f5-08e62c273563 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:30:20.522365 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 709/1406] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:30:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:30:22.610283 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e695f3-52e5-4c4f-966a-e73ed7794c12 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:22.610794 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e695f3-52e5-4c4f-966a-e73ed7794c12 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:22.610794 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e695f3-52e5-4c4f-966a-e73ed7794c12 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:22.612152 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 698/1407] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:30:22.618498 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af52e09-604a-4f34-abe1-ba35766fb924 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:22.619006 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af52e09-604a-4f34-abe1-ba35766fb924 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:22.619089 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af52e09-604a-4f34-abe1-ba35766fb924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:22.683951 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:30:22.696783 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-4af52e09-604a-4f34-abe1-ba35766fb924 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:30:22.698404 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-4af52e09-604a-4f34-abe1-ba35766fb924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:22.835846 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 710/1408] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:30:22.868271 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e695f3-52e5-4c4f-966a-e73ed7794c12 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:30:22.874669 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-20e695f3-52e5-4c4f-966a-e73ed7794c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:23.050205 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e695f3-52e5-4c4f-966a-e73ed7794c12 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:30:23.068616 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:30:23.180210 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9045e9-bfe0-49ed-a898-a2a150c60207 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:30:23.180800 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9045e9-bfe0-49ed-a898-a2a150c60207 service nova] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:23.181109 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9045e9-bfe0-49ed-a898-a2a150c60207 service nova] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:23.181392 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9045e9-bfe0-49ed-a898-a2a150c60207 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:23.188070 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-4e9045e9-bfe0-49ed-a898-a2a150c60207 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:23.292014 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9045e9-bfe0-49ed-a898-a2a150c60207 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:30:23.292014 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9045e9-bfe0-49ed-a898-a2a150c60207 service nova] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:30:23.311576 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 699/1409] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:30:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:30:32.812487 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=44 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:30:33.308789 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=90 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:30:39.547945 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01c073-07ef-4746-9c29-2e9b4935aaa2 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:39.548560 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01c073-07ef-4746-9c29-2e9b4935aaa2 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:39.548560 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01c073-07ef-4746-9c29-2e9b4935aaa2 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:39.549918 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 711/1410] 10.222.0.27 () {54 vars in 918 bytes} [Fri Jul 15 17:30:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:30:39.555981 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5617e72-bc9e-4d60-93ea-adb96fc97223 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:39.556468 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5617e72-bc9e-4d60-93ea-adb96fc97223 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:39.556581 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5617e72-bc9e-4d60-93ea-adb96fc97223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:39.637680 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-b5617e72-bc9e-4d60-93ea-adb96fc97223 None None] MFA Rules not processed for user `96b2105f8d29443383ed51a8fd5cec6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:30:39.638838 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-b5617e72-bc9e-4d60-93ea-adb96fc97223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:39.763899 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 700/1411] 10.222.0.27 () {58 vars in 1015 bytes} [Fri Jul 15 17:30:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:30:39.779123 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d492221-a782-47e5-b3a8-eae4a24fc955 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:39.779415 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d492221-a782-47e5-b3a8-eae4a24fc955 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:39.779690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d492221-a782-47e5-b3a8-eae4a24fc955 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:39.781962 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 712/1412] 10.222.0.27 () {54 vars in 918 bytes} [Fri Jul 15 17:30:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:30:39.786805 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267ddfe-c384-48f2-8b23-17818a29ec20 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:39.787094 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267ddfe-c384-48f2-8b23-17818a29ec20 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:39.787366 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267ddfe-c384-48f2-8b23-17818a29ec20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:39.865236 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:30:39.868527 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-4267ddfe-c384-48f2-8b23-17818a29ec20 None None] MFA Rules not processed for user `f9d548c8199e4fdbbce7597bebd63421`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:30:39.870464 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-4267ddfe-c384-48f2-8b23-17818a29ec20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:39.994946 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 701/1413] 10.222.0.27 () {58 vars in 1015 bytes} [Fri Jul 15 17:30:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:30:42.476284 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71703c5-2bb1-4b0b-9a93-14f70b8b4cd8 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:42.476889 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71703c5-2bb1-4b0b-9a93-14f70b8b4cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:42.476889 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71703c5-2bb1-4b0b-9a93-14f70b8b4cd8 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:42.478231 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 713/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 17:30:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:30:42.484513 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fd019-b2b2-45fa-8c79-1b77b75d49a8 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:42.484960 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fd019-b2b2-45fa-8c79-1b77b75d49a8 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:42.485087 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fd019-b2b2-45fa-8c79-1b77b75d49a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:42.560296 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-cb8fd019-b2b2-45fa-8c79-1b77b75d49a8 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:30:42.561556 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-cb8fd019-b2b2-45fa-8c79-1b77b75d49a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:42.617667 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:30:42.659614 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 702/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 17:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:30:42.705747 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71703c5-2bb1-4b0b-9a93-14f70b8b4cd8 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:30:42.707346 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d71703c5-2bb1-4b0b-9a93-14f70b8b4cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:42.872398 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71703c5-2bb1-4b0b-9a93-14f70b8b4cd8 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:30:42.945753 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:30:42.988643 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fefe49-36f3-40df-b28e-75d8a3aadb36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:30:42.989295 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fefe49-36f3-40df-b28e-75d8a3aadb36 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:42.989571 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fefe49-36f3-40df-b28e-75d8a3aadb36 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:42.989876 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fefe49-36f3-40df-b28e-75d8a3aadb36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:42.991530 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-85fefe49-36f3-40df-b28e-75d8a3aadb36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:43.085681 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fefe49-36f3-40df-b28e-75d8a3aadb36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:30:43.087606 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fefe49-36f3-40df-b28e-75d8a3aadb36 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:30:43.112235 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 714/1416] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:30:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:30:44.020893 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c076ed-a892-4456-9d5b-966090cc25ee None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:44.021465 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c076ed-a892-4456-9d5b-966090cc25ee None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:44.021465 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c076ed-a892-4456-9d5b-966090cc25ee None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:44.022925 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 703/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 17:30:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:30:44.031764 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdd19f-aa57-41a3-b024-9a0371afec29 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:44.032232 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdd19f-aa57-41a3-b024-9a0371afec29 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:44.032349 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdd19f-aa57-41a3-b024-9a0371afec29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:44.121413 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-efbdd19f-aa57-41a3-b024-9a0371afec29 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:30:44.122686 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-efbdd19f-aa57-41a3-b024-9a0371afec29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:44.150946 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:30:44.226398 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 715/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 17:30:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:30:44.385962 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c076ed-a892-4456-9d5b-966090cc25ee None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:30:44.388366 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-23c076ed-a892-4456-9d5b-966090cc25ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:44.563098 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c076ed-a892-4456-9d5b-966090cc25ee None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:30:44.606240 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:30:44.689277 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8eb9bd-4c4f-4d3c-92d9-14df4dfc4c17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:30:44.689969 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8eb9bd-4c4f-4d3c-92d9-14df4dfc4c17 service nova] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:44.690247 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8eb9bd-4c4f-4d3c-92d9-14df4dfc4c17 service nova] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:44.690516 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8eb9bd-4c4f-4d3c-92d9-14df4dfc4c17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:44.692165 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-8f8eb9bd-4c4f-4d3c-92d9-14df4dfc4c17 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:44.781493 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8eb9bd-4c4f-4d3c-92d9-14df4dfc4c17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:30:44.783117 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8eb9bd-4c4f-4d3c-92d9-14df4dfc4c17 service nova] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:30:44.801395 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 704/1419] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:30:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:30:45.685577 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e41bc-08c3-4a3d-b191-ab931b0f9fd0 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:45.686613 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e41bc-08c3-4a3d-b191-ab931b0f9fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:45.686613 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e41bc-08c3-4a3d-b191-ab931b0f9fd0 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:45.687934 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 716/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 17:30:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:30:45.693172 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3de494-d3f5-4921-9fed-d6006b432228 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:45.693669 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3de494-d3f5-4921-9fed-d6006b432228 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:45.693669 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3de494-d3f5-4921-9fed-d6006b432228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:45.760778 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:30:45.790522 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-dc3de494-d3f5-4921-9fed-d6006b432228 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:30:45.791740 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-dc3de494-d3f5-4921-9fed-d6006b432228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:45.895789 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 705/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 17:30:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:30:46.048412 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e41bc-08c3-4a3d-b191-ab931b0f9fd0 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:30:46.050608 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-9c8e41bc-08c3-4a3d-b191-ab931b0f9fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:46.215349 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e41bc-08c3-4a3d-b191-ab931b0f9fd0 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:30:46.228679 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:30:46.336910 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fef9d5-b7e7-41fe-a5bd-e0a5b9d6c984 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:30:46.337597 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fef9d5-b7e7-41fe-a5bd-e0a5b9d6c984 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:46.337908 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fef9d5-b7e7-41fe-a5bd-e0a5b9d6c984 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:46.338175 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fef9d5-b7e7-41fe-a5bd-e0a5b9d6c984 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:46.339848 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-54fef9d5-b7e7-41fe-a5bd-e0a5b9d6c984 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:46.432167 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fef9d5-b7e7-41fe-a5bd-e0a5b9d6c984 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:30:46.433753 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fef9d5-b7e7-41fe-a5bd-e0a5b9d6c984 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:30:46.454144 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 717/1422] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:30:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:30:47.331624 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4182f30-4ada-4c03-8b68-d379bed48516 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:47.332169 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4182f30-4ada-4c03-8b68-d379bed48516 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:47.332169 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4182f30-4ada-4c03-8b68-d379bed48516 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:47.333582 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 706/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 17:30:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:30:47.338978 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0226b9-6c45-4a86-bacb-dacc65618bb9 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:47.339424 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0226b9-6c45-4a86-bacb-dacc65618bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:47.339541 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0226b9-6c45-4a86-bacb-dacc65618bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:47.363825 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:30:47.425931 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-ad0226b9-6c45-4a86-bacb-dacc65618bb9 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:30:47.427160 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ad0226b9-6c45-4a86-bacb-dacc65618bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:47.531267 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 718/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 17:30:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:30:47.703411 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4182f30-4ada-4c03-8b68-d379bed48516 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:30:47.704817 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-e4182f30-4ada-4c03-8b68-d379bed48516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:47.827445 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:30:47.869884 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4182f30-4ada-4c03-8b68-d379bed48516 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:30:47.991220 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d0077b-ffb0-4203-8a0b-8ad589042604 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:30:47.992022 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0077b-ffb0-4203-8a0b-8ad589042604 service nova] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:47.992369 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0077b-ffb0-4203-8a0b-8ad589042604 service nova] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:47.992709 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0077b-ffb0-4203-8a0b-8ad589042604 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:47.995305 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-52d0077b-ffb0-4203-8a0b-8ad589042604 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:48.075342 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:30:48.090348 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d0077b-ffb0-4203-8a0b-8ad589042604 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:30:48.091958 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d0077b-ffb0-4203-8a0b-8ad589042604 service nova] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:30:48.113036 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 707/1425] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:30:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:30:48.977163 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14b6b0-3258-472b-bb52-6cc3dffe4671 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:48.977812 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14b6b0-3258-472b-bb52-6cc3dffe4671 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:48.977812 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14b6b0-3258-472b-bb52-6cc3dffe4671 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:48.979123 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 719/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 17:30:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:30:48.985111 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35a65a-22de-49a6-b5dd-bb95ccecdf36 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:48.985894 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35a65a-22de-49a6-b5dd-bb95ccecdf36 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:48.986043 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35a65a-22de-49a6-b5dd-bb95ccecdf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:49.090340 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-2c35a65a-22de-49a6-b5dd-bb95ccecdf36 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:30:49.091559 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-2c35a65a-22de-49a6-b5dd-bb95ccecdf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:49.200042 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 708/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 17:30:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:30:49.348885 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf14b6b0-3258-472b-bb52-6cc3dffe4671 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:30:49.350475 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-cf14b6b0-3258-472b-bb52-6cc3dffe4671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:49.442846 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:30:49.508728 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf14b6b0-3258-472b-bb52-6cc3dffe4671 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:30:49.632835 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b2275-5079-4b5d-a46f-8a4058e8e8d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:30:49.633435 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b2275-5079-4b5d-a46f-8a4058e8e8d7 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:49.633707 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b2275-5079-4b5d-a46f-8a4058e8e8d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:49.634011 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b2275-5079-4b5d-a46f-8a4058e8e8d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:49.635658 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-242b2275-5079-4b5d-a46f-8a4058e8e8d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:49.685305 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:30:49.732919 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b2275-5079-4b5d-a46f-8a4058e8e8d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:30:49.734687 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b2275-5079-4b5d-a46f-8a4058e8e8d7 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:30:49.753552 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 720/1428] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:30:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:30:50.562318 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ea842-d39a-4666-862e-7bbc52abbeac None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:50.562880 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ea842-d39a-4666-862e-7bbc52abbeac None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:50.562880 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ea842-d39a-4666-862e-7bbc52abbeac None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:50.564421 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 709/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 17:30:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:30:50.570487 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd848e03-e8e4-4ad3-b66d-6ccf87c5f0eb None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:50.570930 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd848e03-e8e4-4ad3-b66d-6ccf87c5f0eb None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:50.571048 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd848e03-e8e4-4ad3-b66d-6ccf87c5f0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:50.649805 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-bd848e03-e8e4-4ad3-b66d-6ccf87c5f0eb None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:30:50.651017 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-bd848e03-e8e4-4ad3-b66d-6ccf87c5f0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:50.767617 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 721/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 17:30:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:30:50.923575 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ea842-d39a-4666-862e-7bbc52abbeac None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:30:50.925015 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-e43ea842-d39a-4666-862e-7bbc52abbeac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:50.978050 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:30:51.099973 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ea842-d39a-4666-862e-7bbc52abbeac None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:30:51.226162 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6c5d5-d4b7-4031-820c-c0f86f8ff79f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:30:51.226878 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6c5d5-d4b7-4031-820c-c0f86f8ff79f service nova] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:51.227173 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6c5d5-d4b7-4031-820c-c0f86f8ff79f service nova] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:51.227466 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6c5d5-d4b7-4031-820c-c0f86f8ff79f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:51.229895 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-d6f6c5d5-d4b7-4031-820c-c0f86f8ff79f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:51.238291 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:30:51.337765 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f6c5d5-d4b7-4031-820c-c0f86f8ff79f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:30:51.339428 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f6c5d5-d4b7-4031-820c-c0f86f8ff79f service nova] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:30:51.357977 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 710/1431] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:30:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:30:52.172794 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5be44-0581-4d27-aa76-57859636a8da None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:52.173321 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5be44-0581-4d27-aa76-57859636a8da None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:52.173321 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5be44-0581-4d27-aa76-57859636a8da None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:52.175566 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 722/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 17:30:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:30:52.184291 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2c911-797e-4c28-ad84-6d61406362a4 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:52.184691 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2c911-797e-4c28-ad84-6d61406362a4 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:52.184836 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2c911-797e-4c28-ad84-6d61406362a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:52.274983 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-1ee2c911-797e-4c28-ad84-6d61406362a4 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:30:52.276228 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-1ee2c911-797e-4c28-ad84-6d61406362a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:52.359113 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:30:52.408336 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 711/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 17:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:30:52.568388 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5be44-0581-4d27-aa76-57859636a8da None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:30:52.570759 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-deb5be44-0581-4d27-aa76-57859636a8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:52.597797 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:30:52.734219 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5be44-0581-4d27-aa76-57859636a8da None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:30:52.830594 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:30:52.980613 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb4cc7-73e1-484f-82a3-d51f7a3816a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:30:52.981291 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb4cc7-73e1-484f-82a3-d51f7a3816a8 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:52.981590 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb4cc7-73e1-484f-82a3-d51f7a3816a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:52.981864 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb4cc7-73e1-484f-82a3-d51f7a3816a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:52.983623 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-06cb4cc7-73e1-484f-82a3-d51f7a3816a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:53.075533 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb4cc7-73e1-484f-82a3-d51f7a3816a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:30:53.077046 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb4cc7-73e1-484f-82a3-d51f7a3816a8 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:30:53.095176 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 723/1434] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:30:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:30:53.915422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d991da-48c6-4b9a-83d0-ca3694d5a973 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:53.916333 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d991da-48c6-4b9a-83d0-ca3694d5a973 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:53.916333 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d991da-48c6-4b9a-83d0-ca3694d5a973 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:53.918459 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 712/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 17:30:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:30:53.926757 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094f514-096b-45ff-90cb-3f33655535d6 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:53.927508 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094f514-096b-45ff-90cb-3f33655535d6 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:53.927691 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094f514-096b-45ff-90cb-3f33655535d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:54.007829 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-1094f514-096b-45ff-90cb-3f33655535d6 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:30:54.009062 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1094f514-096b-45ff-90cb-3f33655535d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:54.056425 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:30:54.125015 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 724/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 17:30:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:30:54.279980 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d991da-48c6-4b9a-83d0-ca3694d5a973 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:30:54.282813 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-f6d991da-48c6-4b9a-83d0-ca3694d5a973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:54.456334 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d991da-48c6-4b9a-83d0-ca3694d5a973 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:30:54.516591 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:30:54.587149 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0fc31-3a2f-4208-9c21-be20ad8c7d65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:30:54.587914 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0fc31-3a2f-4208-9c21-be20ad8c7d65 service nova] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:54.588246 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0fc31-3a2f-4208-9c21-be20ad8c7d65 service nova] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:54.588627 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0fc31-3a2f-4208-9c21-be20ad8c7d65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:54.591118 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-19e0fc31-3a2f-4208-9c21-be20ad8c7d65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:54.695936 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0fc31-3a2f-4208-9c21-be20ad8c7d65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:30:54.697519 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0fc31-3a2f-4208-9c21-be20ad8c7d65 service nova] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:30:54.716260 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 713/1437] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:30:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:30:55.512403 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f902e-ffb3-4d5c-8279-c99294fa7da1 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:55.513309 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f902e-ffb3-4d5c-8279-c99294fa7da1 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:55.513309 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f902e-ffb3-4d5c-8279-c99294fa7da1 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:55.516085 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 725/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 17:30:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:30:55.524347 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5507ef-0d5a-44ab-8bde-5d0b46632371 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:55.524800 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5507ef-0d5a-44ab-8bde-5d0b46632371 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:55.524959 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5507ef-0d5a-44ab-8bde-5d0b46632371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:55.603801 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-fb5507ef-0d5a-44ab-8bde-5d0b46632371 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:30:55.604950 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-fb5507ef-0d5a-44ab-8bde-5d0b46632371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:55.607165 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:30:55.713276 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 714/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 17:30:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:30:55.866905 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f902e-ffb3-4d5c-8279-c99294fa7da1 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:30:55.868317 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1b5f902e-ffb3-4d5c-8279-c99294fa7da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:56.040436 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f902e-ffb3-4d5c-8279-c99294fa7da1 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:30:56.073643 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:30:56.176108 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24586787-b434-4275-bc2e-ee1538d9dc6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:30:56.176674 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24586787-b434-4275-bc2e-ee1538d9dc6b service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:56.176964 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24586787-b434-4275-bc2e-ee1538d9dc6b service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:56.177231 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24586787-b434-4275-bc2e-ee1538d9dc6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:56.184659 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-24586787-b434-4275-bc2e-ee1538d9dc6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:56.287929 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24586787-b434-4275-bc2e-ee1538d9dc6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:30:56.289695 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24586787-b434-4275-bc2e-ee1538d9dc6b service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:30:56.311960 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 726/1440] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:30:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:30:58.300167 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae251164-82d9-409f-92cd-017ed4a87997 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:58.300750 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae251164-82d9-409f-92cd-017ed4a87997 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:58.300750 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae251164-82d9-409f-92cd-017ed4a87997 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:58.302367 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 715/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 17:30:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:30:58.308047 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba8c01-5843-4f49-9825-d7442e721994 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:58.308526 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba8c01-5843-4f49-9825-d7442e721994 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:58.308637 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba8c01-5843-4f49-9825-d7442e721994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:58.349035 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:30:58.375114 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-a3ba8c01-5843-4f49-9825-d7442e721994 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:30:58.376354 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a3ba8c01-5843-4f49-9825-d7442e721994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:58.475142 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 727/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 17:30:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:30:58.526003 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae251164-82d9-409f-92cd-017ed4a87997 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:30:58.527598 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-ae251164-82d9-409f-92cd-017ed4a87997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:58.649975 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae251164-82d9-409f-92cd-017ed4a87997 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:30:58.687258 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:30:58.730708 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b775684f-2164-464f-955e-dbb38aca5574 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:30:58.731365 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775684f-2164-464f-955e-dbb38aca5574 service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:30:58.731650 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775684f-2164-464f-955e-dbb38aca5574 service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:30:58.731920 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775684f-2164-464f-955e-dbb38aca5574 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:30:58.733672 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-b775684f-2164-464f-955e-dbb38aca5574 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:30:58.860280 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b775684f-2164-464f-955e-dbb38aca5574 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:30:58.861710 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b775684f-2164-464f-955e-dbb38aca5574 service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:30:58.882263 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 716/1443] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:30:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:31:01.022446 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9022c6-2811-4980-88d6-ca55125cdde3 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:31:01.023039 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9022c6-2811-4980-88d6-ca55125cdde3 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:31:01.023039 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9022c6-2811-4980-88d6-ca55125cdde3 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:31:01.024376 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 728/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 17:31:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:31:01.030019 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c975027-5fbe-48f8-9cef-f9c39d59d926 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:31:01.030600 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c975027-5fbe-48f8-9cef-f9c39d59d926 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:31:01.030772 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c975027-5fbe-48f8-9cef-f9c39d59d926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:31:01.100455 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-6c975027-5fbe-48f8-9cef-f9c39d59d926 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:31:01.101816 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-6c975027-5fbe-48f8-9cef-f9c39d59d926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:31:01.115001 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:31:01.201365 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 717/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 17:31:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:31:01.247727 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9022c6-2811-4980-88d6-ca55125cdde3 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:31:01.249292 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-2f9022c6-2811-4980-88d6-ca55125cdde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:31:01.357327 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9022c6-2811-4980-88d6-ca55125cdde3 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:31:01.369950 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:31:01.439481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b1725-4d38-4cab-b9cf-36e63ba293f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:31:01.440474 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b1725-4d38-4cab-b9cf-36e63ba293f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:31:01.440756 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b1725-4d38-4cab-b9cf-36e63ba293f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:31:01.441025 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b1725-4d38-4cab-b9cf-36e63ba293f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:31:01.442693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-6c9b1725-4d38-4cab-b9cf-36e63ba293f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:31:01.569937 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9b1725-4d38-4cab-b9cf-36e63ba293f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:31:01.571385 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9b1725-4d38-4cab-b9cf-36e63ba293f0 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:31:01.591135 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 729/1446] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:31:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:31:03.925562 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69ec9c-b86d-45f8-bb70-1571b1deeae5 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:31:03.926571 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69ec9c-b86d-45f8-bb70-1571b1deeae5 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:31:03.926571 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69ec9c-b86d-45f8-bb70-1571b1deeae5 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:31:03.928737 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 718/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 17:31:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:31:03.936396 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020b258-2f08-4ac7-824e-e2b74a6e4259 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:31:03.936839 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020b258-2f08-4ac7-824e-e2b74a6e4259 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:31:03.937037 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020b258-2f08-4ac7-824e-e2b74a6e4259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:31:03.987139 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:31:04.010438 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-f020b258-2f08-4ac7-824e-e2b74a6e4259 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:31:04.011656 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f020b258-2f08-4ac7-824e-e2b74a6e4259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:31:04.115064 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 730/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 17:31:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:31:04.154092 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69ec9c-b86d-45f8-bb70-1571b1deeae5 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:31:04.155677 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-1d69ec9c-b86d-45f8-bb70-1571b1deeae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:31:04.272749 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69ec9c-b86d-45f8-bb70-1571b1deeae5 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:31:04.318535 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:31:04.354065 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5401d7a-2772-434d-9b4f-41abcae60e95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:31:04.354728 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5401d7a-2772-434d-9b4f-41abcae60e95 service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:31:04.355006 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5401d7a-2772-434d-9b4f-41abcae60e95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:31:04.355275 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5401d7a-2772-434d-9b4f-41abcae60e95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:31:04.356954 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-e5401d7a-2772-434d-9b4f-41abcae60e95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:31:04.484238 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5401d7a-2772-434d-9b4f-41abcae60e95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:31:04.485686 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5401d7a-2772-434d-9b4f-41abcae60e95 service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:31:04.505269 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 719/1449] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:31:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:31:06.662819 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd36baf-3df7-4038-9039-e9294b597696 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:31:06.663389 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd36baf-3df7-4038-9039-e9294b597696 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:31:06.663389 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd36baf-3df7-4038-9039-e9294b597696 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:31:06.664646 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 731/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 17:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:31:06.671897 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7bd57-9567-43b7-9fb5-f3cc9c29cb77 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:31:06.672597 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7bd57-9567-43b7-9fb5-f3cc9c29cb77 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:31:06.672597 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7bd57-9567-43b7-9fb5-f3cc9c29cb77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:31:06.742285 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-57d7bd57-9567-43b7-9fb5-f3cc9c29cb77 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:31:06.743483 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-57d7bd57-9567-43b7-9fb5-f3cc9c29cb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:31:06.764625 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:31:06.848814 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 720/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 17:31:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:31:06.887216 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd36baf-3df7-4038-9039-e9294b597696 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:31:06.888759 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-4cd36baf-3df7-4038-9039-e9294b597696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:31:06.998993 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd36baf-3df7-4038-9039-e9294b597696 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:31:07.023281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:31:07.079504 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d3ff2-1fe5-483b-8893-e01c38777ae4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:31:07.080152 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d3ff2-1fe5-483b-8893-e01c38777ae4 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:31:07.080429 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d3ff2-1fe5-483b-8893-e01c38777ae4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:31:07.080695 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d3ff2-1fe5-483b-8893-e01c38777ae4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:31:07.082351 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a58d3ff2-1fe5-483b-8893-e01c38777ae4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:31:07.198558 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d3ff2-1fe5-483b-8893-e01c38777ae4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:31:07.200378 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d3ff2-1fe5-483b-8893-e01c38777ae4 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:31:07.218959 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 732/1452] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:31:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:31:09.342446 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7c253-f89f-4082-88a8-cf2941a0eebf None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:31:09.343155 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7c253-f89f-4082-88a8-cf2941a0eebf None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:31:09.343155 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7c253-f89f-4082-88a8-cf2941a0eebf None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:31:09.344620 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 721/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 17:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:31:09.350186 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616aece9-1724-461e-833d-449f4c7b6943 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:31:09.350637 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616aece9-1724-461e-833d-449f4c7b6943 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:31:09.350740 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616aece9-1724-461e-833d-449f4c7b6943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:31:09.416076 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:31:09.419559 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-616aece9-1724-461e-833d-449f4c7b6943 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:31:09.421499 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-616aece9-1724-461e-833d-449f4c7b6943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:31:09.521837 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 733/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 17:31:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:31:09.559992 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae7c253-f89f-4082-88a8-cf2941a0eebf None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:31:09.561574 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-8ae7c253-f89f-4082-88a8-cf2941a0eebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:31:09.678065 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae7c253-f89f-4082-88a8-cf2941a0eebf None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:31:09.736714 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:31:09.763307 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d03848-78ba-4803-973c-69e88cc9e52b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:31:09.763954 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d03848-78ba-4803-973c-69e88cc9e52b service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:31:09.764233 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d03848-78ba-4803-973c-69e88cc9e52b service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:31:09.764515 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d03848-78ba-4803-973c-69e88cc9e52b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:31:09.766412 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-50d03848-78ba-4803-973c-69e88cc9e52b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:31:09.890467 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d03848-78ba-4803-973c-69e88cc9e52b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:31:09.891898 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d03848-78ba-4803-973c-69e88cc9e52b service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:31:09.910189 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 722/1455] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:31:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:31:11.949866 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f123c9-55cd-4c41-bc68-3699cf5aa824 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:31:11.950662 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f123c9-55cd-4c41-bc68-3699cf5aa824 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:31:11.950810 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f123c9-55cd-4c41-bc68-3699cf5aa824 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:31:11.953468 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 734/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 17:31:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:31:11.960015 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f139e0-a07c-420f-a729-eee9de9bdcde None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:31:11.960772 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f139e0-a07c-420f-a729-eee9de9bdcde None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:31:11.960912 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f139e0-a07c-420f-a729-eee9de9bdcde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:31:12.035927 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-96f139e0-a07c-420f-a729-eee9de9bdcde None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:31:12.037164 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-96f139e0-a07c-420f-a729-eee9de9bdcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:31:12.067451 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:31:12.142682 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 723/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 17:31:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:31:12.191814 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f123c9-55cd-4c41-bc68-3699cf5aa824 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:31:12.193286 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b2f123c9-55cd-4c41-bc68-3699cf5aa824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:31:12.312801 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f123c9-55cd-4c41-bc68-3699cf5aa824 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:31:12.342604 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:31:12.394801 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cffc1c6-26b3-45da-8c67-bff59db6299d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:31:12.395463 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffc1c6-26b3-45da-8c67-bff59db6299d service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:31:12.395738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffc1c6-26b3-45da-8c67-bff59db6299d service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:31:12.395991 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffc1c6-26b3-45da-8c67-bff59db6299d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:31:12.397661 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-3cffc1c6-26b3-45da-8c67-bff59db6299d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:31:12.519474 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cffc1c6-26b3-45da-8c67-bff59db6299d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:31:12.520915 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cffc1c6-26b3-45da-8c67-bff59db6299d service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:31:12.539414 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 735/1458] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:31:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:31:14.673006 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a52088-cabb-4e05-947d-6b1dd37a20ae None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:31:14.673006 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a52088-cabb-4e05-947d-6b1dd37a20ae None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:31:14.674115 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a52088-cabb-4e05-947d-6b1dd37a20ae None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:31:14.675713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 724/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 17:31:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:31:14.681284 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad039e58-f2a8-4722-99df-ea6663c92865 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:31:14.681710 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad039e58-f2a8-4722-99df-ea6663c92865 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:31:14.681849 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad039e58-f2a8-4722-99df-ea6663c92865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:31:14.747546 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-ad039e58-f2a8-4722-99df-ea6663c92865 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:31:14.748733 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ad039e58-f2a8-4722-99df-ea6663c92865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:31:14.757004 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:31:14.855523 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 736/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 17:31:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:31:14.899707 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a52088-cabb-4e05-947d-6b1dd37a20ae None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:31:14.902138 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-d0a52088-cabb-4e05-947d-6b1dd37a20ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:31:15.019080 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a52088-cabb-4e05-947d-6b1dd37a20ae None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:31:15.079059 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:31:15.099414 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d2c7e2-1049-40da-8d75-a3bc056616e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:31:15.100072 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2c7e2-1049-40da-8d75-a3bc056616e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:31:15.100349 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2c7e2-1049-40da-8d75-a3bc056616e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:31:15.100621 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2c7e2-1049-40da-8d75-a3bc056616e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:31:15.102288 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-d1d2c7e2-1049-40da-8d75-a3bc056616e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:31:15.216553 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d2c7e2-1049-40da-8d75-a3bc056616e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:31:15.218012 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d2c7e2-1049-40da-8d75-a3bc056616e8 service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:31:15.236650 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 725/1461] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:31:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:31:17.267446 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e56a06-be47-48ec-8395-914a35684d77 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:31:17.268395 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e56a06-be47-48ec-8395-914a35684d77 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:31:17.268395 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e56a06-be47-48ec-8395-914a35684d77 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:31:17.270610 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 737/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 17:31:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:31:17.279554 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ff3c5-e641-4c97-98b5-301da6219f5e None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:31:17.279999 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ff3c5-e641-4c97-98b5-301da6219f5e None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:31:17.280103 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ff3c5-e641-4c97-98b5-301da6219f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:31:17.351244 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-915ff3c5-e641-4c97-98b5-301da6219f5e None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:31:17.352443 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-915ff3c5-e641-4c97-98b5-301da6219f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:31:17.392409 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:31:17.454621 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 726/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 17:31:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:31:17.492885 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e56a06-be47-48ec-8395-914a35684d77 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:31:17.495093 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e8e56a06-be47-48ec-8395-914a35684d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:31:17.628184 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e56a06-be47-48ec-8395-914a35684d77 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:31:17.674664 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:31:17.721096 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b200f37-805a-4c5f-a665-422d51f21b98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:31:17.721797 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b200f37-805a-4c5f-a665-422d51f21b98 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:31:17.722091 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b200f37-805a-4c5f-a665-422d51f21b98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:31:17.722367 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b200f37-805a-4c5f-a665-422d51f21b98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:31:17.724024 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1b200f37-805a-4c5f-a665-422d51f21b98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:31:17.840014 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b200f37-805a-4c5f-a665-422d51f21b98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:31:17.841443 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b200f37-805a-4c5f-a665-422d51f21b98 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:31:17.861576 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 738/1464] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:31:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:31:19.871243 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abeeb07-40a8-45c8-af3d-46cc6264d017 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:31:19.872162 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abeeb07-40a8-45c8-af3d-46cc6264d017 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:31:19.872162 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abeeb07-40a8-45c8-af3d-46cc6264d017 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:31:19.875021 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 727/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 17:31:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:31:19.881379 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d38f31-b9c3-4027-b79e-d1c2b6a47fd0 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:31:19.882183 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d38f31-b9c3-4027-b79e-d1c2b6a47fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:31:19.882354 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d38f31-b9c3-4027-b79e-d1c2b6a47fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:31:19.953712 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-a9d38f31-b9c3-4027-b79e-d1c2b6a47fd0 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:31:19.954956 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a9d38f31-b9c3-4027-b79e-d1c2b6a47fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:31:19.974980 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:31:20.059074 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 739/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 17:31:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:31:20.095997 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abeeb07-40a8-45c8-af3d-46cc6264d017 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:31:20.097546 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-8abeeb07-40a8-45c8-af3d-46cc6264d017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:31:20.219059 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abeeb07-40a8-45c8-af3d-46cc6264d017 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:31:20.287011 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:31:20.294820 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391fef5-648b-4b1a-b1cd-49aaea6e165d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:31:20.295483 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391fef5-648b-4b1a-b1cd-49aaea6e165d service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:31:20.295766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391fef5-648b-4b1a-b1cd-49aaea6e165d service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:31:20.296045 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391fef5-648b-4b1a-b1cd-49aaea6e165d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:31:20.297933 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-2391fef5-648b-4b1a-b1cd-49aaea6e165d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:31:20.417816 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2391fef5-648b-4b1a-b1cd-49aaea6e165d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:31:20.419276 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2391fef5-648b-4b1a-b1cd-49aaea6e165d service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:31:20.442382 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 728/1467] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:31:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:31:22.483847 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc3c3b-c8bc-452a-81a7-6b116de22533 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:31:22.484478 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc3c3b-c8bc-452a-81a7-6b116de22533 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:31:22.484478 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc3c3b-c8bc-452a-81a7-6b116de22533 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:31:22.485929 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 740/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 17:31:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:31:22.492228 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562b766-9858-4364-b50e-d74acb21dab7 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:31:22.492672 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562b766-9858-4364-b50e-d74acb21dab7 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:31:22.492838 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562b766-9858-4364-b50e-d74acb21dab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:31:22.564208 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-1562b766-9858-4364-b50e-d74acb21dab7 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:31:22.565358 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-1562b766-9858-4364-b50e-d74acb21dab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:31:22.619530 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:31:22.672039 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 729/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 17:31:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:31:22.711821 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc3c3b-c8bc-452a-81a7-6b116de22533 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:31:22.714199 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-60bc3c3b-c8bc-452a-81a7-6b116de22533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:31:22.842818 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc3c3b-c8bc-452a-81a7-6b116de22533 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:31:22.893405 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:31:22.921704 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c551cb9-5edd-4d31-b855-5e6dd8f9f29e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:31:22.922543 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c551cb9-5edd-4d31-b855-5e6dd8f9f29e service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:31:22.922831 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c551cb9-5edd-4d31-b855-5e6dd8f9f29e service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:31:22.923106 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c551cb9-5edd-4d31-b855-5e6dd8f9f29e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:31:22.924758 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-0c551cb9-5edd-4d31-b855-5e6dd8f9f29e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:31:23.039069 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c551cb9-5edd-4d31-b855-5e6dd8f9f29e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:31:23.040498 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c551cb9-5edd-4d31-b855-5e6dd8f9f29e service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:31:23.062217 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 741/1470] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:31:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:31:32.669727 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=22 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:31:33.059189 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=66 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:31:42.647617 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a0d207-b1a8-4b51-92d7-8ebd0489471c None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:31:42.648194 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a0d207-b1a8-4b51-92d7-8ebd0489471c None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:31:42.648194 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a0d207-b1a8-4b51-92d7-8ebd0489471c None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:31:42.649479 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 730/1471] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:31:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:31:42.655964 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d751f-44e2-4566-9baa-4db011c02071 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:31:42.656612 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d751f-44e2-4566-9baa-4db011c02071 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:31:42.656718 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d751f-44e2-4566-9baa-4db011c02071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:31:42.728362 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-916d751f-44e2-4566-9baa-4db011c02071 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:31:42.729575 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-916d751f-44e2-4566-9baa-4db011c02071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:31:42.837963 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 742/1472] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:31:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:31:42.891739 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9c033-5bfe-4a27-a6ea-9064a1d4888f None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:31:42.892093 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9c033-5bfe-4a27-a6ea-9064a1d4888f None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:31:42.892372 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9c033-5bfe-4a27-a6ea-9064a1d4888f None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:31:42.893819 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 731/1473] 10.222.0.27 () {54 vars in 960 bytes} [Fri Jul 15 17:31:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:31:42.899722 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a6d42-c1e1-4cf4-86ab-4b3811c9c5b2 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:31:42.899980 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a6d42-c1e1-4cf4-86ab-4b3811c9c5b2 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:31:42.900383 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a6d42-c1e1-4cf4-86ab-4b3811c9c5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:31:42.982667 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-0f2a6d42-c1e1-4cf4-86ab-4b3811c9c5b2 None None] MFA Rules not processed for user `14775984c9d4463a8e8848dcf189714b`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:31:42.983882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-0f2a6d42-c1e1-4cf4-86ab-4b3811c9c5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:31:43.006833 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:31:43.066845 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 743/1474] 10.222.0.27 () {58 vars in 1057 bytes} [Fri Jul 15 17:31:42 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:31:43.074868 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9c033-5bfe-4a27-a6ea-9064a1d4888f None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:31:43.076407 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-15b9c033-5bfe-4a27-a6ea-9064a1d4888f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:31:43.193625 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9c033-5bfe-4a27-a6ea-9064a1d4888f None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:31:43.270685 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a45cec-764f-4c17-b535-635d2f83dac9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14775984c9d4463a8e8848dcf189714b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:31:43.271336 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a45cec-764f-4c17-b535-635d2f83dac9 service glance] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:31:43.271624 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a45cec-764f-4c17-b535-635d2f83dac9 service glance] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:31:43.271895 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a45cec-764f-4c17-b535-635d2f83dac9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:31:43.273524 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-b3a45cec-764f-4c17-b535-635d2f83dac9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:31:43.332590 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:31:43.390517 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a45cec-764f-4c17-b535-635d2f83dac9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:31:43.392318 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a45cec-764f-4c17-b535-635d2f83dac9 service glance] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:31:43.411471 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 732/1475] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:31:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:31:45.570616 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e2079-f17c-4a56-86a8-416b71e10d51 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:31:45.571435 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e2079-f17c-4a56-86a8-416b71e10d51 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:31:45.571435 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e2079-f17c-4a56-86a8-416b71e10d51 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:31:45.573521 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 744/1476] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:31:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:31:45.579401 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f1362-b946-46f7-b6a9-38399797c954 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:31:45.579850 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f1362-b946-46f7-b6a9-38399797c954 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:31:45.579955 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f1362-b946-46f7-b6a9-38399797c954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:31:45.646870 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-255f1362-b946-46f7-b6a9-38399797c954 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:31:45.648076 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-255f1362-b946-46f7-b6a9-38399797c954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:31:45.754323 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 733/1477] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:31:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:31:45.778075 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e2079-f17c-4a56-86a8-416b71e10d51 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:31:45.780398 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a86e2079-f17c-4a56-86a8-416b71e10d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:31:45.919969 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e2079-f17c-4a56-86a8-416b71e10d51 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:31:45.973144 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:31:46.022648 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a7311-9319-4ccf-be36-00f3c955d993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:31:46.023310 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a7311-9319-4ccf-be36-00f3c955d993 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:31:46.023587 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a7311-9319-4ccf-be36-00f3c955d993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:31:46.023856 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a7311-9319-4ccf-be36-00f3c955d993 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:31:46.024583 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a7311-9319-4ccf-be36-00f3c955d993 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:31:46.026333 dv-cinder-836973-11-smb devstack@keystone.service[80149]: WARNING py.warnings [None req-228a7311-9319-4ccf-be36-00f3c955d993 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 17:31:46.026333 dv-cinder-836973-11-smb devstack@keystone.service[80149]: warnings.warn(msg) Jul 15 17:31:46.026333 dv-cinder-836973-11-smb devstack@keystone.service[80149]: Jul 15 17:31:46.027466 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a7311-9319-4ccf-be36-00f3c955d993 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:31:46.047350 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 745/1478] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Jul 15 17:31:45 2022] GET /identity/v3/projects => generated 2553 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:31:48.087271 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4e4c0-6f86-4939-9d1c-8eda38830d6b None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:31:48.087921 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4e4c0-6f86-4939-9d1c-8eda38830d6b None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:31:48.087921 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4e4c0-6f86-4939-9d1c-8eda38830d6b None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:31:48.089241 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 734/1479] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:31:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:31:48.096196 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83b1bc-c58c-40e0-acd5-35371196b007 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:31:48.096698 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83b1bc-c58c-40e0-acd5-35371196b007 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:31:48.096698 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83b1bc-c58c-40e0-acd5-35371196b007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:31:48.165503 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-bf83b1bc-c58c-40e0-acd5-35371196b007 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:31:48.167520 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-bf83b1bc-c58c-40e0-acd5-35371196b007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:31:48.275899 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 746/1480] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:31:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:31:48.319788 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd4e4c0-6f86-4939-9d1c-8eda38830d6b None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:31:48.321367 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-9fd4e4c0-6f86-4939-9d1c-8eda38830d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:31:48.332055 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:31:48.477592 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd4e4c0-6f86-4939-9d1c-8eda38830d6b None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:31:48.571067 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:31:48.607501 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd9caf4-841a-4b3e-8b65-e49a46bd8fef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:31:48.608156 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9caf4-841a-4b3e-8b65-e49a46bd8fef service nova] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:31:48.608435 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9caf4-841a-4b3e-8b65-e49a46bd8fef service nova] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:31:48.608706 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9caf4-841a-4b3e-8b65-e49a46bd8fef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:31:48.610390 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-ffd9caf4-841a-4b3e-8b65-e49a46bd8fef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:31:48.710483 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd9caf4-841a-4b3e-8b65-e49a46bd8fef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:31:48.712853 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd9caf4-841a-4b3e-8b65-e49a46bd8fef service nova] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:31:48.733596 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 735/1481] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:31:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:31:50.967964 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954df30-a0b1-42ed-88c5-9d2a9e9343ae None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:31:50.968575 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954df30-a0b1-42ed-88c5-9d2a9e9343ae None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:31:50.968575 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954df30-a0b1-42ed-88c5-9d2a9e9343ae None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:31:50.969998 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 747/1482] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:31:50.976387 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff441cb4-8ad9-4b86-b5b1-ca82084b4bf0 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:31:50.977199 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff441cb4-8ad9-4b86-b5b1-ca82084b4bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:31:50.977364 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff441cb4-8ad9-4b86-b5b1-ca82084b4bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:31:51.056924 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-ff441cb4-8ad9-4b86-b5b1-ca82084b4bf0 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:31:51.058180 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-ff441cb4-8ad9-4b86-b5b1-ca82084b4bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:31:51.120929 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:31:51.182399 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 736/1483] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:31:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:31:51.226546 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e954df30-a0b1-42ed-88c5-9d2a9e9343ae None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:31:51.228850 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e954df30-a0b1-42ed-88c5-9d2a9e9343ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:31:51.258443 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:31:51.348895 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e954df30-a0b1-42ed-88c5-9d2a9e9343ae None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:31:51.430219 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d0bb9-52ed-40ca-a90c-e908ef40d8bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:31:51.430891 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d0bb9-52ed-40ca-a90c-e908ef40d8bf service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:31:51.431168 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d0bb9-52ed-40ca-a90c-e908ef40d8bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:31:51.431452 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d0bb9-52ed-40ca-a90c-e908ef40d8bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:31:51.433059 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c43d0bb9-52ed-40ca-a90c-e908ef40d8bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:31:51.517998 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:31:51.562400 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d0bb9-52ed-40ca-a90c-e908ef40d8bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:31:51.563857 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d0bb9-52ed-40ca-a90c-e908ef40d8bf service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:31:51.584792 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 748/1484] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:31:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:31:53.658680 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d3891-dfc9-4363-b517-5f7eb89694ec None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:31:53.659280 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d3891-dfc9-4363-b517-5f7eb89694ec None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:31:53.659280 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d3891-dfc9-4363-b517-5f7eb89694ec None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:31:53.660600 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 737/1485] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:31:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:31:53.667126 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083e97e-b713-4300-840b-b55575d7dbd6 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:31:53.667917 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083e97e-b713-4300-840b-b55575d7dbd6 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:31:53.667917 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083e97e-b713-4300-840b-b55575d7dbd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:31:53.739508 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-6083e97e-b713-4300-840b-b55575d7dbd6 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:31:53.740631 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-6083e97e-b713-4300-840b-b55575d7dbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:31:53.839802 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 749/1486] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:31:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:31:53.877656 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d3891-dfc9-4363-b517-5f7eb89694ec None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:31:53.879205 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-ef3d3891-dfc9-4363-b517-5f7eb89694ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:31:53.986277 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d3891-dfc9-4363-b517-5f7eb89694ec None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:31:54.073856 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:31:54.077172 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b617779-a47c-47de-9dce-2af10710f88b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:31:54.078141 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b617779-a47c-47de-9dce-2af10710f88b service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:31:54.078548 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b617779-a47c-47de-9dce-2af10710f88b service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:31:54.078948 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b617779-a47c-47de-9dce-2af10710f88b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:31:54.082024 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-4b617779-a47c-47de-9dce-2af10710f88b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:31:54.201202 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b617779-a47c-47de-9dce-2af10710f88b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:31:54.202672 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b617779-a47c-47de-9dce-2af10710f88b service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:31:54.222927 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 738/1487] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:31:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:31:56.379913 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b111b9-aa53-4868-a074-10b51decb8e6 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:31:56.380525 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b111b9-aa53-4868-a074-10b51decb8e6 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:31:56.380525 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b111b9-aa53-4868-a074-10b51decb8e6 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:31:56.381842 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 750/1488] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:31:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:31:56.387325 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb6107-36df-4ba0-8a41-b5f16fa7275b None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:31:56.387774 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb6107-36df-4ba0-8a41-b5f16fa7275b None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:31:56.387867 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb6107-36df-4ba0-8a41-b5f16fa7275b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:31:56.474948 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-60eb6107-36df-4ba0-8a41-b5f16fa7275b None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:31:56.476202 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-60eb6107-36df-4ba0-8a41-b5f16fa7275b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:31:56.528980 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:31:56.576692 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 739/1489] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:31:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:31:56.621852 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b111b9-aa53-4868-a074-10b51decb8e6 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:31:56.624407 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d6b111b9-aa53-4868-a074-10b51decb8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:31:56.670813 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:31:56.746792 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b111b9-aa53-4868-a074-10b51decb8e6 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:31:56.837584 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3907c-62fa-4fca-b69d-de4f83854cb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:31:56.838178 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3907c-62fa-4fca-b69d-de4f83854cb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:31:56.838462 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3907c-62fa-4fca-b69d-de4f83854cb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:31:56.838728 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3907c-62fa-4fca-b69d-de4f83854cb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:31:56.840379 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b7c3907c-62fa-4fca-b69d-de4f83854cb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:31:56.925197 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:31:56.956231 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c3907c-62fa-4fca-b69d-de4f83854cb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:31:56.957662 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c3907c-62fa-4fca-b69d-de4f83854cb2 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:31:56.976484 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 751/1490] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:31:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:31:59.198160 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8c470-ad94-40b4-b397-0ddda317ff69 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:31:59.198731 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8c470-ad94-40b4-b397-0ddda317ff69 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:31:59.198731 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8c470-ad94-40b4-b397-0ddda317ff69 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:31:59.200483 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 740/1491] 10.222.0.27 () {54 vars in 926 bytes} [Fri Jul 15 17:31:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:31:59.208961 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f2978-24c7-4161-b863-b253ed593e3b None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:31:59.209399 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f2978-24c7-4161-b863-b253ed593e3b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:31:59.209599 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f2978-24c7-4161-b863-b253ed593e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:31:59.290011 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-7d0f2978-24c7-4161-b863-b253ed593e3b None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:31:59.291221 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7d0f2978-24c7-4161-b863-b253ed593e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:31:59.403231 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 752/1492] 10.222.0.27 () {58 vars in 1023 bytes} [Fri Jul 15 17:31:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:31:59.446587 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8c470-ad94-40b4-b397-0ddda317ff69 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:31:59.448964 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-9ff8c470-ad94-40b4-b397-0ddda317ff69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:31:59.563184 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8c470-ad94-40b4-b397-0ddda317ff69 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:31:59.648810 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58834154-f64a-495c-b355-2334b37663ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:31:59.649480 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58834154-f64a-495c-b355-2334b37663ed service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:31:59.649755 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58834154-f64a-495c-b355-2334b37663ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:31:59.650038 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58834154-f64a-495c-b355-2334b37663ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:31:59.651713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-58834154-f64a-495c-b355-2334b37663ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:31:59.661657 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:31:59.768490 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58834154-f64a-495c-b355-2334b37663ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:31:59.769882 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58834154-f64a-495c-b355-2334b37663ed service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:31:59.789233 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 741/1493] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:31:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:32:09.401316 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=82 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:32:09.786719 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=50 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:33:45.796316 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b969d85-41de-4c08-b145-c3011e5b3b85 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:33:45.797218 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b969d85-41de-4c08-b145-c3011e5b3b85 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:33:45.797218 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b969d85-41de-4c08-b145-c3011e5b3b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:33:45.880024 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-4b969d85-41de-4c08-b145-c3011e5b3b85 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:33:45.881232 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-4b969d85-41de-4c08-b145-c3011e5b3b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:33:45.986368 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 753/1494] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:33:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:33:45.995796 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f6593-6a7d-4b74-b816-93a410b83614 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:33:45.996310 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f6593-6a7d-4b74-b816-93a410b83614 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:33:45.996310 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f6593-6a7d-4b74-b816-93a410b83614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:33:46.072331 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-c79f6593-6a7d-4b74-b816-93a410b83614 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:33:46.073463 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-c79f6593-6a7d-4b74-b816-93a410b83614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:33:46.190823 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 742/1495] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:33:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:33:46.195960 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b969d85-41de-4c08-b145-c3011e5b3b85 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:33:46.197161 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-4b969d85-41de-4c08-b145-c3011e5b3b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:33:46.210731 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b969d85-41de-4c08-b145-c3011e5b3b85 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:33:46.284228 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:33:46.319866 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d415a0-9041-4d1c-8773-430e980bf3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:33:46.320535 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d415a0-9041-4d1c-8773-430e980bf3ce admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:33:46.320812 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d415a0-9041-4d1c-8773-430e980bf3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:33:46.321090 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d415a0-9041-4d1c-8773-430e980bf3ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:33:46.321812 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d415a0-9041-4d1c-8773-430e980bf3ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:33:46.322135 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d415a0-9041-4d1c-8773-430e980bf3ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:33:46.323219 dv-cinder-836973-11-smb devstack@keystone.service[80149]: WARNING py.warnings [None req-90d415a0-9041-4d1c-8773-430e980bf3ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 17:33:46.323219 dv-cinder-836973-11-smb devstack@keystone.service[80149]: warnings.warn(msg) Jul 15 17:33:46.323219 dv-cinder-836973-11-smb devstack@keystone.service[80149]: Jul 15 17:33:46.324064 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d415a0-9041-4d1c-8773-430e980bf3ce admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:33:46.336441 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 754/1496] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:33:46.345513 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f6593-6a7d-4b74-b816-93a410b83614 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:33:46.356867 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f6593-6a7d-4b74-b816-93a410b83614 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:33:46.436676 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:33:46.476765 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342800f8-a263-43e2-92d1-2bdd301bec28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:33:46.477436 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342800f8-a263-43e2-92d1-2bdd301bec28 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:33:46.477714 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342800f8-a263-43e2-92d1-2bdd301bec28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:33:46.478023 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342800f8-a263-43e2-92d1-2bdd301bec28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:33:46.478722 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342800f8-a263-43e2-92d1-2bdd301bec28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:33:46.480486 dv-cinder-836973-11-smb devstack@keystone.service[80150]: WARNING py.warnings [None req-342800f8-a263-43e2-92d1-2bdd301bec28 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 17:33:46.480486 dv-cinder-836973-11-smb devstack@keystone.service[80150]: warnings.warn(msg) Jul 15 17:33:46.480486 dv-cinder-836973-11-smb devstack@keystone.service[80150]: Jul 15 17:33:46.481696 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342800f8-a263-43e2-92d1-2bdd301bec28 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:33:46.549244 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 743/1497] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:33:46 2022] POST /identity/v3/projects => generated 379 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:33:46.554012 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d415a0-9041-4d1c-8773-430e980bf3ce admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:33:46.555545 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-90d415a0-9041-4d1c-8773-430e980bf3ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:33:46.590497 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d415a0-9041-4d1c-8773-430e980bf3ce admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:33:46.703105 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da229f-30ed-470b-8b19-c47c6e6c982d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:33:46.703993 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da229f-30ed-470b-8b19-c47c6e6c982d admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:33:46.704317 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da229f-30ed-470b-8b19-c47c6e6c982d admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:33:46.704671 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da229f-30ed-470b-8b19-c47c6e6c982d admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:33:46.705691 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da229f-30ed-470b-8b19-c47c6e6c982d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:33:46.707180 dv-cinder-836973-11-smb devstack@keystone.service[80149]: WARNING py.warnings [None req-e2da229f-30ed-470b-8b19-c47c6e6c982d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 17:33:46.707180 dv-cinder-836973-11-smb devstack@keystone.service[80149]: warnings.warn(msg) Jul 15 17:33:46.707180 dv-cinder-836973-11-smb devstack@keystone.service[80149]: Jul 15 17:33:46.708495 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da229f-30ed-470b-8b19-c47c6e6c982d admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:33:46.755712 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 755/1498] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:33:46 2022] POST /identity/v3/users => generated 290 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:33:46.760386 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342800f8-a263-43e2-92d1-2bdd301bec28 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:33:46.762010 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-342800f8-a263-43e2-92d1-2bdd301bec28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:33:46.830021 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342800f8-a263-43e2-92d1-2bdd301bec28 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:33:46.914062 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:33:46.932056 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80116947-0e90-43dc-bcb7-863e59dc60b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:33:46.933121 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80116947-0e90-43dc-bcb7-863e59dc60b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:33:46.933469 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80116947-0e90-43dc-bcb7-863e59dc60b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:33:46.933867 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80116947-0e90-43dc-bcb7-863e59dc60b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:33:46.934907 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80116947-0e90-43dc-bcb7-863e59dc60b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:33:46.936458 dv-cinder-836973-11-smb devstack@keystone.service[80150]: WARNING py.warnings [None req-80116947-0e90-43dc-bcb7-863e59dc60b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 17:33:46.936458 dv-cinder-836973-11-smb devstack@keystone.service[80150]: warnings.warn(msg) Jul 15 17:33:46.936458 dv-cinder-836973-11-smb devstack@keystone.service[80150]: Jul 15 17:33:46.937859 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80116947-0e90-43dc-bcb7-863e59dc60b5 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:33:46.952989 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 744/1499] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:33:46 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:33:46.957617 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da229f-30ed-470b-8b19-c47c6e6c982d admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:33:46.959271 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e2da229f-30ed-470b-8b19-c47c6e6c982d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:33:46.970820 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da229f-30ed-470b-8b19-c47c6e6c982d admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:33:46.999321 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:33:47.086926 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2c652-a33a-4a7c-95d8-4d076fc281d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:33:47.087606 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2c652-a33a-4a7c-95d8-4d076fc281d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:33:47.087879 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2c652-a33a-4a7c-95d8-4d076fc281d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:33:47.088145 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2c652-a33a-4a7c-95d8-4d076fc281d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:33:47.088940 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c2c652-a33a-4a7c-95d8-4d076fc281d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:33:47.089990 dv-cinder-836973-11-smb devstack@keystone.service[80149]: WARNING py.warnings [None req-05c2c652-a33a-4a7c-95d8-4d076fc281d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 17:33:47.089990 dv-cinder-836973-11-smb devstack@keystone.service[80149]: warnings.warn(msg) Jul 15 17:33:47.089990 dv-cinder-836973-11-smb devstack@keystone.service[80149]: Jul 15 17:33:47.090874 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c2c652-a33a-4a7c-95d8-4d076fc281d3 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:33:47.104248 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 756/1500] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:33:46 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:33:47.109216 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80116947-0e90-43dc-bcb7-863e59dc60b5 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:33:47.110799 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-80116947-0e90-43dc-bcb7-863e59dc60b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:33:47.145864 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80116947-0e90-43dc-bcb7-863e59dc60b5 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:33:47.247635 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b8235-c856-43e7-afdd-f7697a9984af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:33:47.248466 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b8235-c856-43e7-afdd-f7697a9984af admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:33:47.248746 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b8235-c856-43e7-afdd-f7697a9984af admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:33:47.249016 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b8235-c856-43e7-afdd-f7697a9984af admin admin] PATH_INFO: `/v3/projects/2c2deba529d1453393321c625c62e41c/users/031c7ecc8f4447f48a4768e80e13ae4a/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:33:47.271631 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b8235-c856-43e7-afdd-f7697a9984af admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c2deba529d1453393321c625c62e41c, user_id=031c7ecc8f4447f48a4768e80e13ae4a, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:33:47.272660 dv-cinder-836973-11-smb devstack@keystone.service[80150]: WARNING py.warnings [None req-9f6b8235-c856-43e7-afdd-f7697a9984af admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 17:33:47.272660 dv-cinder-836973-11-smb devstack@keystone.service[80150]: warnings.warn(msg) Jul 15 17:33:47.272660 dv-cinder-836973-11-smb devstack@keystone.service[80150]: Jul 15 17:33:47.274631 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b8235-c856-43e7-afdd-f7697a9984af admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:33:47.303023 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 745/1501] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:33:47 2022] PUT /identity/v3/projects/2c2deba529d1453393321c625c62e41c/users/031c7ecc8f4447f48a4768e80e13ae4a/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:33:47.315759 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0dee5-975e-41f1-a0ea-3455522b733d None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:33:47.316081 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0dee5-975e-41f1-a0ea-3455522b733d None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:33:47.316356 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0dee5-975e-41f1-a0ea-3455522b733d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:33:47.375967 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-09f0dee5-975e-41f1-a0ea-3455522b733d None None] MFA Rules not processed for user `031c7ecc8f4447f48a4768e80e13ae4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:33:47.377181 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-09f0dee5-975e-41f1-a0ea-3455522b733d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:33:47.470397 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 757/1502] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:33:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:33:47.485030 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31bd50-ad0a-4dd3-9290-d5451414ead2 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:33:47.485315 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31bd50-ad0a-4dd3-9290-d5451414ead2 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:33:47.485588 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31bd50-ad0a-4dd3-9290-d5451414ead2 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:33:47.486989 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 746/1503] 10.222.0.27 () {54 vars in 963 bytes} [Fri Jul 15 17:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:33:47.491921 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b90811-7253-4f3b-a40a-520d6fd745d1 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:33:47.492213 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b90811-7253-4f3b-a40a-520d6fd745d1 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:33:47.492482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b90811-7253-4f3b-a40a-520d6fd745d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:33:47.524474 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:33:47.572451 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-b3b90811-7253-4f3b-a40a-520d6fd745d1 None None] MFA Rules not processed for user `94b8121d0b0d4eef818b2a8b3508df18`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:33:47.573662 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b3b90811-7253-4f3b-a40a-520d6fd745d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:33:47.658516 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 758/1504] 10.222.0.27 () {58 vars in 1060 bytes} [Fri Jul 15 17:33:47 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:33:47.667670 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f31bd50-ad0a-4dd3-9290-d5451414ead2 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:33:47.669959 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-1f31bd50-ad0a-4dd3-9290-d5451414ead2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:33:47.737745 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:33:47.794917 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f31bd50-ad0a-4dd3-9290-d5451414ead2 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:33:47.870203 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471128a-6f95-4ef4-8862-231eca2d1343 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:33:47.870863 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471128a-6f95-4ef4-8862-231eca2d1343 service cinder] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:33:47.871154 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471128a-6f95-4ef4-8862-231eca2d1343 service cinder] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:33:47.871413 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471128a-6f95-4ef4-8862-231eca2d1343 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:33:47.873234 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-8471128a-6f95-4ef4-8862-231eca2d1343 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:33:47.975783 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471128a-6f95-4ef4-8862-231eca2d1343 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:33:47.977206 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471128a-6f95-4ef4-8862-231eca2d1343 service cinder] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:33:47.980769 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:33:47.996260 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 747/1505] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:33:47 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:33:48.045500 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311cba3-bc54-4eb8-bc50-a868a9e03787 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:33:48.045950 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311cba3-bc54-4eb8-bc50-a868a9e03787 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:33:48.046053 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311cba3-bc54-4eb8-bc50-a868a9e03787 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:33:48.047857 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 759/1506] 10.222.0.27 () {52 vars in 829 bytes} [Fri Jul 15 17:33:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:33:48.052812 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471128a-6f95-4ef4-8862-231eca2d1343 service cinder] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:33:48.054140 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-8471128a-6f95-4ef4-8862-231eca2d1343 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:33:48.171256 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471128a-6f95-4ef4-8862-231eca2d1343 service cinder] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:33:48.276739 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f89808-f09a-4ff1-9fbf-02be4d33bd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:33:48.277638 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f89808-f09a-4ff1-9fbf-02be4d33bd2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:33:48.277952 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f89808-f09a-4ff1-9fbf-02be4d33bd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:33:48.278227 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f89808-f09a-4ff1-9fbf-02be4d33bd2b admin admin] PATH_INFO: `/v3/users/031c7ecc8f4447f48a4768e80e13ae4a` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:33:48.294543 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f89808-f09a-4ff1-9fbf-02be4d33bd2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=031c7ecc8f4447f48a4768e80e13ae4a)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:33:48.296108 dv-cinder-836973-11-smb devstack@keystone.service[80150]: WARNING py.warnings [None req-a5f89808-f09a-4ff1-9fbf-02be4d33bd2b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 17:33:48.296108 dv-cinder-836973-11-smb devstack@keystone.service[80150]: warnings.warn(msg) Jul 15 17:33:48.296108 dv-cinder-836973-11-smb devstack@keystone.service[80150]: Jul 15 17:33:48.297748 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f89808-f09a-4ff1-9fbf-02be4d33bd2b admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:33:48.310018 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:33:48.370239 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-a5f89808-f09a-4ff1-9fbf-02be4d33bd2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '031c7ecc8f4447f48a4768e80e13ae4a'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:33:48.370683 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-a5f89808-f09a-4ff1-9fbf-02be4d33bd2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '031c7ecc8f4447f48a4768e80e13ae4a'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:33:48.384145 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-a5f89808-f09a-4ff1-9fbf-02be4d33bd2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '031c7ecc8f4447f48a4768e80e13ae4a'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:33:48.384904 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-a5f89808-f09a-4ff1-9fbf-02be4d33bd2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '031c7ecc8f4447f48a4768e80e13ae4a'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:33:48.413971 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-a5f89808-f09a-4ff1-9fbf-02be4d33bd2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '031c7ecc8f4447f48a4768e80e13ae4a'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:33:48.430841 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 748/1507] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:33:48 2022] DELETE /identity/v3/users/031c7ecc8f4447f48a4768e80e13ae4a => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:33:48.435456 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05844951-9980-4a96-991d-307e6e4e729b None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:33:48.435745 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05844951-9980-4a96-991d-307e6e4e729b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:33:48.436025 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05844951-9980-4a96-991d-307e6e4e729b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:33:48.491811 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-05844951-9980-4a96-991d-307e6e4e729b None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:33:48.493023 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-05844951-9980-4a96-991d-307e6e4e729b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:33:48.580378 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:33:48.593500 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 760/1508] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:33:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:33:48.603968 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f89808-f09a-4ff1-9fbf-02be4d33bd2b admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:33:48.605214 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-a5f89808-f09a-4ff1-9fbf-02be4d33bd2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:33:48.731257 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f89808-f09a-4ff1-9fbf-02be4d33bd2b admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:33:48.800108 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:33:48.824026 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6485b8-53a1-4168-8d79-5dbe10e8187d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:33:48.824718 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6485b8-53a1-4168-8d79-5dbe10e8187d service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:33:48.824995 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6485b8-53a1-4168-8d79-5dbe10e8187d service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:33:48.825268 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6485b8-53a1-4168-8d79-5dbe10e8187d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:33:48.827297 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-9f6485b8-53a1-4168-8d79-5dbe10e8187d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:33:48.954632 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6485b8-53a1-4168-8d79-5dbe10e8187d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:33:48.956529 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6485b8-53a1-4168-8d79-5dbe10e8187d service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:33:48.976971 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 749/1509] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:33:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:33:49.320319 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05844951-9980-4a96-991d-307e6e4e729b None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:33:49.321762 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-05844951-9980-4a96-991d-307e6e4e729b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:33:49.334676 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05844951-9980-4a96-991d-307e6e4e729b None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:33:49.436427 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7ba34-a1ea-47bd-822c-f86c103cab93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:33:49.437535 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7ba34-a1ea-47bd-822c-f86c103cab93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:33:49.437825 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7ba34-a1ea-47bd-822c-f86c103cab93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:33:49.438106 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7ba34-a1ea-47bd-822c-f86c103cab93 admin admin] PATH_INFO: `/v3/projects/2c2deba529d1453393321c625c62e41c` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:33:49.448786 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d7ba34-a1ea-47bd-822c-f86c103cab93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c2deba529d1453393321c625c62e41c)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:33:49.449811 dv-cinder-836973-11-smb devstack@keystone.service[80149]: WARNING py.warnings [None req-c4d7ba34-a1ea-47bd-822c-f86c103cab93 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 17:33:49.449811 dv-cinder-836973-11-smb devstack@keystone.service[80149]: warnings.warn(msg) Jul 15 17:33:49.449811 dv-cinder-836973-11-smb devstack@keystone.service[80149]: Jul 15 17:33:49.451023 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d7ba34-a1ea-47bd-822c-f86c103cab93 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:33:49.511649 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c4d7ba34-a1ea-47bd-822c-f86c103cab93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c2deba529d1453393321c625c62e41c', 'request_id': 'req-c4d7ba34-a1ea-47bd-822c-f86c103cab93'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:33:49.521213 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c4d7ba34-a1ea-47bd-822c-f86c103cab93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c2deba529d1453393321c625c62e41c', 'request_id': 'req-c4d7ba34-a1ea-47bd-822c-f86c103cab93'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:33:49.527369 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c4d7ba34-a1ea-47bd-822c-f86c103cab93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c2deba529d1453393321c625c62e41c', 'request_id': 'req-c4d7ba34-a1ea-47bd-822c-f86c103cab93'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:33:49.560347 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c4d7ba34-a1ea-47bd-822c-f86c103cab93 admin admin] The token cache is being invalidate because project 2c2deba529d1453393321c625c62e41c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:33:49.560597 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c4d7ba34-a1ea-47bd-822c-f86c103cab93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:33:49.561046 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c4d7ba34-a1ea-47bd-822c-f86c103cab93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:33:49.562551 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 761/1510] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:33:49 2022] DELETE /identity/v3/projects/2c2deba529d1453393321c625c62e41c => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:33:58.974141 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=62 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:33:59.557688 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:35:34.357103 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1734e13-b5fc-4daa-a624-10567ac79562 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:35:34.358076 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1734e13-b5fc-4daa-a624-10567ac79562 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:35:34.358076 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1734e13-b5fc-4daa-a624-10567ac79562 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:35:34.360223 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 750/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 17:35:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:35:34.368216 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b44f7c-78f5-427a-86cc-8aee97d775eb None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:35:34.368691 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b44f7c-78f5-427a-86cc-8aee97d775eb None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:35:34.368801 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b44f7c-78f5-427a-86cc-8aee97d775eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:35:34.452863 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-e8b44f7c-78f5-427a-86cc-8aee97d775eb None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:35:34.454215 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e8b44f7c-78f5-427a-86cc-8aee97d775eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:35:34.578342 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 762/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 17:35:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:35:34.743349 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1734e13-b5fc-4daa-a624-10567ac79562 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:35:34.745938 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-f1734e13-b5fc-4daa-a624-10567ac79562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:35:34.879815 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1734e13-b5fc-4daa-a624-10567ac79562 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:35:34.889154 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f37429-999d-4638-a2f1-3d0f806fa910 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:35:34.889154 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f37429-999d-4638-a2f1-3d0f806fa910 service nova] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:35:34.889154 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f37429-999d-4638-a2f1-3d0f806fa910 service nova] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:35:34.889154 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f37429-999d-4638-a2f1-3d0f806fa910 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:35:34.904322 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f37429-999d-4638-a2f1-3d0f806fa910 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:35:34.906940 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f37429-999d-4638-a2f1-3d0f806fa910 service nova] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:35:34.918505 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 751/1513] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:35:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:35:35.768076 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12443262-bfda-44ab-a068-374a30f46b99 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:35:35.768927 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12443262-bfda-44ab-a068-374a30f46b99 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:35:35.768927 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12443262-bfda-44ab-a068-374a30f46b99 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:35:35.770812 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 763/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 17:35:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:35:35.775901 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564948a-9a9b-4bc0-9e48-ce9591fabe12 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:35:35.776352 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564948a-9a9b-4bc0-9e48-ce9591fabe12 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:35:35.776471 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564948a-9a9b-4bc0-9e48-ce9591fabe12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:35:35.796263 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-2564948a-9a9b-4bc0-9e48-ce9591fabe12 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:35:35.797463 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-2564948a-9a9b-4bc0-9e48-ce9591fabe12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:35:35.806734 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 752/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 17:35:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:35:35.962118 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12443262-bfda-44ab-a068-374a30f46b99 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:35:35.987937 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12443262-bfda-44ab-a068-374a30f46b99 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:35:35.995570 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213f313-2e6a-48f3-b0b2-4eb2ae377c2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:35:35.996218 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213f313-2e6a-48f3-b0b2-4eb2ae377c2e service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:35:35.996505 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213f313-2e6a-48f3-b0b2-4eb2ae377c2e service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:35:35.996780 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213f313-2e6a-48f3-b0b2-4eb2ae377c2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:35:36.005577 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6213f313-2e6a-48f3-b0b2-4eb2ae377c2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:35:36.007222 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6213f313-2e6a-48f3-b0b2-4eb2ae377c2e service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:35:36.016943 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 764/1516] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:35:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:35:37.041175 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8516ca7-e2a4-4c70-b247-3555a1fa43d4 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:35:37.041762 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8516ca7-e2a4-4c70-b247-3555a1fa43d4 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:35:37.041762 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8516ca7-e2a4-4c70-b247-3555a1fa43d4 None None] PATH_INFO: `/v3` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:35:37.043129 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 753/1517] 10.222.0.69 () {54 vars in 925 bytes} [Fri Jul 15 17:35:37 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:35:37.050326 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb7eb2-87b9-431e-a3a1-4ed767784c02 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:35:37.050773 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb7eb2-87b9-431e-a3a1-4ed767784c02 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:35:37.050870 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb7eb2-87b9-431e-a3a1-4ed767784c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:35:37.115058 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-43fb7eb2-87b9-431e-a3a1-4ed767784c02 None None] MFA Rules not processed for user `96b2105f8d29443383ed51a8fd5cec6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:35:37.116280 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-43fb7eb2-87b9-431e-a3a1-4ed767784c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:35:37.134705 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:35:37.198956 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 765/1518] 10.222.0.69 () {58 vars in 1015 bytes} [Fri Jul 15 17:35:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:35:41.201340 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759260d-420a-42d8-95fd-fb8f5ac252f8 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:35:41.201967 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759260d-420a-42d8-95fd-fb8f5ac252f8 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:35:41.201967 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759260d-420a-42d8-95fd-fb8f5ac252f8 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:35:41.204005 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 754/1519] 10.222.0.27 () {54 vars in 960 bytes} [Fri Jul 15 17:35:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:35:41.211560 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90635e-a98d-4ea0-b77e-f997b3ee34d7 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:35:41.212009 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90635e-a98d-4ea0-b77e-f997b3ee34d7 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:35:41.212163 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90635e-a98d-4ea0-b77e-f997b3ee34d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:35:41.238492 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-5d90635e-a98d-4ea0-b77e-f997b3ee34d7 None None] MFA Rules not processed for user `96b2105f8d29443383ed51a8fd5cec6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:35:41.240051 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5d90635e-a98d-4ea0-b77e-f997b3ee34d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:35:41.255747 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 766/1520] 10.222.0.27 () {58 vars in 1057 bytes} [Fri Jul 15 17:35:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:35:41.263451 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759260d-420a-42d8-95fd-fb8f5ac252f8 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:35:41.278690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759260d-420a-42d8-95fd-fb8f5ac252f8 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:35:41.284059 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b9e1b-92ba-4b71-958f-9eff2079425b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96b2105f8d29443383ed51a8fd5cec6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:35:41.284694 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b9e1b-92ba-4b71-958f-9eff2079425b service placement] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:35:41.284976 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b9e1b-92ba-4b71-958f-9eff2079425b service placement] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:35:41.285251 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b9e1b-92ba-4b71-958f-9eff2079425b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:35:41.294284 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b9e1b-92ba-4b71-958f-9eff2079425b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:35:41.295853 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b9e1b-92ba-4b71-958f-9eff2079425b service placement] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:35:41.306177 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 755/1521] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:35:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:35:47.297439 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4554f5-cbe5-48cc-a0e6-61df10cc4c34 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:35:47.298061 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4554f5-cbe5-48cc-a0e6-61df10cc4c34 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:35:47.298061 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4554f5-cbe5-48cc-a0e6-61df10cc4c34 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:35:47.299409 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 767/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 17:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:35:47.307746 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd68a7-f74f-43d5-aa0d-e78e2aa2bfb5 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:35:47.308339 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd68a7-f74f-43d5-aa0d-e78e2aa2bfb5 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:35:47.308519 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd68a7-f74f-43d5-aa0d-e78e2aa2bfb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:35:47.331817 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-90cd68a7-f74f-43d5-aa0d-e78e2aa2bfb5 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:35:47.333011 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-90cd68a7-f74f-43d5-aa0d-e78e2aa2bfb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:35:47.342314 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 756/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 17:35:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:35:47.505563 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4554f5-cbe5-48cc-a0e6-61df10cc4c34 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:35:47.523264 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4554f5-cbe5-48cc-a0e6-61df10cc4c34 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:35:47.530251 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1ee21-f86c-4be3-8580-5aba5981f6f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:35:47.530904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1ee21-f86c-4be3-8580-5aba5981f6f2 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:35:47.531187 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1ee21-f86c-4be3-8580-5aba5981f6f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:35:47.531455 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1ee21-f86c-4be3-8580-5aba5981f6f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:35:47.540400 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a1ee21-f86c-4be3-8580-5aba5981f6f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:35:47.541978 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a1ee21-f86c-4be3-8580-5aba5981f6f2 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:35:47.551529 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 768/1524] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:35:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:35:48.384121 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024f268-c71c-4d2f-87ab-d156b53c41ea None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:35:48.384684 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024f268-c71c-4d2f-87ab-d156b53c41ea None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:35:48.384684 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024f268-c71c-4d2f-87ab-d156b53c41ea None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:35:48.386693 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 757/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 17:35:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:35:48.394106 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ad2b5-b8dd-4ee3-a4bd-59b5f4d78432 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:35:48.394549 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ad2b5-b8dd-4ee3-a4bd-59b5f4d78432 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:35:48.394934 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ad2b5-b8dd-4ee3-a4bd-59b5f4d78432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:35:48.414440 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-ad7ad2b5-b8dd-4ee3-a4bd-59b5f4d78432 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:35:48.415632 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ad7ad2b5-b8dd-4ee3-a4bd-59b5f4d78432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:35:48.424036 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 769/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 17:35:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:35:48.596076 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5024f268-c71c-4d2f-87ab-d156b53c41ea None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:35:48.620102 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5024f268-c71c-4d2f-87ab-d156b53c41ea None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:35:48.626940 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c93db-8389-4067-a42c-f22ade91feee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:35:48.627603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c93db-8389-4067-a42c-f22ade91feee service nova] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:35:48.627882 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c93db-8389-4067-a42c-f22ade91feee service nova] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:35:48.628151 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c93db-8389-4067-a42c-f22ade91feee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:35:48.637681 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c93db-8389-4067-a42c-f22ade91feee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:35:48.639266 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c93db-8389-4067-a42c-f22ade91feee service nova] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:35:48.650060 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 758/1527] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:35:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:35:52.545056 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20752fda-9a82-41cb-9708-d32e2497ad3a None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:35:52.546021 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20752fda-9a82-41cb-9708-d32e2497ad3a None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:35:52.546021 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20752fda-9a82-41cb-9708-d32e2497ad3a None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:35:52.548295 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 770/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 17:35:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:35:52.554928 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d37b0d-0e2b-4cd1-b7ee-186cf91a0549 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:35:52.555405 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d37b0d-0e2b-4cd1-b7ee-186cf91a0549 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:35:52.555508 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d37b0d-0e2b-4cd1-b7ee-186cf91a0549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:35:52.580631 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-94d37b0d-0e2b-4cd1-b7ee-186cf91a0549 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:35:52.581798 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-94d37b0d-0e2b-4cd1-b7ee-186cf91a0549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:35:52.591000 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 759/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 17:35:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:35:52.632825 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20752fda-9a82-41cb-9708-d32e2497ad3a None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:35:52.635108 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-20752fda-9a82-41cb-9708-d32e2497ad3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:35:52.725812 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20752fda-9a82-41cb-9708-d32e2497ad3a None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:35:52.729540 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635071ca-f218-4a09-a352-4c89e0e0f66c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:35:52.730220 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635071ca-f218-4a09-a352-4c89e0e0f66c service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:35:52.730495 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635071ca-f218-4a09-a352-4c89e0e0f66c service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:35:52.730770 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635071ca-f218-4a09-a352-4c89e0e0f66c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:35:52.739967 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635071ca-f218-4a09-a352-4c89e0e0f66c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:35:52.741645 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635071ca-f218-4a09-a352-4c89e0e0f66c service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:35:52.751094 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 771/1530] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:35:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:35:54.774451 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7e8ad-57fe-4fa6-99e2-59a6fd7d1bca None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:35:54.775447 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7e8ad-57fe-4fa6-99e2-59a6fd7d1bca None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:35:54.775447 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7e8ad-57fe-4fa6-99e2-59a6fd7d1bca None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:35:54.777490 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 760/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 17:35:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:35:54.785435 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e2eee-6d68-435b-ad46-36dd0c7a3369 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:35:54.785911 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e2eee-6d68-435b-ad46-36dd0c7a3369 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:35:54.786014 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e2eee-6d68-435b-ad46-36dd0c7a3369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:35:54.805113 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-589e2eee-6d68-435b-ad46-36dd0c7a3369 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:35:54.806326 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-589e2eee-6d68-435b-ad46-36dd0c7a3369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:35:54.814753 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 772/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 17:35:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:35:54.851687 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7e8ad-57fe-4fa6-99e2-59a6fd7d1bca None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:35:54.864193 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7e8ad-57fe-4fa6-99e2-59a6fd7d1bca None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:35:54.868158 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad543f-b2c3-4182-8c8f-dce9a26f6e6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:35:54.868803 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad543f-b2c3-4182-8c8f-dce9a26f6e6b service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:35:54.869086 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad543f-b2c3-4182-8c8f-dce9a26f6e6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:35:54.869343 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad543f-b2c3-4182-8c8f-dce9a26f6e6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:35:54.879163 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad543f-b2c3-4182-8c8f-dce9a26f6e6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:35:54.880615 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad543f-b2c3-4182-8c8f-dce9a26f6e6b service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:35:54.890523 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 761/1533] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:35:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 17:35:58.371602 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1544307-d89f-4a68-8b43-13226769af4a None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:35:58.372171 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1544307-d89f-4a68-8b43-13226769af4a None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:35:58.372171 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1544307-d89f-4a68-8b43-13226769af4a None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:35:58.373445 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 773/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 17:35:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:35:58.378732 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c378fd5-44d6-4fc9-aa1b-621c76a59a7c None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:35:58.379188 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c378fd5-44d6-4fc9-aa1b-621c76a59a7c None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:35:58.379284 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c378fd5-44d6-4fc9-aa1b-621c76a59a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:35:58.398969 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-6c378fd5-44d6-4fc9-aa1b-621c76a59a7c None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:35:58.400150 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-6c378fd5-44d6-4fc9-aa1b-621c76a59a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:35:58.410921 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 762/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 17:35:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:35:58.713153 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1544307-d89f-4a68-8b43-13226769af4a None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:35:58.715302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a1544307-d89f-4a68-8b43-13226769af4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:35:58.784353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:35:58.798282 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1544307-d89f-4a68-8b43-13226769af4a None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:35:58.802183 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19dc633-cac6-4462-8686-19a87bd42337 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:35:58.802828 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19dc633-cac6-4462-8686-19a87bd42337 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:35:58.803111 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19dc633-cac6-4462-8686-19a87bd42337 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:35:58.803445 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19dc633-cac6-4462-8686-19a87bd42337 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:35:58.812709 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19dc633-cac6-4462-8686-19a87bd42337 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:35:58.814195 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19dc633-cac6-4462-8686-19a87bd42337 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:35:58.824107 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 774/1536] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:35:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:36:00.845169 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92514b4-94f1-480a-a82a-6c3fd7b61487 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:36:00.845769 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92514b4-94f1-480a-a82a-6c3fd7b61487 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:36:00.845769 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92514b4-94f1-480a-a82a-6c3fd7b61487 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:36:00.847151 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 763/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 17:36:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:36:00.852797 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f817c-198c-4733-ad87-b91980b40ebe None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:36:00.853245 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f817c-198c-4733-ad87-b91980b40ebe None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:36:00.853350 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f817c-198c-4733-ad87-b91980b40ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:36:00.879113 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-5e4f817c-198c-4733-ad87-b91980b40ebe None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:36:00.881105 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5e4f817c-198c-4733-ad87-b91980b40ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:36:00.891101 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 775/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 17:36:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:36:01.202377 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92514b4-94f1-480a-a82a-6c3fd7b61487 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:36:01.204212 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-f92514b4-94f1-480a-a82a-6c3fd7b61487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:36:01.213055 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=84 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:36:01.220022 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92514b4-94f1-480a-a82a-6c3fd7b61487 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:36:01.223689 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25739b0f-dbe4-49af-80ca-9bbbb4424e22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:36:01.224326 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25739b0f-dbe4-49af-80ca-9bbbb4424e22 service cinder] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:36:01.224602 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25739b0f-dbe4-49af-80ca-9bbbb4424e22 service cinder] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:36:01.224870 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25739b0f-dbe4-49af-80ca-9bbbb4424e22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:36:01.234285 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25739b0f-dbe4-49af-80ca-9bbbb4424e22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:36:01.235698 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25739b0f-dbe4-49af-80ca-9bbbb4424e22 service cinder] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:36:01.245177 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 764/1539] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:36:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:36:10.871160 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=11 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:36:11.241302 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=5 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:37:40.781950 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c590f9-be58-43b3-961e-0ff0927da9fe None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:40.783230 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c590f9-be58-43b3-961e-0ff0927da9fe None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:40.783740 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c590f9-be58-43b3-961e-0ff0927da9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:40.810792 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-06c590f9-be58-43b3-961e-0ff0927da9fe None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:37:40.812424 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-06c590f9-be58-43b3-961e-0ff0927da9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:40.827835 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 776/1540] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:37:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:37:40.838586 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc616ee-f12d-4952-bbcb-5fe0eef45844 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:40.839157 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc616ee-f12d-4952-bbcb-5fe0eef45844 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:40.839157 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc616ee-f12d-4952-bbcb-5fe0eef45844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:40.870882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18104e59-9a29-40bd-93ef-d7fc04a446ec None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:40.871617 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18104e59-9a29-40bd-93ef-d7fc04a446ec None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:40.872124 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18104e59-9a29-40bd-93ef-d7fc04a446ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:40.872367 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-0fc616ee-f12d-4952-bbcb-5fe0eef45844 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:37:40.873612 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-0fc616ee-f12d-4952-bbcb-5fe0eef45844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:40.895644 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 765/1541] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:37:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:37:40.909807 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc616ee-f12d-4952-bbcb-5fe0eef45844 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:40.922727 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc616ee-f12d-4952-bbcb-5fe0eef45844 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:40.923251 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-18104e59-9a29-40bd-93ef-d7fc04a446ec None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:37:40.924723 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-18104e59-9a29-40bd-93ef-d7fc04a446ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:40.933469 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e0080-2444-4446-a8c7-81b7ca055570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:40.935310 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e0080-2444-4446-a8c7-81b7ca055570 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:40.935861 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e0080-2444-4446-a8c7-81b7ca055570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:40.936302 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e0080-2444-4446-a8c7-81b7ca055570 admin admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:40.937301 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0e0080-2444-4446-a8c7-81b7ca055570 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:37:40.937757 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0e0080-2444-4446-a8c7-81b7ca055570 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:40.939054 dv-cinder-836973-11-smb devstack@keystone.service[80150]: WARNING py.warnings [None req-1a0e0080-2444-4446-a8c7-81b7ca055570 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 17:37:40.939054 dv-cinder-836973-11-smb devstack@keystone.service[80150]: warnings.warn(msg) Jul 15 17:37:40.939054 dv-cinder-836973-11-smb devstack@keystone.service[80150]: Jul 15 17:37:40.940384 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0e0080-2444-4446-a8c7-81b7ca055570 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:40.951751 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 777/1542] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:37:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:37:40.959227 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 766/1543] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:37:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:37:40.970929 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e0080-2444-4446-a8c7-81b7ca055570 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:40.971590 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97fc1a-8daa-4f93-92f5-f7a14b037017 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:40.972216 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97fc1a-8daa-4f93-92f5-f7a14b037017 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:40.972712 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97fc1a-8daa-4f93-92f5-f7a14b037017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:40.985209 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e0080-2444-4446-a8c7-81b7ca055570 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:40.994685 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a0af0-0efa-440a-936e-18d450ef0401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:40.995393 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a0af0-0efa-440a-936e-18d450ef0401 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:40.995675 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a0af0-0efa-440a-936e-18d450ef0401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:40.995947 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a0af0-0efa-440a-936e-18d450ef0401 admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:40.997367 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a0af0-0efa-440a-936e-18d450ef0401 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:40.999353 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a0af0-0efa-440a-936e-18d450ef0401 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:41.028597 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-ab97fc1a-8daa-4f93-92f5-f7a14b037017 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:37:41.030300 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ab97fc1a-8daa-4f93-92f5-f7a14b037017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:41.058537 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 778/1544] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:37:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:37:41.060382 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25531848-d835-4b07-8e32-d33b2902b153 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:41.061028 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25531848-d835-4b07-8e32-d33b2902b153 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:41.061569 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25531848-d835-4b07-8e32-d33b2902b153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:41.083301 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 767/1545] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:37:40 2022] POST /identity/v3/projects => generated 389 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:37:41.084595 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a0af0-0efa-440a-936e-18d450ef0401 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:41.118915 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-25531848-d835-4b07-8e32-d33b2902b153 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:37:41.120572 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-25531848-d835-4b07-8e32-d33b2902b153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:41.202050 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a0af0-0efa-440a-936e-18d450ef0401 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:41.207321 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88c582-db75-4bb6-85cb-b5478b587555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:41.208274 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88c582-db75-4bb6-85cb-b5478b587555 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:41.208756 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88c582-db75-4bb6-85cb-b5478b587555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:41.209228 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88c582-db75-4bb6-85cb-b5478b587555 admin admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:41.210172 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88c582-db75-4bb6-85cb-b5478b587555 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:37:41.214156 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88c582-db75-4bb6-85cb-b5478b587555 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:41.214156 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88c582-db75-4bb6-85cb-b5478b587555 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:41.226383 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 768/1546] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:37:41.227304 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88c582-db75-4bb6-85cb-b5478b587555 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:41.241427 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88c582-db75-4bb6-85cb-b5478b587555 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:41.248136 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c441f-091b-474e-ab8c-976a5645dc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:41.248866 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c441f-091b-474e-ab8c-976a5645dc99 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:41.249266 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c441f-091b-474e-ab8c-976a5645dc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:41.249487 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c441f-091b-474e-ab8c-976a5645dc99 admin admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:41.250318 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002c441f-091b-474e-ab8c-976a5645dc99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:41.251347 dv-cinder-836973-11-smb devstack@keystone.service[80150]: WARNING py.warnings [None req-002c441f-091b-474e-ab8c-976a5645dc99 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 17:37:41.251347 dv-cinder-836973-11-smb devstack@keystone.service[80150]: warnings.warn(msg) Jul 15 17:37:41.251347 dv-cinder-836973-11-smb devstack@keystone.service[80150]: Jul 15 17:37:41.252577 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002c441f-091b-474e-ab8c-976a5645dc99 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:41.257313 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 779/1547] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:37:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:37:41.263181 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a3765-3896-4752-b850-5cfc8c29461b None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:41.263475 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a3765-3896-4752-b850-5cfc8c29461b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:41.263807 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a3765-3896-4752-b850-5cfc8c29461b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:41.280841 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 769/1548] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:37:41 2022] POST /identity/v3/users => generated 295 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:37:41.283713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b73bf1-94dc-4d31-bd0e-ae88c1be1be3 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:41.284403 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b73bf1-94dc-4d31-bd0e-ae88c1be1be3 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:41.284761 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b73bf1-94dc-4d31-bd0e-ae88c1be1be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:41.285052 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-939a3765-3896-4752-b850-5cfc8c29461b None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:37:41.286314 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-939a3765-3896-4752-b850-5cfc8c29461b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:41.304463 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 780/1549] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:37:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:37:41.304676 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-c8b73bf1-94dc-4d31-bd0e-ae88c1be1be3 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:37:41.305582 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27a84e-76fe-454f-b8b6-10c4300a199a None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:41.305696 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-c8b73bf1-94dc-4d31-bd0e-ae88c1be1be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:41.305911 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27a84e-76fe-454f-b8b6-10c4300a199a None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:41.306163 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27a84e-76fe-454f-b8b6-10c4300a199a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:41.318042 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 770/1550] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:37:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:37:41.319406 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc826efc-99b5-4e5d-abd0-bc5a6032758a None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:41.319778 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc826efc-99b5-4e5d-abd0-bc5a6032758a None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:41.320125 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc826efc-99b5-4e5d-abd0-bc5a6032758a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:41.328980 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-8d27a84e-76fe-454f-b8b6-10c4300a199a None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:37:41.330229 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8d27a84e-76fe-454f-b8b6-10c4300a199a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:41.338195 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 781/1551] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:37:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:37:41.338932 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d27a84e-76fe-454f-b8b6-10c4300a199a None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:41.339247 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-cc826efc-99b5-4e5d-abd0-bc5a6032758a None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:37:41.340595 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-cc826efc-99b5-4e5d-abd0-bc5a6032758a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:41.350417 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 771/1552] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:37:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:37:41.352482 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010663e9-0cc1-4c03-a20b-af36ef778241 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:41.353273 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010663e9-0cc1-4c03-a20b-af36ef778241 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:41.353682 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010663e9-0cc1-4c03-a20b-af36ef778241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:41.355233 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d27a84e-76fe-454f-b8b6-10c4300a199a None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:41.360426 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11734ee-c7f6-495f-9e65-689cb1161af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:41.361100 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11734ee-c7f6-495f-9e65-689cb1161af5 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:41.361382 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11734ee-c7f6-495f-9e65-689cb1161af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:41.361657 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11734ee-c7f6-495f-9e65-689cb1161af5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:41.362504 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11734ee-c7f6-495f-9e65-689cb1161af5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:41.363509 dv-cinder-836973-11-smb devstack@keystone.service[80149]: WARNING py.warnings [None req-f11734ee-c7f6-495f-9e65-689cb1161af5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 17:37:41.363509 dv-cinder-836973-11-smb devstack@keystone.service[80149]: warnings.warn(msg) Jul 15 17:37:41.363509 dv-cinder-836973-11-smb devstack@keystone.service[80149]: Jul 15 17:37:41.364698 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11734ee-c7f6-495f-9e65-689cb1161af5 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:41.373925 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-010663e9-0cc1-4c03-a20b-af36ef778241 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:37:41.375129 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-010663e9-0cc1-4c03-a20b-af36ef778241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:41.384392 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 772/1553] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:37:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:37:41.388998 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010663e9-0cc1-4c03-a20b-af36ef778241 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:41.393752 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 782/1554] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:37:41 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:37:41.395144 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa97609-ad46-4f7a-9560-d580838b49d5 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:41.395500 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa97609-ad46-4f7a-9560-d580838b49d5 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:41.395979 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa97609-ad46-4f7a-9560-d580838b49d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:41.399247 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010663e9-0cc1-4c03-a20b-af36ef778241 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:41.415164 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-faa97609-ad46-4f7a-9560-d580838b49d5 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:37:41.416393 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-faa97609-ad46-4f7a-9560-d580838b49d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:41.460758 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79bdb9-951f-423f-9a7e-f268a4b1e9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:41.461444 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79bdb9-951f-423f-9a7e-f268a4b1e9f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:41.461719 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79bdb9-951f-423f-9a7e-f268a4b1e9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:41.462032 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79bdb9-951f-423f-9a7e-f268a4b1e9f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:41.462762 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f79bdb9-951f-423f-9a7e-f268a4b1e9f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:41.464360 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f79bdb9-951f-423f-9a7e-f268a4b1e9f3 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:41.474483 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 773/1555] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:37:41.477921 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a349c-4ea6-4303-90e8-d598e07fd32e None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:41.477921 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a349c-4ea6-4303-90e8-d598e07fd32e None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:41.477921 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a349c-4ea6-4303-90e8-d598e07fd32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:41.480414 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 783/1556] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:37:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:37:41.481753 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c67a7-73e7-44cd-b8ce-325d26d828e3 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:41.482092 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c67a7-73e7-44cd-b8ce-325d26d828e3 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:41.482727 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:37:41.483631 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c67a7-73e7-44cd-b8ce-325d26d828e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:41.496956 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-a20a349c-4ea6-4303-90e8-d598e07fd32e None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:37:41.498192 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-a20a349c-4ea6-4303-90e8-d598e07fd32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:41.504808 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-8e3c67a7-73e7-44cd-b8ce-325d26d828e3 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:37:41.506005 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8e3c67a7-73e7-44cd-b8ce-325d26d828e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:41.506599 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 774/1557] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:37:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:37:41.507962 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb175f-1988-4b3c-83cf-0e46af92bcae None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:41.508278 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb175f-1988-4b3c-83cf-0e46af92bcae None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:41.508629 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb175f-1988-4b3c-83cf-0e46af92bcae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:41.518160 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 784/1558] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:37:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:37:41.519448 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdf242-ae29-493e-aae8-719b118c5009 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:41.519731 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdf242-ae29-493e-aae8-719b118c5009 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:41.520000 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdf242-ae29-493e-aae8-719b118c5009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:41.527609 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-f5bb175f-1988-4b3c-83cf-0e46af92bcae None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:37:41.529458 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-f5bb175f-1988-4b3c-83cf-0e46af92bcae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:41.537437 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 775/1559] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:37:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:37:41.538439 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb175f-1988-4b3c-83cf-0e46af92bcae None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:41.538555 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-96fdf242-ae29-493e-aae8-719b118c5009 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:37:41.539752 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-96fdf242-ae29-493e-aae8-719b118c5009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:41.547896 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 785/1560] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:37:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:37:41.548435 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb175f-1988-4b3c-83cf-0e46af92bcae None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:41.548661 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdf242-ae29-493e-aae8-719b118c5009 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:41.555713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9782b3-e03c-44c7-81b8-6d50df29764d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:41.556393 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9782b3-e03c-44c7-81b8-6d50df29764d admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:41.556674 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9782b3-e03c-44c7-81b8-6d50df29764d admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:41.556932 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9782b3-e03c-44c7-81b8-6d50df29764d admin admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:41.557685 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9782b3-e03c-44c7-81b8-6d50df29764d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:37:41.558013 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9782b3-e03c-44c7-81b8-6d50df29764d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:41.558548 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdf242-ae29-493e-aae8-719b118c5009 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:41.560076 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9782b3-e03c-44c7-81b8-6d50df29764d admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:41.563285 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e992c-64c0-4763-96fb-adbe09e8169b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:41.563944 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e992c-64c0-4763-96fb-adbe09e8169b admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:41.564253 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e992c-64c0-4763-96fb-adbe09e8169b admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:41.564619 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e992c-64c0-4763-96fb-adbe09e8169b admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:41.565768 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502e992c-64c0-4763-96fb-adbe09e8169b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:41.568981 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502e992c-64c0-4763-96fb-adbe09e8169b admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:41.572203 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 776/1561] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:37:41.573130 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9782b3-e03c-44c7-81b8-6d50df29764d admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:41.585683 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9782b3-e03c-44c7-81b8-6d50df29764d admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:41.590622 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26377c-2eea-4500-9724-2ec43fcfc6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:41.591294 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26377c-2eea-4500-9724-2ec43fcfc6c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:41.591577 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26377c-2eea-4500-9724-2ec43fcfc6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:41.591851 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26377c-2eea-4500-9724-2ec43fcfc6c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:41.592467 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 786/1562] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:37:41 2022] POST /identity/v3/users => generated 293 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:37:41.593001 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f26377c-2eea-4500-9724-2ec43fcfc6c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:41.593770 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea4542-1a71-4968-80f5-21e8029a5fb1 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:41.594078 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea4542-1a71-4968-80f5-21e8029a5fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:41.594369 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea4542-1a71-4968-80f5-21e8029a5fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:41.594727 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f26377c-2eea-4500-9724-2ec43fcfc6c4 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:41.609837 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 777/1563] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:37:41.609837 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26377c-2eea-4500-9724-2ec43fcfc6c4 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:41.613280 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-cdea4542-1a71-4968-80f5-21e8029a5fb1 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:37:41.614468 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-cdea4542-1a71-4968-80f5-21e8029a5fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:41.619884 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26377c-2eea-4500-9724-2ec43fcfc6c4 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:41.622759 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 787/1564] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:37:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:37:41.623566 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdea4542-1a71-4968-80f5-21e8029a5fb1 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:41.625757 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0a8f3e-29e2-43b5-a4a5-a1361cf18d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:41.626457 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a8f3e-29e2-43b5-a4a5-a1361cf18d6b admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:41.626812 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a8f3e-29e2-43b5-a4a5-a1361cf18d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:41.627085 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a8f3e-29e2-43b5-a4a5-a1361cf18d6b admin admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:41.627821 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0a8f3e-29e2-43b5-a4a5-a1361cf18d6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:37:41.628108 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0a8f3e-29e2-43b5-a4a5-a1361cf18d6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:41.629721 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0a8f3e-29e2-43b5-a4a5-a1361cf18d6b admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:41.633360 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdea4542-1a71-4968-80f5-21e8029a5fb1 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:41.637960 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f378dc-d3a3-414e-9f3e-118c3aca3f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:41.638617 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f378dc-d3a3-414e-9f3e-118c3aca3f50 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:41.638903 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f378dc-d3a3-414e-9f3e-118c3aca3f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:41.639175 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f378dc-d3a3-414e-9f3e-118c3aca3f50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:41.639893 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f378dc-d3a3-414e-9f3e-118c3aca3f50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:37:41.640192 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f378dc-d3a3-414e-9f3e-118c3aca3f50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:41.641796 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f378dc-d3a3-414e-9f3e-118c3aca3f50 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:41.649614 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 778/1565] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:37:41.649614 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0a8f3e-29e2-43b5-a4a5-a1361cf18d6b admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:41.650869 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:37:41.661841 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 788/1566] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:37:41.661841 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f378dc-d3a3-414e-9f3e-118c3aca3f50 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:41.662188 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0a8f3e-29e2-43b5-a4a5-a1361cf18d6b admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:41.662425 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95530b7-fa75-48ce-90d7-3f90b12a9463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:41.663202 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95530b7-fa75-48ce-90d7-3f90b12a9463 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:41.663480 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95530b7-fa75-48ce-90d7-3f90b12a9463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:41.663750 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95530b7-fa75-48ce-90d7-3f90b12a9463 admin admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:41.664476 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95530b7-fa75-48ce-90d7-3f90b12a9463 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:37:41.664761 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95530b7-fa75-48ce-90d7-3f90b12a9463 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:41.666380 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95530b7-fa75-48ce-90d7-3f90b12a9463 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:41.672664 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f378dc-d3a3-414e-9f3e-118c3aca3f50 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:41.677975 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d2569-d7c5-4709-b12d-f24b9724865a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:41.678652 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d2569-d7c5-4709-b12d-f24b9724865a admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:41.678940 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d2569-d7c5-4709-b12d-f24b9724865a admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:41.679217 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d2569-d7c5-4709-b12d-f24b9724865a admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:41.679626 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 779/1567] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:37:41.680617 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95530b7-fa75-48ce-90d7-3f90b12a9463 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:41.685922 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16d2569-d7c5-4709-b12d-f24b9724865a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:37:41.686241 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16d2569-d7c5-4709-b12d-f24b9724865a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:41.687862 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16d2569-d7c5-4709-b12d-f24b9724865a admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:41.690575 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95530b7-fa75-48ce-90d7-3f90b12a9463 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:41.696234 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac5a92-ee48-4ace-98a0-02b92e1784c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:41.696916 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac5a92-ee48-4ace-98a0-02b92e1784c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:41.697180 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac5a92-ee48-4ace-98a0-02b92e1784c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:41.697452 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac5a92-ee48-4ace-98a0-02b92e1784c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:41.698179 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac5a92-ee48-4ace-98a0-02b92e1784c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:41.700565 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac5a92-ee48-4ace-98a0-02b92e1784c2 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:41.707923 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 789/1568] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:37:41.707923 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d2569-d7c5-4709-b12d-f24b9724865a admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:41.710742 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d2569-d7c5-4709-b12d-f24b9724865a admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:41.715314 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d067d-64a9-47bc-83bf-7f76be6758fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:41.715999 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d067d-64a9-47bc-83bf-7f76be6758fe admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:41.716275 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d067d-64a9-47bc-83bf-7f76be6758fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:41.716593 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d067d-64a9-47bc-83bf-7f76be6758fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:41.717710 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d067d-64a9-47bc-83bf-7f76be6758fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:41.719553 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d067d-64a9-47bc-83bf-7f76be6758fe admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:41.729990 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 780/1569] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:37:41 2022] POST /identity/v3/projects => generated 391 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:37:41.730785 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac5a92-ee48-4ace-98a0-02b92e1784c2 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:41.736423 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 790/1570] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:37:41.736423 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d067d-64a9-47bc-83bf-7f76be6758fe admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:41.744674 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d067d-64a9-47bc-83bf-7f76be6758fe admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:41.795217 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac5a92-ee48-4ace-98a0-02b92e1784c2 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:41.800237 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc50b8c-5f08-438b-b930-d181b9966c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:41.801146 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc50b8c-5f08-438b-b930-d181b9966c43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:41.801422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc50b8c-5f08-438b-b930-d181b9966c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:41.801691 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc50b8c-5f08-438b-b930-d181b9966c43 admin admin] PATH_INFO: `/v3/projects/9c8bc85659564a3499f69383d238c3f7/users/0f7c910cba2b48b393805fcc4df8884a/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:41.802020 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bccf604-9cec-444b-93b8-5a5cd6dcbcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:41.802701 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccf604-9cec-444b-93b8-5a5cd6dcbcc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:41.802988 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccf604-9cec-444b-93b8-5a5cd6dcbcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:41.803265 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccf604-9cec-444b-93b8-5a5cd6dcbcc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:41.804004 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bccf604-9cec-444b-93b8-5a5cd6dcbcc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:37:41.804313 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bccf604-9cec-444b-93b8-5a5cd6dcbcc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:41.805955 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bccf604-9cec-444b-93b8-5a5cd6dcbcc6 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:41.818540 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc50b8c-5f08-438b-b930-d181b9966c43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c8bc85659564a3499f69383d238c3f7, user_id=0f7c910cba2b48b393805fcc4df8884a, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:41.818745 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 791/1571] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:37:41.819429 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bccf604-9cec-444b-93b8-5a5cd6dcbcc6 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:41.821220 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc50b8c-5f08-438b-b930-d181b9966c43 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:41.836718 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bccf604-9cec-444b-93b8-5a5cd6dcbcc6 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:41.837540 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 781/1572] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:37:41 2022] PUT /identity/v3/projects/9c8bc85659564a3499f69383d238c3f7/users/0f7c910cba2b48b393805fcc4df8884a/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:37:41.841561 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc50b8c-5f08-438b-b930-d181b9966c43 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:41.908455 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222dc2c4-2507-4ed9-8027-a7bebf7d943c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:41.909115 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222dc2c4-2507-4ed9-8027-a7bebf7d943c admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:41.909392 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222dc2c4-2507-4ed9-8027-a7bebf7d943c admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:41.909663 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222dc2c4-2507-4ed9-8027-a7bebf7d943c admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:41.910585 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222dc2c4-2507-4ed9-8027-a7bebf7d943c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:41.911354 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc50b8c-5f08-438b-b930-d181b9966c43 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:41.913012 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222dc2c4-2507-4ed9-8027-a7bebf7d943c admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:41.916625 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371921d-5afc-4b38-9262-6289a14f723e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:41.917472 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371921d-5afc-4b38-9262-6289a14f723e admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:41.917841 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371921d-5afc-4b38-9262-6289a14f723e admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:41.918221 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371921d-5afc-4b38-9262-6289a14f723e admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:41.919010 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371921d-5afc-4b38-9262-6289a14f723e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:41.921623 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371921d-5afc-4b38-9262-6289a14f723e admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:41.925623 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:37:41.949044 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 792/1573] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:37:41 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:37:41.953839 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222dc2c4-2507-4ed9-8027-a7bebf7d943c admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:41.959107 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 782/1574] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:37:41 2022] POST /identity/v3/projects => generated 365 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:37:41.959107 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371921d-5afc-4b38-9262-6289a14f723e admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:42.010808 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:37:42.024472 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222dc2c4-2507-4ed9-8027-a7bebf7d943c admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:42.035856 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371921d-5afc-4b38-9262-6289a14f723e admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:42.040878 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f844b-deaf-43c4-a6f9-ca93ab0cf867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:42.041624 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f844b-deaf-43c4-a6f9-ca93ab0cf867 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:42.041875 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f844b-deaf-43c4-a6f9-ca93ab0cf867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:42.042135 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f844b-deaf-43c4-a6f9-ca93ab0cf867 admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:42.042838 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48f844b-deaf-43c4-a6f9-ca93ab0cf867 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:42.044879 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48f844b-deaf-43c4-a6f9-ca93ab0cf867 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:42.074711 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 783/1575] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:37:41 2022] POST /identity/v3/projects => generated 377 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:37:42.076258 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f844b-deaf-43c4-a6f9-ca93ab0cf867 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:42.093169 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c6d43-e716-44f7-b24b-14fc69e401b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:42.094076 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c6d43-e716-44f7-b24b-14fc69e401b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:42.094482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c6d43-e716-44f7-b24b-14fc69e401b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:42.094941 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c6d43-e716-44f7-b24b-14fc69e401b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:42.095843 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c6d43-e716-44f7-b24b-14fc69e401b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:42.097943 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c6d43-e716-44f7-b24b-14fc69e401b7 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:42.130763 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 793/1576] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:37:41 2022] POST /identity/v3/projects => generated 379 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:37:42.133395 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c6d43-e716-44f7-b24b-14fc69e401b7 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:42.152528 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f844b-deaf-43c4-a6f9-ca93ab0cf867 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:42.220653 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c6d43-e716-44f7-b24b-14fc69e401b7 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:42.221082 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc8a541-c1ff-435e-a045-fd1d95935f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:42.222252 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8a541-c1ff-435e-a045-fd1d95935f63 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:42.222754 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8a541-c1ff-435e-a045-fd1d95935f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:42.223255 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8a541-c1ff-435e-a045-fd1d95935f63 admin admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:42.224466 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc8a541-c1ff-435e-a045-fd1d95935f63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:42.225453 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8efc6-2157-43c9-ae04-b559ade1ec95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:42.226193 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8efc6-2157-43c9-ae04-b559ade1ec95 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:42.226472 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8efc6-2157-43c9-ae04-b559ade1ec95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:42.226743 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8efc6-2157-43c9-ae04-b559ade1ec95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:42.226848 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc8a541-c1ff-435e-a045-fd1d95935f63 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:42.227474 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8efc6-2157-43c9-ae04-b559ade1ec95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:42.229111 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8efc6-2157-43c9-ae04-b559ade1ec95 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:42.240378 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 794/1577] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:37:42.241264 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8efc6-2157-43c9-ae04-b559ade1ec95 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:42.253912 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8efc6-2157-43c9-ae04-b559ade1ec95 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:42.256594 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 784/1578] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:37:42 2022] POST /identity/v3/users => generated 296 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:37:42.258154 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e918c23-d185-452b-b564-05d7feb9d5a9 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:42.259623 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e918c23-d185-452b-b564-05d7feb9d5a9 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:42.259623 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e918c23-d185-452b-b564-05d7feb9d5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:42.263978 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab4d7e3-143f-4ebb-bdfe-3dc0386975e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:42.265047 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4d7e3-143f-4ebb-bdfe-3dc0386975e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:42.265905 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4d7e3-143f-4ebb-bdfe-3dc0386975e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:42.266355 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4d7e3-143f-4ebb-bdfe-3dc0386975e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:42.267559 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab4d7e3-143f-4ebb-bdfe-3dc0386975e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:42.270669 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab4d7e3-143f-4ebb-bdfe-3dc0386975e1 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:42.273523 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:37:42.280866 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-4e918c23-d185-452b-b564-05d7feb9d5a9 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:37:42.282897 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-4e918c23-d185-452b-b564-05d7feb9d5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:42.292091 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 785/1579] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:37:42.293135 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e918c23-d185-452b-b564-05d7feb9d5a9 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:42.310699 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e918c23-d185-452b-b564-05d7feb9d5a9 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:42.310912 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 795/1580] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:37:42 2022] POST /identity/v3/projects => generated 365 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:37:42.310912 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab4d7e3-143f-4ebb-bdfe-3dc0386975e1 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:42.311126 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e200a028-7631-4a1d-8379-897f6ffb1b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:42.311126 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200a028-7631-4a1d-8379-897f6ffb1b48 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:42.311126 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200a028-7631-4a1d-8379-897f6ffb1b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:42.311126 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200a028-7631-4a1d-8379-897f6ffb1b48 admin admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:42.311595 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e200a028-7631-4a1d-8379-897f6ffb1b48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:42.313526 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e200a028-7631-4a1d-8379-897f6ffb1b48 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:42.337857 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 786/1581] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:37:42 2022] POST /identity/v3/users => generated 293 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:37:42.338853 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e200a028-7631-4a1d-8379-897f6ffb1b48 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:42.349133 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e200a028-7631-4a1d-8379-897f6ffb1b48 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:42.391926 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:37:42.396086 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab4d7e3-143f-4ebb-bdfe-3dc0386975e1 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:42.402028 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20852c26-a4d4-4d8b-adec-74a04041697a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:42.402756 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20852c26-a4d4-4d8b-adec-74a04041697a admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:42.403094 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20852c26-a4d4-4d8b-adec-74a04041697a admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:42.403474 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20852c26-a4d4-4d8b-adec-74a04041697a admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:42.404244 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20852c26-a4d4-4d8b-adec-74a04041697a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:42.406196 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20852c26-a4d4-4d8b-adec-74a04041697a admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:42.416978 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f13a3-98e0-4e86-9c05-3f4f4a395554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:42.418878 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f13a3-98e0-4e86-9c05-3f4f4a395554 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:42.418878 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f13a3-98e0-4e86-9c05-3f4f4a395554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:42.418878 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f13a3-98e0-4e86-9c05-3f4f4a395554 admin admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:42.419224 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f13a3-98e0-4e86-9c05-3f4f4a395554 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:42.421224 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f13a3-98e0-4e86-9c05-3f4f4a395554 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:42.431558 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 796/1582] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:37:42 2022] POST /identity/v3/users => generated 283 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:37:42.432380 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20852c26-a4d4-4d8b-adec-74a04041697a admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:42.444496 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20852c26-a4d4-4d8b-adec-74a04041697a admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:42.451097 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 787/1583] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:37:42 2022] POST /identity/v3/users => generated 289 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:37:42.451097 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f13a3-98e0-4e86-9c05-3f4f4a395554 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:42.451378 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47944c86-aea6-4dd8-ae7a-30430b88b6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:42.452486 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47944c86-aea6-4dd8-ae7a-30430b88b6e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:42.452780 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47944c86-aea6-4dd8-ae7a-30430b88b6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:42.453058 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47944c86-aea6-4dd8-ae7a-30430b88b6e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:42.453755 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47944c86-aea6-4dd8-ae7a-30430b88b6e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:42.455714 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47944c86-aea6-4dd8-ae7a-30430b88b6e6 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:42.461223 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f13a3-98e0-4e86-9c05-3f4f4a395554 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:42.469737 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846efdbc-e7bf-4876-8634-155eb09eb0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:42.471634 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846efdbc-e7bf-4876-8634-155eb09eb0de admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:42.472153 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846efdbc-e7bf-4876-8634-155eb09eb0de admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:42.472486 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846efdbc-e7bf-4876-8634-155eb09eb0de admin admin] PATH_INFO: `/v3/projects/cff54f284aef4805bd552dbe43456938/users/74d30ee6d35f4d4899e4927944a3dd93/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:42.480190 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 797/1584] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:37:42 2022] POST /identity/v3/users => generated 290 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:37:42.481732 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47944c86-aea6-4dd8-ae7a-30430b88b6e6 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:42.491413 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846efdbc-e7bf-4876-8634-155eb09eb0de admin admin] RBAC: Authorizing `identity:create_grant(project_id=cff54f284aef4805bd552dbe43456938, user_id=74d30ee6d35f4d4899e4927944a3dd93, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:42.495174 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47944c86-aea6-4dd8-ae7a-30430b88b6e6 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:42.496270 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846efdbc-e7bf-4876-8634-155eb09eb0de admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:42.500558 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63823b-3f98-4663-a2c4-840e8e2dfdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:42.501232 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63823b-3f98-4663-a2c4-840e8e2dfdec admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:42.501525 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63823b-3f98-4663-a2c4-840e8e2dfdec admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:42.501823 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63823b-3f98-4663-a2c4-840e8e2dfdec admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:42.502557 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea63823b-3f98-4663-a2c4-840e8e2dfdec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:42.506051 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea63823b-3f98-4663-a2c4-840e8e2dfdec admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:42.514515 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 788/1585] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:37:42 2022] PUT /identity/v3/projects/cff54f284aef4805bd552dbe43456938/users/74d30ee6d35f4d4899e4927944a3dd93/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:37:42.515579 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846efdbc-e7bf-4876-8634-155eb09eb0de admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:42.518198 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-846efdbc-e7bf-4876-8634-155eb09eb0de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:42.522206 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 798/1586] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:37:42.522206 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63823b-3f98-4663-a2c4-840e8e2dfdec admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:42.535737 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63823b-3f98-4663-a2c4-840e8e2dfdec admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:42.598397 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846efdbc-e7bf-4876-8634-155eb09eb0de admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:42.599266 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5cd6e-5c02-43d3-b489-e81eca2086e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:42.599682 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5cd6e-5c02-43d3-b489-e81eca2086e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:42.599977 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5cd6e-5c02-43d3-b489-e81eca2086e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:42.600243 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5cd6e-5c02-43d3-b489-e81eca2086e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:42.601071 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd5cd6e-5c02-43d3-b489-e81eca2086e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:42.602586 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047efff5-7bae-4066-b371-dd08e1c355b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:42.603247 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047efff5-7bae-4066-b371-dd08e1c355b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:42.603525 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047efff5-7bae-4066-b371-dd08e1c355b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:42.603800 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047efff5-7bae-4066-b371-dd08e1c355b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:42.604569 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd5cd6e-5c02-43d3-b489-e81eca2086e8 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:42.614542 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047efff5-7bae-4066-b371-dd08e1c355b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:42.616297 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047efff5-7bae-4066-b371-dd08e1c355b0 service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:42.629304 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 789/1587] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:37:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:37:42.633624 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047efff5-7bae-4066-b371-dd08e1c355b0 service neutron] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:42.633970 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 799/1588] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:37:42 2022] POST /identity/v3/users => generated 283 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:37:42.633970 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5cd6e-5c02-43d3-b489-e81eca2086e8 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:42.640945 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047efff5-7bae-4066-b371-dd08e1c355b0 service neutron] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:42.647210 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c3e6bf-e58b-4e67-912d-bda8ee60f216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:42.647891 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3e6bf-e58b-4e67-912d-bda8ee60f216 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:42.648169 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3e6bf-e58b-4e67-912d-bda8ee60f216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:42.648574 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3e6bf-e58b-4e67-912d-bda8ee60f216 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:42.648767 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5cd6e-5c02-43d3-b489-e81eca2086e8 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:42.649320 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c3e6bf-e58b-4e67-912d-bda8ee60f216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:42.651554 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c3e6bf-e58b-4e67-912d-bda8ee60f216 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:42.656000 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb0553-9b16-4cf9-9057-f7fee67a207c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:42.656863 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb0553-9b16-4cf9-9057-f7fee67a207c admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:42.657165 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb0553-9b16-4cf9-9057-f7fee67a207c admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:42.657447 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb0553-9b16-4cf9-9057-f7fee67a207c admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:42.658337 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fb0553-9b16-4cf9-9057-f7fee67a207c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:42.660005 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fb0553-9b16-4cf9-9057-f7fee67a207c admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:42.667445 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 790/1589] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:37:42.667445 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c3e6bf-e58b-4e67-912d-bda8ee60f216 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:42.673505 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 800/1590] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:37:42.674199 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb0553-9b16-4cf9-9057-f7fee67a207c admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:42.682314 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c3e6bf-e58b-4e67-912d-bda8ee60f216 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:42.687192 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb0553-9b16-4cf9-9057-f7fee67a207c admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:42.687472 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e0add-a44f-4636-8791-5c39b0ad4847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:42.688676 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e0add-a44f-4636-8791-5c39b0ad4847 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:42.688676 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e0add-a44f-4636-8791-5c39b0ad4847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:42.688868 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e0add-a44f-4636-8791-5c39b0ad4847 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:42.689629 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e0add-a44f-4636-8791-5c39b0ad4847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:42.691258 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e0add-a44f-4636-8791-5c39b0ad4847 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:42.693167 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0568d5af-a9f3-48e1-9779-34aeb79dcc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:42.694080 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568d5af-a9f3-48e1-9779-34aeb79dcc97 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:42.694373 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568d5af-a9f3-48e1-9779-34aeb79dcc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:42.694739 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568d5af-a9f3-48e1-9779-34aeb79dcc97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:42.697277 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0568d5af-a9f3-48e1-9779-34aeb79dcc97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:42.700426 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0568d5af-a9f3-48e1-9779-34aeb79dcc97 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:42.704757 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 791/1591] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:37:42.705489 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e0add-a44f-4636-8791-5c39b0ad4847 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:42.716885 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e0add-a44f-4636-8791-5c39b0ad4847 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:42.717810 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 801/1592] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:37:42.719071 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71c337-e04d-468b-af7d-b6f8ecfe694c None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:42.719368 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71c337-e04d-468b-af7d-b6f8ecfe694c None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:42.719648 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71c337-e04d-468b-af7d-b6f8ecfe694c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:42.722375 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d4748-b4c2-4f9d-96fe-b48d6302378e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:42.723277 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d4748-b4c2-4f9d-96fe-b48d6302378e admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:42.723721 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d4748-b4c2-4f9d-96fe-b48d6302378e admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:42.724456 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d4748-b4c2-4f9d-96fe-b48d6302378e admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:42.725883 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d4748-b4c2-4f9d-96fe-b48d6302378e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:42.727916 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d4748-b4c2-4f9d-96fe-b48d6302378e admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:42.743850 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 792/1593] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:37:42.749091 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d4748-b4c2-4f9d-96fe-b48d6302378e admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:42.751381 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-5c71c337-e04d-468b-af7d-b6f8ecfe694c None None] MFA Rules not processed for user `74d30ee6d35f4d4899e4927944a3dd93`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:37:42.752619 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5c71c337-e04d-468b-af7d-b6f8ecfe694c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:42.766311 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d4748-b4c2-4f9d-96fe-b48d6302378e admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:42.772052 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7da2b-53ba-45d3-9a44-4ff4990bdf4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:42.772740 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7da2b-53ba-45d3-9a44-4ff4990bdf4f admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:42.773021 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7da2b-53ba-45d3-9a44-4ff4990bdf4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:42.774022 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7da2b-53ba-45d3-9a44-4ff4990bdf4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:42.774805 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d7da2b-53ba-45d3-9a44-4ff4990bdf4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:42.776426 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d7da2b-53ba-45d3-9a44-4ff4990bdf4f admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:42.790799 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 793/1594] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:37:42.790799 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7da2b-53ba-45d3-9a44-4ff4990bdf4f admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:42.799523 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7da2b-53ba-45d3-9a44-4ff4990bdf4f admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:42.804962 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b289ae5-d811-4992-8ef3-dae6600f0340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:42.805906 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b289ae5-d811-4992-8ef3-dae6600f0340 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:42.806282 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b289ae5-d811-4992-8ef3-dae6600f0340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:42.806627 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b289ae5-d811-4992-8ef3-dae6600f0340 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:42.807647 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b289ae5-d811-4992-8ef3-dae6600f0340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:42.809808 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b289ae5-d811-4992-8ef3-dae6600f0340 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:42.811654 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:37:42.822265 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 794/1595] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:37:42.823426 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b289ae5-d811-4992-8ef3-dae6600f0340 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:42.829201 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 802/1596] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:37:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:37:42.829967 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71c337-e04d-468b-af7d-b6f8ecfe694c None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:42.841747 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b289ae5-d811-4992-8ef3-dae6600f0340 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:42.843468 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71c337-e04d-468b-af7d-b6f8ecfe694c None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:42.847142 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe46d7-277a-4d57-88d4-1f8c332cec1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:42.847812 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe46d7-277a-4d57-88d4-1f8c332cec1c admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:42.848096 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe46d7-277a-4d57-88d4-1f8c332cec1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:42.848374 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe46d7-277a-4d57-88d4-1f8c332cec1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:42.849155 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64435750-c3be-4513-92fe-d3228ff475e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:42.849281 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe46d7-277a-4d57-88d4-1f8c332cec1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:42.850370 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64435750-c3be-4513-92fe-d3228ff475e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:42.850681 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64435750-c3be-4513-92fe-d3228ff475e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:42.850834 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe46d7-277a-4d57-88d4-1f8c332cec1c admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:42.851135 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64435750-c3be-4513-92fe-d3228ff475e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:42.852395 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64435750-c3be-4513-92fe-d3228ff475e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:42.854654 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64435750-c3be-4513-92fe-d3228ff475e4 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:42.869504 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 803/1597] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:37:42.870462 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64435750-c3be-4513-92fe-d3228ff475e4 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:42.874286 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 795/1598] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:37:42.874286 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe46d7-277a-4d57-88d4-1f8c332cec1c admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:42.888238 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe46d7-277a-4d57-88d4-1f8c332cec1c admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:42.891375 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:37:42.897019 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ddbc0-cf61-466e-ab24-7277a7823194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:42.899041 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ddbc0-cf61-466e-ab24-7277a7823194 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:42.899540 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ddbc0-cf61-466e-ab24-7277a7823194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:42.900054 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ddbc0-cf61-466e-ab24-7277a7823194 admin admin] PATH_INFO: `/v3/projects/3daa5e049f97475bb8adf78342e2510c/users/9a6b1637ae344e6fa593b0aa10c003d3/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:42.900810 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64435750-c3be-4513-92fe-d3228ff475e4 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:42.914377 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abbe1a1-11c4-4239-839f-2828d509594e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:42.915091 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abbe1a1-11c4-4239-839f-2828d509594e admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:42.915357 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abbe1a1-11c4-4239-839f-2828d509594e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:42.915644 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abbe1a1-11c4-4239-839f-2828d509594e admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:42.916648 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abbe1a1-11c4-4239-839f-2828d509594e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:42.919458 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abbe1a1-11c4-4239-839f-2828d509594e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:42.920060 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0ddbc0-cf61-466e-ab24-7277a7823194 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3daa5e049f97475bb8adf78342e2510c, user_id=9a6b1637ae344e6fa593b0aa10c003d3, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:42.923759 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0ddbc0-cf61-466e-ab24-7277a7823194 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:42.931020 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 804/1599] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:37:42.935381 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abbe1a1-11c4-4239-839f-2828d509594e admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:42.946472 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 796/1600] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:37:42 2022] PUT /identity/v3/projects/3daa5e049f97475bb8adf78342e2510c/users/9a6b1637ae344e6fa593b0aa10c003d3/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:37:42.946472 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ddbc0-cf61-466e-ab24-7277a7823194 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:42.946779 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abbe1a1-11c4-4239-839f-2828d509594e admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:43.011821 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b74a7-a750-4e91-9905-8d9f93a853a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:43.012601 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b74a7-a750-4e91-9905-8d9f93a853a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:43.012883 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ddbc0-cf61-466e-ab24-7277a7823194 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:43.013003 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b74a7-a750-4e91-9905-8d9f93a853a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:43.013392 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b74a7-a750-4e91-9905-8d9f93a853a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:43.014244 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b74a7-a750-4e91-9905-8d9f93a853a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:43.016215 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b74a7-a750-4e91-9905-8d9f93a853a1 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:43.018047 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c1e65-8b50-421e-b6b4-a5534bfb2ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:43.019188 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c1e65-8b50-421e-b6b4-a5534bfb2ecd admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:43.019475 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c1e65-8b50-421e-b6b4-a5534bfb2ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:43.019737 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c1e65-8b50-421e-b6b4-a5534bfb2ecd admin admin] PATH_INFO: `/v3/projects/57b501d5874e405daa2793c3b72f3201/users/1332dc25fb5c4d5b8ed7bd0bd77243d0/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:43.031667 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 805/1601] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:37:43.031667 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b74a7-a750-4e91-9905-8d9f93a853a1 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:43.039195 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b74a7-a750-4e91-9905-8d9f93a853a1 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:43.040936 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c1e65-8b50-421e-b6b4-a5534bfb2ecd admin admin] RBAC: Authorizing `identity:create_grant(project_id=57b501d5874e405daa2793c3b72f3201, user_id=1332dc25fb5c4d5b8ed7bd0bd77243d0, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:43.044773 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c1e65-8b50-421e-b6b4-a5534bfb2ecd admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:43.045626 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5112a0-b9d1-42d7-83d1-2202bc2751ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:43.046880 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5112a0-b9d1-42d7-83d1-2202bc2751ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:43.047393 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5112a0-b9d1-42d7-83d1-2202bc2751ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:43.047851 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5112a0-b9d1-42d7-83d1-2202bc2751ee admin admin] PATH_INFO: `/v3/projects/b74558f098234027b1d9067e7132b258/users/9925dde3c53843e48e59cf353a857956/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:43.065595 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 797/1602] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:37:42 2022] PUT /identity/v3/projects/57b501d5874e405daa2793c3b72f3201/users/1332dc25fb5c4d5b8ed7bd0bd77243d0/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:37:43.066331 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c1e65-8b50-421e-b6b4-a5534bfb2ecd admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:43.087328 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5112a0-b9d1-42d7-83d1-2202bc2751ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=b74558f098234027b1d9067e7132b258, user_id=9925dde3c53843e48e59cf353a857956, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:43.088374 dv-cinder-836973-11-smb devstack@keystone.service[80149]: WARNING py.warnings [None req-7d5112a0-b9d1-42d7-83d1-2202bc2751ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 17:37:43.088374 dv-cinder-836973-11-smb devstack@keystone.service[80149]: warnings.warn(msg) Jul 15 17:37:43.088374 dv-cinder-836973-11-smb devstack@keystone.service[80149]: Jul 15 17:37:43.090619 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5112a0-b9d1-42d7-83d1-2202bc2751ee admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:43.111426 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 806/1603] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:37:43 2022] PUT /identity/v3/projects/b74558f098234027b1d9067e7132b258/users/9925dde3c53843e48e59cf353a857956/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:37:43.116320 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102fdb8-731a-417d-b6db-c819eea195ad None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:43.116658 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102fdb8-731a-417d-b6db-c819eea195ad None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:43.116869 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102fdb8-731a-417d-b6db-c819eea195ad None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:43.118642 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 807/1604] 10.222.0.27 () {54 vars in 961 bytes} [Fri Jul 15 17:37:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:37:43.120060 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e102fdb8-731a-417d-b6db-c819eea195ad None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:43.155603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c1e65-8b50-421e-b6b4-a5534bfb2ecd admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:43.194737 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e102fdb8-731a-417d-b6db-c819eea195ad None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:43.200516 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2349ae-6df7-42c0-9e1b-75abaaf7a589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:43.201427 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2349ae-6df7-42c0-9e1b-75abaaf7a589 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:43.202034 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2349ae-6df7-42c0-9e1b-75abaaf7a589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:43.202526 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2349ae-6df7-42c0-9e1b-75abaaf7a589 admin admin] PATH_INFO: `/v3/projects/e878db375d0d433f8371b02f9b4a0d4e/users/c74dd7359f33431baa46ef7e2a84024a/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:43.211064 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:37:43.223441 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffb7e1f-376e-44d3-9a6b-dd2246d2988c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:43.224099 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2349ae-6df7-42c0-9e1b-75abaaf7a589 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e878db375d0d433f8371b02f9b4a0d4e, user_id=c74dd7359f33431baa46ef7e2a84024a, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:43.224625 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb7e1f-376e-44d3-9a6b-dd2246d2988c admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:43.225008 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb7e1f-376e-44d3-9a6b-dd2246d2988c admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:43.225435 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb7e1f-376e-44d3-9a6b-dd2246d2988c admin admin] PATH_INFO: `/v3/projects/8df18b17572a4c84b5560cff7a6826b2/users/581bfbaa1757460486b8b5c3b7afe225/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:43.226990 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2349ae-6df7-42c0-9e1b-75abaaf7a589 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:43.243212 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffb7e1f-376e-44d3-9a6b-dd2246d2988c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8df18b17572a4c84b5560cff7a6826b2, user_id=581bfbaa1757460486b8b5c3b7afe225, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:43.244863 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 808/1605] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:37:43 2022] PUT /identity/v3/projects/e878db375d0d433f8371b02f9b4a0d4e/users/c74dd7359f33431baa46ef7e2a84024a/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:37:43.246144 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d95a9f-f5c6-459c-86db-c8ac11838c83 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:43.246429 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d95a9f-f5c6-459c-86db-c8ac11838c83 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:43.246713 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d95a9f-f5c6-459c-86db-c8ac11838c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:43.248914 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffb7e1f-376e-44d3-9a6b-dd2246d2988c admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:43.266531 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-15d95a9f-f5c6-459c-86db-c8ac11838c83 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:37:43.267701 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 798/1606] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:37:43 2022] PUT /identity/v3/projects/8df18b17572a4c84b5560cff7a6826b2/users/581bfbaa1757460486b8b5c3b7afe225/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:37:43.267849 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-15d95a9f-f5c6-459c-86db-c8ac11838c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:43.268661 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffb7e1f-376e-44d3-9a6b-dd2246d2988c admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:43.317551 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:37:43.336193 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 809/1607] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:37:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:37:43.337522 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd433ddf-4b26-4cf4-b2da-ac814bca494f None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:43.337980 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd433ddf-4b26-4cf4-b2da-ac814bca494f None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:43.338096 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd433ddf-4b26-4cf4-b2da-ac814bca494f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:43.350582 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffb7e1f-376e-44d3-9a6b-dd2246d2988c admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:43.355347 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ebc5c-dadf-4b85-9ea4-04cc6662ae67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:43.357063 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ebc5c-dadf-4b85-9ea4-04cc6662ae67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:43.357345 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-cd433ddf-4b26-4cf4-b2da-ac814bca494f None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:37:43.357481 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ebc5c-dadf-4b85-9ea4-04cc6662ae67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:43.357910 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ebc5c-dadf-4b85-9ea4-04cc6662ae67 admin admin] PATH_INFO: `/v3/projects/85c233e0e33647a58a8557b7b6837c27/users/4a2b73734b5748fdbfee97f7bb26e258/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:43.358602 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-cd433ddf-4b26-4cf4-b2da-ac814bca494f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:43.366451 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 810/1608] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:37:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:37:43.370636 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c275f6c-497e-483a-81b9-142cf80484de None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:43.370922 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c275f6c-497e-483a-81b9-142cf80484de None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:43.371233 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c275f6c-497e-483a-81b9-142cf80484de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:43.374426 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ebc5c-dadf-4b85-9ea4-04cc6662ae67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85c233e0e33647a58a8557b7b6837c27, user_id=4a2b73734b5748fdbfee97f7bb26e258, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:43.377523 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ebc5c-dadf-4b85-9ea4-04cc6662ae67 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:43.390097 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-3c275f6c-497e-483a-81b9-142cf80484de None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:37:43.391354 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-3c275f6c-497e-483a-81b9-142cf80484de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:43.394012 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 799/1609] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:37:43 2022] PUT /identity/v3/projects/85c233e0e33647a58a8557b7b6837c27/users/4a2b73734b5748fdbfee97f7bb26e258/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:37:43.399679 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e7ba7-a074-41e6-a428-e6e05a6f3b54 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:43.400427 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e7ba7-a074-41e6-a428-e6e05a6f3b54 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:43.401808 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e7ba7-a074-41e6-a428-e6e05a6f3b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:43.444135 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-4b0e7ba7-a074-41e6-a428-e6e05a6f3b54 None None] MFA Rules not processed for user `f9d548c8199e4fdbbce7597bebd63421`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:37:43.445367 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-4b0e7ba7-a074-41e6-a428-e6e05a6f3b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:43.460745 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 811/1610] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:37:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:37:43.462097 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752031a1-0c09-476b-8e37-e712f8a13df2 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:43.462451 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752031a1-0c09-476b-8e37-e712f8a13df2 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:43.462797 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752031a1-0c09-476b-8e37-e712f8a13df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:43.481516 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-752031a1-0c09-476b-8e37-e712f8a13df2 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:37:43.483226 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-752031a1-0c09-476b-8e37-e712f8a13df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:43.497427 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 812/1611] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:37:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:37:43.498901 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd13ebd-ce0a-43ca-9df5-4db12b75fa52 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:43.499194 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd13ebd-ce0a-43ca-9df5-4db12b75fa52 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:43.499477 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd13ebd-ce0a-43ca-9df5-4db12b75fa52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:43.521582 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 800/1612] 10.222.0.27 () {58 vars in 1058 bytes} [Fri Jul 15 17:37:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:37:43.522325 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e7ba7-a074-41e6-a428-e6e05a6f3b54 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:43.532758 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-9dd13ebd-ce0a-43ca-9df5-4db12b75fa52 None None] MFA Rules not processed for user `581bfbaa1757460486b8b5c3b7afe225`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:37:43.535093 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-9dd13ebd-ce0a-43ca-9df5-4db12b75fa52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:43.581242 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:37:43.603880 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e7ba7-a074-41e6-a428-e6e05a6f3b54 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:43.610777 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af65431-8886-42f6-8302-e0aea5c5a060 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:43.611390 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af65431-8886-42f6-8302-e0aea5c5a060 service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:43.611679 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af65431-8886-42f6-8302-e0aea5c5a060 service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:43.612473 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af65431-8886-42f6-8302-e0aea5c5a060 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:43.623753 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af65431-8886-42f6-8302-e0aea5c5a060 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:43.625479 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af65431-8886-42f6-8302-e0aea5c5a060 service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:43.638898 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 813/1613] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:37:43 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:37:43.638898 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd13ebd-ce0a-43ca-9df5-4db12b75fa52 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:43.639175 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 801/1614] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:37:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:37:43.640512 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38138b7-ada5-47e6-8a63-fa13371c5cbe None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:43.640853 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38138b7-ada5-47e6-8a63-fa13371c5cbe None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:43.641182 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38138b7-ada5-47e6-8a63-fa13371c5cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:43.647742 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd13ebd-ce0a-43ca-9df5-4db12b75fa52 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:43.652562 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ffd896-748e-473c-adef-c7e4b86ce414 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:43.654414 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffd896-748e-473c-adef-c7e4b86ce414 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:43.654793 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffd896-748e-473c-adef-c7e4b86ce414 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:43.655097 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffd896-748e-473c-adef-c7e4b86ce414 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:43.670132 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ffd896-748e-473c-adef-c7e4b86ce414 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:43.672339 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ffd896-748e-473c-adef-c7e4b86ce414 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:43.677081 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-e38138b7-ada5-47e6-8a63-fa13371c5cbe None None] MFA Rules not processed for user `4a2b73734b5748fdbfee97f7bb26e258`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:37:43.678455 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-e38138b7-ada5-47e6-8a63-fa13371c5cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:43.685822 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 814/1615] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:37:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:37:43.686709 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ffd896-748e-473c-adef-c7e4b86ce414 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:43.695885 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ffd896-748e-473c-adef-c7e4b86ce414 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:43.699823 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc912f2a-e7b3-4722-816e-a3b004e1747c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:43.700795 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc912f2a-e7b3-4722-816e-a3b004e1747c service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:43.701079 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc912f2a-e7b3-4722-816e-a3b004e1747c service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:43.701522 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc912f2a-e7b3-4722-816e-a3b004e1747c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:43.715235 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc912f2a-e7b3-4722-816e-a3b004e1747c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:43.717014 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc912f2a-e7b3-4722-816e-a3b004e1747c service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:43.733141 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 815/1616] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:37:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:37:43.734852 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc912f2a-e7b3-4722-816e-a3b004e1747c service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:43.748184 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc912f2a-e7b3-4722-816e-a3b004e1747c service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:43.757820 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c290f302-3f45-4cd2-863d-a9704576905d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:43.758614 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290f302-3f45-4cd2-863d-a9704576905d service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:43.758899 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290f302-3f45-4cd2-863d-a9704576905d service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:43.760001 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290f302-3f45-4cd2-863d-a9704576905d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:43.776046 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c290f302-3f45-4cd2-863d-a9704576905d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:43.778149 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c290f302-3f45-4cd2-863d-a9704576905d service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:43.784020 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 802/1617] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:37:43 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:37:43.786665 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38138b7-ada5-47e6-8a63-fa13371c5cbe None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:43.793883 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 816/1618] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:37:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:37:43.794727 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c290f302-3f45-4cd2-863d-a9704576905d service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:43.803091 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38138b7-ada5-47e6-8a63-fa13371c5cbe None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:43.805903 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c290f302-3f45-4cd2-863d-a9704576905d service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:43.809944 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f97a2-6711-49e1-bc7c-c9e7f8266423 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:43.810622 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f97a2-6711-49e1-bc7c-c9e7f8266423 service nova] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:43.810908 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f97a2-6711-49e1-bc7c-c9e7f8266423 service nova] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:43.811018 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a66acb-a2fc-4216-a019-20bbad772d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:43.811208 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f97a2-6711-49e1-bc7c-c9e7f8266423 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:43.811716 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a66acb-a2fc-4216-a019-20bbad772d22 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:43.812003 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a66acb-a2fc-4216-a019-20bbad772d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:43.812283 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a66acb-a2fc-4216-a019-20bbad772d22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:43.813123 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a66acb-a2fc-4216-a019-20bbad772d22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:43.816728 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a66acb-a2fc-4216-a019-20bbad772d22 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:43.859503 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 817/1619] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:37:43 2022] POST /identity/v3/projects => generated 365 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:37:43.860561 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a66acb-a2fc-4216-a019-20bbad772d22 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:43.870489 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:37:43.877072 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f97a2-6711-49e1-bc7c-c9e7f8266423 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:43.878951 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f97a2-6711-49e1-bc7c-c9e7f8266423 service nova] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:43.889835 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 803/1620] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:37:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:37:43.890849 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f97a2-6711-49e1-bc7c-c9e7f8266423 service nova] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:43.902793 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f97a2-6711-49e1-bc7c-c9e7f8266423 service nova] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:43.970302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a66acb-a2fc-4216-a019-20bbad772d22 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:43.979482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796afc19-518b-4f7d-a169-b72e8faef0cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:43.980157 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796afc19-518b-4f7d-a169-b72e8faef0cc service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:43.980660 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796afc19-518b-4f7d-a169-b72e8faef0cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:43.980921 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796afc19-518b-4f7d-a169-b72e8faef0cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:44.004740 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b692cf-2dbf-4d06-8a00-184117fe91a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:44.005447 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b692cf-2dbf-4d06-8a00-184117fe91a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:44.005728 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b692cf-2dbf-4d06-8a00-184117fe91a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:44.006020 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b692cf-2dbf-4d06-8a00-184117fe91a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:44.006725 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b692cf-2dbf-4d06-8a00-184117fe91a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:44.009100 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b692cf-2dbf-4d06-8a00-184117fe91a8 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:44.021498 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:37:44.048571 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 804/1621] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:37:43 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:37:44.049703 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b692cf-2dbf-4d06-8a00-184117fe91a8 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:44.069252 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b692cf-2dbf-4d06-8a00-184117fe91a8 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:44.083719 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d1fa0-5f25-4c46-93f2-61e8d81ecf50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:44.084623 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d1fa0-5f25-4c46-93f2-61e8d81ecf50 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:44.085253 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d1fa0-5f25-4c46-93f2-61e8d81ecf50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:44.085684 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d1fa0-5f25-4c46-93f2-61e8d81ecf50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:44.086722 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4d1fa0-5f25-4c46-93f2-61e8d81ecf50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:44.088674 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4d1fa0-5f25-4c46-93f2-61e8d81ecf50 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:44.104785 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 805/1622] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:37:44.106034 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d1fa0-5f25-4c46-93f2-61e8d81ecf50 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:44.117285 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d1fa0-5f25-4c46-93f2-61e8d81ecf50 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:44.122917 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833873dd-4ce6-4e0e-971d-dd5d8ec917df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:44.124085 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833873dd-4ce6-4e0e-971d-dd5d8ec917df admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:44.124557 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833873dd-4ce6-4e0e-971d-dd5d8ec917df admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:44.125140 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833873dd-4ce6-4e0e-971d-dd5d8ec917df admin admin] PATH_INFO: `/v3/projects/6ae5f0280f88424e9e335042ef46cb2e/users/e2416d83f575448b92744496a85b4db9/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:44.127156 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796afc19-518b-4f7d-a169-b72e8faef0cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:44.129887 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796afc19-518b-4f7d-a169-b72e8faef0cc service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:44.143610 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833873dd-4ce6-4e0e-971d-dd5d8ec917df admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ae5f0280f88424e9e335042ef46cb2e, user_id=e2416d83f575448b92744496a85b4db9, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:44.146953 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833873dd-4ce6-4e0e-971d-dd5d8ec917df admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:44.157365 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 818/1623] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:37:43 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:37:44.164160 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 806/1624] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:37:44 2022] PUT /identity/v3/projects/6ae5f0280f88424e9e335042ef46cb2e/users/e2416d83f575448b92744496a85b4db9/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:37:44.168765 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796afc19-518b-4f7d-a169-b72e8faef0cc service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:44.189511 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796afc19-518b-4f7d-a169-b72e8faef0cc service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:44.236354 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87b230-55d2-4e09-a8ab-863704a6e179 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:44.236647 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87b230-55d2-4e09-a8ab-863704a6e179 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:44.236927 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87b230-55d2-4e09-a8ab-863704a6e179 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:44.238683 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 807/1625] 10.222.0.27 () {54 vars in 912 bytes} [Fri Jul 15 17:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:37:44.246129 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ae722-4537-40e6-aaff-587a5d313b98 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:44.246129 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ae722-4537-40e6-aaff-587a5d313b98 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:44.246129 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ae722-4537-40e6-aaff-587a5d313b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:44.265014 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-226ae722-4537-40e6-aaff-587a5d313b98 None None] MFA Rules not processed for user `f9d548c8199e4fdbbce7597bebd63421`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:37:44.266537 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-226ae722-4537-40e6-aaff-587a5d313b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:44.344066 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3cffb-6ce3-4a66-8372-2d6d9aee2019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:44.344932 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3cffb-6ce3-4a66-8372-2d6d9aee2019 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:44.345326 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3cffb-6ce3-4a66-8372-2d6d9aee2019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:44.345717 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3cffb-6ce3-4a66-8372-2d6d9aee2019 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:44.348985 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c3cffb-6ce3-4a66-8372-2d6d9aee2019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:44.350984 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c3cffb-6ce3-4a66-8372-2d6d9aee2019 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:44.366712 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 808/1626] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Jul 15 17:37:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:37:44.367737 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226ae722-4537-40e6-aaff-587a5d313b98 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:44.375792 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 819/1627] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:37:44.380608 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3cffb-6ce3-4a66-8372-2d6d9aee2019 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:44.406654 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3cffb-6ce3-4a66-8372-2d6d9aee2019 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:44.418276 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac60d28-6660-4043-a2e8-93bc5f2fda29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:44.419376 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac60d28-6660-4043-a2e8-93bc5f2fda29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:44.419760 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac60d28-6660-4043-a2e8-93bc5f2fda29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:44.420193 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac60d28-6660-4043-a2e8-93bc5f2fda29 admin admin] PATH_INFO: `/v3/projects/6ae5f0280f88424e9e335042ef46cb2e/users/e2416d83f575448b92744496a85b4db9/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:44.424591 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac60d28-6660-4043-a2e8-93bc5f2fda29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ae5f0280f88424e9e335042ef46cb2e, user_id=e2416d83f575448b92744496a85b4db9, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:44.431299 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac60d28-6660-4043-a2e8-93bc5f2fda29 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:44.435535 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226ae722-4537-40e6-aaff-587a5d313b98 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:44.439447 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53019dfb-f8c4-42fc-a23e-77dafdfe6f76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:44.440378 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53019dfb-f8c4-42fc-a23e-77dafdfe6f76 service cinder] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:44.440654 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53019dfb-f8c4-42fc-a23e-77dafdfe6f76 service cinder] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:44.441163 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53019dfb-f8c4-42fc-a23e-77dafdfe6f76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:44.455161 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53019dfb-f8c4-42fc-a23e-77dafdfe6f76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:44.456626 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53019dfb-f8c4-42fc-a23e-77dafdfe6f76 service cinder] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:44.457833 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 820/1628] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:37:44 2022] PUT /identity/v3/projects/6ae5f0280f88424e9e335042ef46cb2e/users/e2416d83f575448b92744496a85b4db9/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:37:44.470372 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439e2ff-b7c1-421b-9129-76622dd94216 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:44.470372 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439e2ff-b7c1-421b-9129-76622dd94216 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:44.470372 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439e2ff-b7c1-421b-9129-76622dd94216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:44.490152 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 809/1629] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:37:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:37:44.525154 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-5439e2ff-b7c1-421b-9129-76622dd94216 None None] MFA Rules not processed for user `e2416d83f575448b92744496a85b4db9`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:37:44.526544 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5439e2ff-b7c1-421b-9129-76622dd94216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:44.601548 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:37:44.691251 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 821/1630] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:37:44 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:37:45.011939 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53019dfb-f8c4-42fc-a23e-77dafdfe6f76 service cinder] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:45.022215 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53019dfb-f8c4-42fc-a23e-77dafdfe6f76 service cinder] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:45.141035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab72d81-1424-419e-9d90-c552936504ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:45.141921 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab72d81-1424-419e-9d90-c552936504ba service cinder] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:45.142193 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab72d81-1424-419e-9d90-c552936504ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:45.142494 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab72d81-1424-419e-9d90-c552936504ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:45.164729 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab72d81-1424-419e-9d90-c552936504ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:45.166238 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab72d81-1424-419e-9d90-c552936504ba service cinder] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:45.178347 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:37:45.197112 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 810/1631] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:37:45 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:37:45.431656 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439e2ff-b7c1-421b-9129-76622dd94216 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:45.443399 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439e2ff-b7c1-421b-9129-76622dd94216 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:45.447497 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7159f-9bdb-4ea8-902f-490fcae50d23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:45.448219 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7159f-9bdb-4ea8-902f-490fcae50d23 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:45.448512 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7159f-9bdb-4ea8-902f-490fcae50d23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:45.448779 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7159f-9bdb-4ea8-902f-490fcae50d23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:45.570398 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7159f-9bdb-4ea8-902f-490fcae50d23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:45.572174 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7159f-9bdb-4ea8-902f-490fcae50d23 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:45.595984 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 822/1632] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:37:45 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:37:45.866818 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cf0fd-550e-40e1-815a-042080fc7b08 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:45.867415 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cf0fd-550e-40e1-815a-042080fc7b08 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:45.867849 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cf0fd-550e-40e1-815a-042080fc7b08 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:45.869592 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 811/1633] 10.222.0.27 () {54 vars in 961 bytes} [Fri Jul 15 17:37:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:37:45.879403 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098de89-8689-4ffe-8a37-f8fa6fed7dc3 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:45.879938 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098de89-8689-4ffe-8a37-f8fa6fed7dc3 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:45.880053 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098de89-8689-4ffe-8a37-f8fa6fed7dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:45.935887 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-0098de89-8689-4ffe-8a37-f8fa6fed7dc3 None None] MFA Rules not processed for user `f9d548c8199e4fdbbce7597bebd63421`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:37:45.942515 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-0098de89-8689-4ffe-8a37-f8fa6fed7dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:46.105416 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 823/1634] 10.222.0.27 () {58 vars in 1058 bytes} [Fri Jul 15 17:37:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:37:46.111604 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ee346-f8f7-4012-bde6-888ca567b6ec None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:46.112158 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ee346-f8f7-4012-bde6-888ca567b6ec None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:46.112158 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ee346-f8f7-4012-bde6-888ca567b6ec None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:46.114311 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 812/1635] 10.222.0.27 () {54 vars in 912 bytes} [Fri Jul 15 17:37:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:37:46.148387 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2cfc87-e62d-4e65-a38f-4735abc93d6c None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:46.149512 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2cfc87-e62d-4e65-a38f-4735abc93d6c None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:46.149969 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2cfc87-e62d-4e65-a38f-4735abc93d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:46.208584 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-fa2cfc87-e62d-4e65-a38f-4735abc93d6c None None] MFA Rules not processed for user `f9d548c8199e4fdbbce7597bebd63421`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:37:46.210311 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-fa2cfc87-e62d-4e65-a38f-4735abc93d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:46.225006 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 824/1636] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Jul 15 17:37:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:37:46.256202 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ee346-f8f7-4012-bde6-888ca567b6ec None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:46.293512 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ee346-f8f7-4012-bde6-888ca567b6ec None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:46.314682 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad181d7d-31f6-427c-a0fa-6afb19134f89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:46.315596 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad181d7d-31f6-427c-a0fa-6afb19134f89 service cinder] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:46.316038 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad181d7d-31f6-427c-a0fa-6afb19134f89 service cinder] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:46.316519 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad181d7d-31f6-427c-a0fa-6afb19134f89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:46.362515 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad181d7d-31f6-427c-a0fa-6afb19134f89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:46.365060 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad181d7d-31f6-427c-a0fa-6afb19134f89 service cinder] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:46.382470 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 813/1637] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:37:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:37:49.391954 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2cfc87-e62d-4e65-a38f-4735abc93d6c None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:49.496150 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:37:49.517135 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2cfc87-e62d-4e65-a38f-4735abc93d6c None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:49.523107 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5196290-2dc9-4361-9307-375ad3dc34d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:49.524350 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5196290-2dc9-4361-9307-375ad3dc34d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:49.524767 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5196290-2dc9-4361-9307-375ad3dc34d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:49.525402 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5196290-2dc9-4361-9307-375ad3dc34d2 admin admin] PATH_INFO: `/v3/users/581bfbaa1757460486b8b5c3b7afe225` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:49.526814 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5196290-2dc9-4361-9307-375ad3dc34d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=581bfbaa1757460486b8b5c3b7afe225)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:49.528458 dv-cinder-836973-11-smb devstack@keystone.service[80149]: WARNING py.warnings [None req-b5196290-2dc9-4361-9307-375ad3dc34d2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 17:37:49.528458 dv-cinder-836973-11-smb devstack@keystone.service[80149]: warnings.warn(msg) Jul 15 17:37:49.528458 dv-cinder-836973-11-smb devstack@keystone.service[80149]: Jul 15 17:37:49.530620 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5196290-2dc9-4361-9307-375ad3dc34d2 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:49.699631 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-b5196290-2dc9-4361-9307-375ad3dc34d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '581bfbaa1757460486b8b5c3b7afe225'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:37:49.701338 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-b5196290-2dc9-4361-9307-375ad3dc34d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '581bfbaa1757460486b8b5c3b7afe225'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:37:49.728864 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-b5196290-2dc9-4361-9307-375ad3dc34d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '581bfbaa1757460486b8b5c3b7afe225'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:37:49.771110 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-b5196290-2dc9-4361-9307-375ad3dc34d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '581bfbaa1757460486b8b5c3b7afe225'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:37:49.795650 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-b5196290-2dc9-4361-9307-375ad3dc34d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '581bfbaa1757460486b8b5c3b7afe225'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:37:49.806926 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 825/1638] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:37:49 2022] DELETE /identity/v3/users/581bfbaa1757460486b8b5c3b7afe225 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:37:49.808802 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e81239-296e-4add-af4e-1335974c6668 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:49.809572 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e81239-296e-4add-af4e-1335974c6668 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:49.809572 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e81239-296e-4add-af4e-1335974c6668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:49.834488 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-03e81239-296e-4add-af4e-1335974c6668 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:37:49.836459 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-03e81239-296e-4add-af4e-1335974c6668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:49.955538 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 814/1639] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:37:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:37:49.991813 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5196290-2dc9-4361-9307-375ad3dc34d2 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:49.992941 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b5196290-2dc9-4361-9307-375ad3dc34d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:50.167203 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5196290-2dc9-4361-9307-375ad3dc34d2 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:50.178625 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499dadb-bbef-487c-8e40-4275eae75f8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:50.179430 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499dadb-bbef-487c-8e40-4275eae75f8c service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:50.179802 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499dadb-bbef-487c-8e40-4275eae75f8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:50.180126 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499dadb-bbef-487c-8e40-4275eae75f8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:50.222513 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b499dadb-bbef-487c-8e40-4275eae75f8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:50.223990 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b499dadb-bbef-487c-8e40-4275eae75f8c service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:50.263259 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 826/1640] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:37:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:37:50.366469 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e81239-296e-4add-af4e-1335974c6668 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:50.368809 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-03e81239-296e-4add-af4e-1335974c6668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:50.399620 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e81239-296e-4add-af4e-1335974c6668 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:50.412074 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ec907-3d19-4b50-b1ec-f8c7c41de3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:50.413102 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ec907-3d19-4b50-b1ec-f8c7c41de3c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:50.413612 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ec907-3d19-4b50-b1ec-f8c7c41de3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:50.414007 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ec907-3d19-4b50-b1ec-f8c7c41de3c0 admin admin] PATH_INFO: `/v3/users/74d30ee6d35f4d4899e4927944a3dd93` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:50.419865 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ec907-3d19-4b50-b1ec-f8c7c41de3c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74d30ee6d35f4d4899e4927944a3dd93)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:50.422343 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ec907-3d19-4b50-b1ec-f8c7c41de3c0 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:50.538995 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-d36ec907-3d19-4b50-b1ec-f8c7c41de3c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74d30ee6d35f4d4899e4927944a3dd93'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:37:50.540006 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-d36ec907-3d19-4b50-b1ec-f8c7c41de3c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74d30ee6d35f4d4899e4927944a3dd93'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:37:50.549296 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-d36ec907-3d19-4b50-b1ec-f8c7c41de3c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74d30ee6d35f4d4899e4927944a3dd93'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:37:50.550581 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-d36ec907-3d19-4b50-b1ec-f8c7c41de3c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74d30ee6d35f4d4899e4927944a3dd93'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:37:50.591780 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-d36ec907-3d19-4b50-b1ec-f8c7c41de3c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74d30ee6d35f4d4899e4927944a3dd93'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:37:50.624326 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 815/1641] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:37:50 2022] DELETE /identity/v3/users/74d30ee6d35f4d4899e4927944a3dd93 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:37:50.629804 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e12d8-53c2-43da-8c3b-2ebebfbaadd9 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:50.632029 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e12d8-53c2-43da-8c3b-2ebebfbaadd9 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:50.632527 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e12d8-53c2-43da-8c3b-2ebebfbaadd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:50.665922 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-9f0e12d8-53c2-43da-8c3b-2ebebfbaadd9 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:37:50.667522 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-9f0e12d8-53c2-43da-8c3b-2ebebfbaadd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:50.794358 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 827/1642] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:37:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:37:50.918320 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ec907-3d19-4b50-b1ec-f8c7c41de3c0 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:50.919901 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-d36ec907-3d19-4b50-b1ec-f8c7c41de3c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:51.055051 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ec907-3d19-4b50-b1ec-f8c7c41de3c0 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:51.065477 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e775ae-cd24-4adf-9070-7f77a6283325 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:51.066452 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e775ae-cd24-4adf-9070-7f77a6283325 service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:51.066919 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e775ae-cd24-4adf-9070-7f77a6283325 service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:51.067969 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e775ae-cd24-4adf-9070-7f77a6283325 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:51.090748 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e775ae-cd24-4adf-9070-7f77a6283325 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:51.092219 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e775ae-cd24-4adf-9070-7f77a6283325 service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:51.116567 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:37:51.123598 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 816/1643] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:37:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:37:53.420814 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e12d8-53c2-43da-8c3b-2ebebfbaadd9 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:53.425125 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-9f0e12d8-53c2-43da-8c3b-2ebebfbaadd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:53.447187 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e12d8-53c2-43da-8c3b-2ebebfbaadd9 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:53.467957 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b55a64b-ccf7-4e82-8612-9cab463b946e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:53.471313 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55a64b-ccf7-4e82-8612-9cab463b946e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:53.471833 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55a64b-ccf7-4e82-8612-9cab463b946e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:53.472320 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55a64b-ccf7-4e82-8612-9cab463b946e admin admin] PATH_INFO: `/v3/projects/8df18b17572a4c84b5560cff7a6826b2` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:53.475741 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b55a64b-ccf7-4e82-8612-9cab463b946e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8df18b17572a4c84b5560cff7a6826b2)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:53.479372 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b55a64b-ccf7-4e82-8612-9cab463b946e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:53.501149 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:37:53.600671 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-4b55a64b-ccf7-4e82-8612-9cab463b946e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8df18b17572a4c84b5560cff7a6826b2', 'request_id': 'req-4b55a64b-ccf7-4e82-8612-9cab463b946e'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:37:53.630345 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-4b55a64b-ccf7-4e82-8612-9cab463b946e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8df18b17572a4c84b5560cff7a6826b2', 'request_id': 'req-4b55a64b-ccf7-4e82-8612-9cab463b946e'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:37:53.640139 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-4b55a64b-ccf7-4e82-8612-9cab463b946e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8df18b17572a4c84b5560cff7a6826b2', 'request_id': 'req-4b55a64b-ccf7-4e82-8612-9cab463b946e'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:37:53.667648 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-4b55a64b-ccf7-4e82-8612-9cab463b946e admin admin] The token cache is being invalidate because project 8df18b17572a4c84b5560cff7a6826b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:37:53.667965 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-4b55a64b-ccf7-4e82-8612-9cab463b946e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:37:53.668684 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-4b55a64b-ccf7-4e82-8612-9cab463b946e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:37:53.670678 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 828/1644] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:37:53 2022] DELETE /identity/v3/projects/8df18b17572a4c84b5560cff7a6826b2 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:37:53.674544 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e775ae-cd24-4adf-9070-7f77a6283325 service neutron] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:53.703181 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e775ae-cd24-4adf-9070-7f77a6283325 service neutron] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:53.817360 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516722c6-d71c-4bb3-be2b-67302f83a723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:53.818642 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516722c6-d71c-4bb3-be2b-67302f83a723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:53.819591 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516722c6-d71c-4bb3-be2b-67302f83a723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:53.819591 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516722c6-d71c-4bb3-be2b-67302f83a723 admin admin] PATH_INFO: `/v3/users/e2416d83f575448b92744496a85b4db9` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:53.820881 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516722c6-d71c-4bb3-be2b-67302f83a723 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2416d83f575448b92744496a85b4db9)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:53.837461 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516722c6-d71c-4bb3-be2b-67302f83a723 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:53.976624 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-516722c6-d71c-4bb3-be2b-67302f83a723 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2416d83f575448b92744496a85b4db9'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:37:53.978804 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-516722c6-d71c-4bb3-be2b-67302f83a723 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2416d83f575448b92744496a85b4db9'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:37:54.002295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-516722c6-d71c-4bb3-be2b-67302f83a723 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2416d83f575448b92744496a85b4db9'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:37:54.005374 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-516722c6-d71c-4bb3-be2b-67302f83a723 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2416d83f575448b92744496a85b4db9'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:37:54.056184 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-516722c6-d71c-4bb3-be2b-67302f83a723 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2416d83f575448b92744496a85b4db9'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:37:54.093647 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 817/1645] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:37:53 2022] DELETE /identity/v3/users/e2416d83f575448b92744496a85b4db9 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:37:54.107548 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b55a64b-ccf7-4e82-8612-9cab463b946e admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:54.109513 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-4b55a64b-ccf7-4e82-8612-9cab463b946e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:54.136725 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b55a64b-ccf7-4e82-8612-9cab463b946e admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:54.391867 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde4b3c-a38f-44c1-8924-85a1fb785bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:54.394143 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde4b3c-a38f-44c1-8924-85a1fb785bdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:54.394437 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde4b3c-a38f-44c1-8924-85a1fb785bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:54.396370 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde4b3c-a38f-44c1-8924-85a1fb785bdc admin admin] PATH_INFO: `/v3/projects/cff54f284aef4805bd552dbe43456938` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:54.401100 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde4b3c-a38f-44c1-8924-85a1fb785bdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=cff54f284aef4805bd552dbe43456938)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:54.405378 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde4b3c-a38f-44c1-8924-85a1fb785bdc admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:54.552654 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-ecde4b3c-a38f-44c1-8924-85a1fb785bdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cff54f284aef4805bd552dbe43456938', 'request_id': 'req-ecde4b3c-a38f-44c1-8924-85a1fb785bdc'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:37:54.592206 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-ecde4b3c-a38f-44c1-8924-85a1fb785bdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cff54f284aef4805bd552dbe43456938', 'request_id': 'req-ecde4b3c-a38f-44c1-8924-85a1fb785bdc'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:37:54.608603 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-ecde4b3c-a38f-44c1-8924-85a1fb785bdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cff54f284aef4805bd552dbe43456938', 'request_id': 'req-ecde4b3c-a38f-44c1-8924-85a1fb785bdc'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:37:54.651558 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-ecde4b3c-a38f-44c1-8924-85a1fb785bdc admin admin] The token cache is being invalidate because project cff54f284aef4805bd552dbe43456938 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:37:54.653933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-ecde4b3c-a38f-44c1-8924-85a1fb785bdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:37:54.656733 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-ecde4b3c-a38f-44c1-8924-85a1fb785bdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:37:54.671676 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 829/1646] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:37:54 2022] DELETE /identity/v3/projects/cff54f284aef4805bd552dbe43456938 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:37:54.676410 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338751f-e41a-4162-93e7-557d06acfeb3 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:54.677315 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338751f-e41a-4162-93e7-557d06acfeb3 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:54.677837 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338751f-e41a-4162-93e7-557d06acfeb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:54.715166 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-d338751f-e41a-4162-93e7-557d06acfeb3 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:37:54.719154 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-d338751f-e41a-4162-93e7-557d06acfeb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:54.832097 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 818/1647] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:37:54.835389 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44948adb-5902-41ec-96b6-673e4f84ad9b None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:54.836805 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44948adb-5902-41ec-96b6-673e4f84ad9b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:54.837319 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44948adb-5902-41ec-96b6-673e4f84ad9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:54.902292 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-44948adb-5902-41ec-96b6-673e4f84ad9b None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:37:54.904291 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-44948adb-5902-41ec-96b6-673e4f84ad9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:54.943707 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 830/1648] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:37:54.947942 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338751f-e41a-4162-93e7-557d06acfeb3 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:54.964797 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338751f-e41a-4162-93e7-557d06acfeb3 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:54.975828 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f69afb-89b5-4859-8876-b6845f8bc2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:54.976923 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f69afb-89b5-4859-8876-b6845f8bc2af admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:54.977336 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f69afb-89b5-4859-8876-b6845f8bc2af admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:54.977758 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f69afb-89b5-4859-8876-b6845f8bc2af admin admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:54.985663 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f69afb-89b5-4859-8876-b6845f8bc2af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:37:54.986259 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f69afb-89b5-4859-8876-b6845f8bc2af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:54.988088 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f69afb-89b5-4859-8876-b6845f8bc2af admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:55.022467 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44948adb-5902-41ec-96b6-673e4f84ad9b None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:55.023169 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 819/1649] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:37:55.037726 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44948adb-5902-41ec-96b6-673e4f84ad9b None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:55.048667 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b555f-246e-4507-8919-bc00ba68e7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:55.049684 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b555f-246e-4507-8919-bc00ba68e7b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:55.050096 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b555f-246e-4507-8919-bc00ba68e7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:55.050559 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b555f-246e-4507-8919-bc00ba68e7b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:55.051474 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9b555f-246e-4507-8919-bc00ba68e7b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:55.058743 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9b555f-246e-4507-8919-bc00ba68e7b6 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:55.123910 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:37:55.153040 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 831/1650] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:37:55 2022] POST /identity/v3/projects => generated 371 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:37:55.157027 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f69afb-89b5-4859-8876-b6845f8bc2af admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:55.189907 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f69afb-89b5-4859-8876-b6845f8bc2af admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:55.208626 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:37:55.371723 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b555f-246e-4507-8919-bc00ba68e7b6 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:55.373713 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-bc9b555f-246e-4507-8919-bc00ba68e7b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:55.455354 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca0b19-1740-4fc3-abe8-75b4502f297a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:55.459062 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca0b19-1740-4fc3-abe8-75b4502f297a admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:55.461521 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca0b19-1740-4fc3-abe8-75b4502f297a admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:55.461958 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca0b19-1740-4fc3-abe8-75b4502f297a admin admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:55.464643 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abca0b19-1740-4fc3-abe8-75b4502f297a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:55.467879 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abca0b19-1740-4fc3-abe8-75b4502f297a admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:55.549094 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 820/1651] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:37:55 2022] POST /identity/v3/users => generated 286 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:37:55.549513 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca0b19-1740-4fc3-abe8-75b4502f297a admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:55.582884 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca0b19-1740-4fc3-abe8-75b4502f297a admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:55.596799 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b555f-246e-4507-8919-bc00ba68e7b6 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:55.599525 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc8e85-6cab-4c70-97cf-904f7588b635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:55.600236 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc8e85-6cab-4c70-97cf-904f7588b635 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:55.600518 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc8e85-6cab-4c70-97cf-904f7588b635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:55.600795 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc8e85-6cab-4c70-97cf-904f7588b635 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:55.601538 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc8e85-6cab-4c70-97cf-904f7588b635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:55.604359 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc8e85-6cab-4c70-97cf-904f7588b635 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:55.610178 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f127df-a0f0-4e56-95be-abe9611db4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:55.611107 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f127df-a0f0-4e56-95be-abe9611db4da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:55.611405 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f127df-a0f0-4e56-95be-abe9611db4da admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:55.612067 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f127df-a0f0-4e56-95be-abe9611db4da admin admin] PATH_INFO: `/v3/users/4a2b73734b5748fdbfee97f7bb26e258` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:55.614435 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f127df-a0f0-4e56-95be-abe9611db4da admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a2b73734b5748fdbfee97f7bb26e258)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:55.616122 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f127df-a0f0-4e56-95be-abe9611db4da admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:55.635221 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 821/1652] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:37:55.645215 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc8e85-6cab-4c70-97cf-904f7588b635 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:55.673549 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc8e85-6cab-4c70-97cf-904f7588b635 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:55.684363 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab7e0c-2dc5-40f1-87b4-1bb364d165fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:55.685069 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab7e0c-2dc5-40f1-87b4-1bb364d165fa admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:55.685331 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab7e0c-2dc5-40f1-87b4-1bb364d165fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:55.687365 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab7e0c-2dc5-40f1-87b4-1bb364d165fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:55.689302 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bab7e0c-2dc5-40f1-87b4-1bb364d165fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:55.690988 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bab7e0c-2dc5-40f1-87b4-1bb364d165fa admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:55.710606 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 822/1653] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:37:55.711845 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab7e0c-2dc5-40f1-87b4-1bb364d165fa admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:55.734857 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab7e0c-2dc5-40f1-87b4-1bb364d165fa admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:55.738841 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-87f127df-a0f0-4e56-95be-abe9611db4da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a2b73734b5748fdbfee97f7bb26e258'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:37:55.739860 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-87f127df-a0f0-4e56-95be-abe9611db4da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a2b73734b5748fdbfee97f7bb26e258'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:37:55.750058 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-87f127df-a0f0-4e56-95be-abe9611db4da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a2b73734b5748fdbfee97f7bb26e258'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:37:55.750441 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752394a8-4a47-4110-b7d7-5150c63b2042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:55.751422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752394a8-4a47-4110-b7d7-5150c63b2042 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:55.751836 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752394a8-4a47-4110-b7d7-5150c63b2042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:55.752329 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752394a8-4a47-4110-b7d7-5150c63b2042 admin admin] PATH_INFO: `/v3/projects/cadaffec06304d9ba5ac199fab5f1e63/users/8d636cfd3c49409f8096430a211dcefc/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:55.767210 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-87f127df-a0f0-4e56-95be-abe9611db4da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a2b73734b5748fdbfee97f7bb26e258'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:37:55.776903 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-87f127df-a0f0-4e56-95be-abe9611db4da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a2b73734b5748fdbfee97f7bb26e258'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:37:55.787843 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 832/1654] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:37:55 2022] DELETE /identity/v3/users/4a2b73734b5748fdbfee97f7bb26e258 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:37:55.791379 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695e716-a88b-4061-af35-44e717b34751 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:55.791679 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695e716-a88b-4061-af35-44e717b34751 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:55.792963 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695e716-a88b-4061-af35-44e717b34751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:55.793175 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752394a8-4a47-4110-b7d7-5150c63b2042 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cadaffec06304d9ba5ac199fab5f1e63, user_id=8d636cfd3c49409f8096430a211dcefc, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:55.798775 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752394a8-4a47-4110-b7d7-5150c63b2042 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:55.820620 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-3695e716-a88b-4061-af35-44e717b34751 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:37:55.822673 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-3695e716-a88b-4061-af35-44e717b34751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:55.845164 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 823/1655] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:37:55 2022] PUT /identity/v3/projects/cadaffec06304d9ba5ac199fab5f1e63/users/8d636cfd3c49409f8096430a211dcefc/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:37:55.847557 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5ecda-99cf-41a8-bf6b-cbdf3baae239 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:55.848462 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5ecda-99cf-41a8-bf6b-cbdf3baae239 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:55.849018 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5ecda-99cf-41a8-bf6b-cbdf3baae239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:55.896892 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-22f5ecda-99cf-41a8-bf6b-cbdf3baae239 None None] MFA Rules not processed for user `8d636cfd3c49409f8096430a211dcefc`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:37:55.898581 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-22f5ecda-99cf-41a8-bf6b-cbdf3baae239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:55.967967 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 833/1656] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:37:55.998454 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 824/1657] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:37:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:37:56.000011 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695e716-a88b-4061-af35-44e717b34751 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:56.001522 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-3695e716-a88b-4061-af35-44e717b34751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:56.015390 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695e716-a88b-4061-af35-44e717b34751 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:56.033655 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:37:56.118178 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408f438-a2f6-40a7-9c93-967c8ce92e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:56.119235 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408f438-a2f6-40a7-9c93-967c8ce92e0a admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:56.119705 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408f438-a2f6-40a7-9c93-967c8ce92e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:56.121231 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f5ecda-99cf-41a8-bf6b-cbdf3baae239 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:56.122203 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408f438-a2f6-40a7-9c93-967c8ce92e0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:56.123356 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-22f5ecda-99cf-41a8-bf6b-cbdf3baae239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:56.145686 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d408f438-a2f6-40a7-9c93-967c8ce92e0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:56.157419 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d408f438-a2f6-40a7-9c93-967c8ce92e0a admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:56.226499 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 834/1658] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:37:55 2022] POST /identity/v3/projects => generated 371 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:37:56.231501 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408f438-a2f6-40a7-9c93-967c8ce92e0a admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:56.238528 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:37:56.285766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f5ecda-99cf-41a8-bf6b-cbdf3baae239 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:56.431264 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408f438-a2f6-40a7-9c93-967c8ce92e0a admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:56.443957 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d7705d-caf1-4afd-9114-69295129cfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:56.444510 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f624e4a-1d95-4ea1-80e4-f6ea3f5dc181 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:56.445548 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f624e4a-1d95-4ea1-80e4-f6ea3f5dc181 service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:56.446441 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7705d-caf1-4afd-9114-69295129cfe9 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:56.446869 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f624e4a-1d95-4ea1-80e4-f6ea3f5dc181 service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:56.447289 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f624e4a-1d95-4ea1-80e4-f6ea3f5dc181 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:56.447704 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7705d-caf1-4afd-9114-69295129cfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:56.448798 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7705d-caf1-4afd-9114-69295129cfe9 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:56.449645 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d7705d-caf1-4afd-9114-69295129cfe9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:56.454571 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d7705d-caf1-4afd-9114-69295129cfe9 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:56.473311 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f624e4a-1d95-4ea1-80e4-f6ea3f5dc181 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:56.475030 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f624e4a-1d95-4ea1-80e4-f6ea3f5dc181 service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:56.500208 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 825/1659] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:37:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 17:37:56.503417 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 835/1660] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:37:56 2022] POST /identity/v3/users => generated 292 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:37:56.507402 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d7705d-caf1-4afd-9114-69295129cfe9 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:56.532495 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d7705d-caf1-4afd-9114-69295129cfe9 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:56.537502 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa9b3b-444c-482c-80e6-bed847c257a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:56.538509 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa9b3b-444c-482c-80e6-bed847c257a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:56.538634 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa9b3b-444c-482c-80e6-bed847c257a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:56.539549 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa9b3b-444c-482c-80e6-bed847c257a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:56.539659 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aa9b3b-444c-482c-80e6-bed847c257a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:56.541209 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aa9b3b-444c-482c-80e6-bed847c257a0 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:56.560873 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 836/1661] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:37:56.566266 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f624e4a-1d95-4ea1-80e4-f6ea3f5dc181 service neutron] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:56.580963 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f624e4a-1d95-4ea1-80e4-f6ea3f5dc181 service neutron] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:56.586221 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb54fe8-b86e-4689-ac2e-f770e15aef61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:56.587367 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb54fe8-b86e-4689-ac2e-f770e15aef61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:56.587832 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb54fe8-b86e-4689-ac2e-f770e15aef61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:56.588432 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb54fe8-b86e-4689-ac2e-f770e15aef61 admin admin] PATH_INFO: `/v3/projects/feb944d8ff874614af2fd7ec3e33cf08/users/eed958c0abd24a579081c69cbebfb1d1/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:56.624318 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb54fe8-b86e-4689-ac2e-f770e15aef61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=feb944d8ff874614af2fd7ec3e33cf08, user_id=eed958c0abd24a579081c69cbebfb1d1, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:56.631003 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb54fe8-b86e-4689-ac2e-f770e15aef61 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:56.671473 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 826/1662] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:37:56 2022] PUT /identity/v3/projects/feb944d8ff874614af2fd7ec3e33cf08/users/eed958c0abd24a579081c69cbebfb1d1/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:37:56.672297 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa9b3b-444c-482c-80e6-bed847c257a0 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:56.689993 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa9b3b-444c-482c-80e6-bed847c257a0 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:56.811163 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac4bf7-400e-4e05-a0f9-e08fefc0eb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:56.811868 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac4bf7-400e-4e05-a0f9-e08fefc0eb31 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:56.812413 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac4bf7-400e-4e05-a0f9-e08fefc0eb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:56.812413 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac4bf7-400e-4e05-a0f9-e08fefc0eb31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:56.813243 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac4bf7-400e-4e05-a0f9-e08fefc0eb31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:56.815032 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac4bf7-400e-4e05-a0f9-e08fefc0eb31 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:56.840150 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb54fe8-b86e-4689-ac2e-f770e15aef61 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:56.851109 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 837/1663] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:37:56.852354 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb54fe8-b86e-4689-ac2e-f770e15aef61 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:56.861399 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9724f1b-d66f-429d-a0a4-dab1f696d8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:56.862379 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9724f1b-d66f-429d-a0a4-dab1f696d8dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:56.862660 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9724f1b-d66f-429d-a0a4-dab1f696d8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:56.862937 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9724f1b-d66f-429d-a0a4-dab1f696d8dc admin admin] PATH_INFO: `/v3/projects/feb944d8ff874614af2fd7ec3e33cf08/users/eed958c0abd24a579081c69cbebfb1d1/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:56.865947 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9724f1b-d66f-429d-a0a4-dab1f696d8dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=feb944d8ff874614af2fd7ec3e33cf08, user_id=eed958c0abd24a579081c69cbebfb1d1, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:56.868804 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9724f1b-d66f-429d-a0a4-dab1f696d8dc admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:56.882649 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 827/1664] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:37:56 2022] PUT /identity/v3/projects/feb944d8ff874614af2fd7ec3e33cf08/users/eed958c0abd24a579081c69cbebfb1d1/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:37:56.895046 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce6f97-8ce3-40ff-9ea2-752e337270f8 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:56.895576 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce6f97-8ce3-40ff-9ea2-752e337270f8 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:56.896085 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce6f97-8ce3-40ff-9ea2-752e337270f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:56.953367 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-30ce6f97-8ce3-40ff-9ea2-752e337270f8 None None] MFA Rules not processed for user `eed958c0abd24a579081c69cbebfb1d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:37:56.955020 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-30ce6f97-8ce3-40ff-9ea2-752e337270f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:56.961849 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:37:57.045497 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3880e-64f3-487e-8938-6cfcf78ac0ec None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:57.046024 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3880e-64f3-487e-8938-6cfcf78ac0ec None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:57.046495 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3880e-64f3-487e-8938-6cfcf78ac0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:57.092470 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 838/1665] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:37:56 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:37:57.105012 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce6f97-8ce3-40ff-9ea2-752e337270f8 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:57.106683 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-30ce6f97-8ce3-40ff-9ea2-752e337270f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:57.114202 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-55b3880e-64f3-487e-8938-6cfcf78ac0ec None None] MFA Rules not processed for user `c74dd7359f33431baa46ef7e2a84024a`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:37:57.115678 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-55b3880e-64f3-487e-8938-6cfcf78ac0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:57.266523 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce6f97-8ce3-40ff-9ea2-752e337270f8 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:57.287325 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3cccf-080a-4e63-be69-2ae5960a268e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:57.288222 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3cccf-080a-4e63-be69-2ae5960a268e service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:57.288646 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3cccf-080a-4e63-be69-2ae5960a268e service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:57.289051 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3cccf-080a-4e63-be69-2ae5960a268e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:57.318065 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e3cccf-080a-4e63-be69-2ae5960a268e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:57.319577 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e3cccf-080a-4e63-be69-2ae5960a268e service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:57.346048 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 828/1666] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:37:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:37:57.349002 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6aeb8-135d-456c-99a2-505d9bad580a None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:57.349293 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6aeb8-135d-456c-99a2-505d9bad580a None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:57.349644 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6aeb8-135d-456c-99a2-505d9bad580a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:57.357087 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 839/1667] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:37:57 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:37:57.400046 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-01c6aeb8-135d-456c-99a2-505d9bad580a None None] MFA Rules not processed for user `c74dd7359f33431baa46ef7e2a84024a`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:37:57.401362 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-01c6aeb8-135d-456c-99a2-505d9bad580a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:57.441869 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 829/1668] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:37:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:37:57.455139 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3cccf-080a-4e63-be69-2ae5960a268e service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:57.456700 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a3e3cccf-080a-4e63-be69-2ae5960a268e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:57.662053 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3cccf-080a-4e63-be69-2ae5960a268e service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:57.681737 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3172e-028a-44a6-bbed-8ae68988c9c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:57.684219 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3172e-028a-44a6-bbed-8ae68988c9c3 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:57.684682 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3172e-028a-44a6-bbed-8ae68988c9c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:57.685034 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3172e-028a-44a6-bbed-8ae68988c9c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:57.707257 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac3172e-028a-44a6-bbed-8ae68988c9c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:57.713120 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac3172e-028a-44a6-bbed-8ae68988c9c3 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:57.750256 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 840/1669] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:37:57 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:37:58.221326 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6aeb8-135d-456c-99a2-505d9bad580a None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:58.337342 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:37:58.376378 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6aeb8-135d-456c-99a2-505d9bad580a None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:58.382583 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3172e-028a-44a6-bbed-8ae68988c9c3 service nova] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:58.384938 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7ac3172e-028a-44a6-bbed-8ae68988c9c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:58.401094 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9036f2-b681-4398-896d-6dbb954e592a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:58.402454 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9036f2-b681-4398-896d-6dbb954e592a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:58.402874 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9036f2-b681-4398-896d-6dbb954e592a admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:58.403278 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9036f2-b681-4398-896d-6dbb954e592a admin admin] PATH_INFO: `/v3/users/8d636cfd3c49409f8096430a211dcefc` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:58.404832 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9036f2-b681-4398-896d-6dbb954e592a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d636cfd3c49409f8096430a211dcefc)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:58.409182 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9036f2-b681-4398-896d-6dbb954e592a admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:58.413837 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3172e-028a-44a6-bbed-8ae68988c9c3 service nova] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:58.426484 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803781b-f9ae-427b-b057-3067f1f905f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:58.428569 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803781b-f9ae-427b-b057-3067f1f905f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:58.431106 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803781b-f9ae-427b-b057-3067f1f905f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:58.431556 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803781b-f9ae-427b-b057-3067f1f905f6 admin admin] PATH_INFO: `/v3/projects/6ae5f0280f88424e9e335042ef46cb2e` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:58.437659 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e803781b-f9ae-427b-b057-3067f1f905f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ae5f0280f88424e9e335042ef46cb2e)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:58.440444 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e803781b-f9ae-427b-b057-3067f1f905f6 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:58.520230 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:37:58.528076 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-9f9036f2-b681-4398-896d-6dbb954e592a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d636cfd3c49409f8096430a211dcefc'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:37:58.530587 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-9f9036f2-b681-4398-896d-6dbb954e592a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d636cfd3c49409f8096430a211dcefc'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:37:58.557190 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-9f9036f2-b681-4398-896d-6dbb954e592a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d636cfd3c49409f8096430a211dcefc'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:37:58.559342 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-9f9036f2-b681-4398-896d-6dbb954e592a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d636cfd3c49409f8096430a211dcefc'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:37:58.571592 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e803781b-f9ae-427b-b057-3067f1f905f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ae5f0280f88424e9e335042ef46cb2e', 'request_id': 'req-e803781b-f9ae-427b-b057-3067f1f905f6'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:37:58.587405 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-9f9036f2-b681-4398-896d-6dbb954e592a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d636cfd3c49409f8096430a211dcefc'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:37:58.594822 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e803781b-f9ae-427b-b057-3067f1f905f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ae5f0280f88424e9e335042ef46cb2e', 'request_id': 'req-e803781b-f9ae-427b-b057-3067f1f905f6'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:37:58.603302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e803781b-f9ae-427b-b057-3067f1f905f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ae5f0280f88424e9e335042ef46cb2e', 'request_id': 'req-e803781b-f9ae-427b-b057-3067f1f905f6'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:37:58.625073 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 830/1670] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:37:58 2022] DELETE /identity/v3/users/8d636cfd3c49409f8096430a211dcefc => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:37:58.627812 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea52268-fa0b-4fa0-8edc-d587f2f69ef4 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:58.628395 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea52268-fa0b-4fa0-8edc-d587f2f69ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:58.628678 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea52268-fa0b-4fa0-8edc-d587f2f69ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:58.645397 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e803781b-f9ae-427b-b057-3067f1f905f6 admin admin] The token cache is being invalidate because project 6ae5f0280f88424e9e335042ef46cb2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:37:58.646690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e803781b-f9ae-427b-b057-3067f1f905f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:37:58.649079 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e803781b-f9ae-427b-b057-3067f1f905f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:37:58.654033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 841/1671] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:37:58 2022] DELETE /identity/v3/projects/6ae5f0280f88424e9e335042ef46cb2e => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:37:58.659703 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c2b37-eb3a-4d48-8dec-4b4c85443f69 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:58.660019 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-1ea52268-fa0b-4fa0-8edc-d587f2f69ef4 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:37:58.661262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-1ea52268-fa0b-4fa0-8edc-d587f2f69ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:58.661380 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c2b37-eb3a-4d48-8dec-4b4c85443f69 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:58.663595 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c2b37-eb3a-4d48-8dec-4b4c85443f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:58.712363 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-4b6c2b37-eb3a-4d48-8dec-4b4c85443f69 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:37:58.716050 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-4b6c2b37-eb3a-4d48-8dec-4b4c85443f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:58.754338 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 831/1672] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:37:58.897807 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 842/1673] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:37:58.899875 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c434b38-0f4b-45fd-a650-2ff62edb297d None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:58.900861 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c434b38-0f4b-45fd-a650-2ff62edb297d None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:58.901321 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c434b38-0f4b-45fd-a650-2ff62edb297d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:58.973063 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-7c434b38-0f4b-45fd-a650-2ff62edb297d None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:37:58.984126 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-7c434b38-0f4b-45fd-a650-2ff62edb297d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:59.038481 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 832/1674] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:37:59.039053 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c2b37-eb3a-4d48-8dec-4b4c85443f69 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:59.039392 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c434b38-0f4b-45fd-a650-2ff62edb297d None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:59.042395 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-4b6c2b37-eb3a-4d48-8dec-4b4c85443f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:59.063193 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c434b38-0f4b-45fd-a650-2ff62edb297d None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:59.078320 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad3d01-a87c-4022-8d43-d644d719fe3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:59.079019 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad3d01-a87c-4022-8d43-d644d719fe3d admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:59.079294 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad3d01-a87c-4022-8d43-d644d719fe3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:59.079641 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad3d01-a87c-4022-8d43-d644d719fe3d admin admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:59.080369 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad3d01-a87c-4022-8d43-d644d719fe3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:37:59.080670 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad3d01-a87c-4022-8d43-d644d719fe3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:59.084783 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad3d01-a87c-4022-8d43-d644d719fe3d admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:59.115521 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 833/1675] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:37:59.134646 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86819c-f5d1-4c4f-98bf-5d69ee217497 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:59.134829 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86819c-f5d1-4c4f-98bf-5d69ee217497 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:59.135111 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86819c-f5d1-4c4f-98bf-5d69ee217497 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:59.136957 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 834/1676] 10.222.0.27 () {54 vars in 912 bytes} [Fri Jul 15 17:37:59 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:37:59.137502 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86819c-f5d1-4c4f-98bf-5d69ee217497 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:59.178703 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86819c-f5d1-4c4f-98bf-5d69ee217497 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:59.190650 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e3a4f-d76a-40b4-a766-06509cd67f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:59.191340 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e3a4f-d76a-40b4-a766-06509cd67f57 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:59.191621 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e3a4f-d76a-40b4-a766-06509cd67f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:59.191891 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e3a4f-d76a-40b4-a766-06509cd67f57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:59.192596 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e3a4f-d76a-40b4-a766-06509cd67f57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:59.194536 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e3a4f-d76a-40b4-a766-06509cd67f57 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:59.261807 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 835/1677] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:37:59 2022] POST /identity/v3/projects => generated 367 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:37:59.268665 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dba80a-9666-4394-b6d1-2ba50810d3f6 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:59.268997 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dba80a-9666-4394-b6d1-2ba50810d3f6 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:59.269277 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dba80a-9666-4394-b6d1-2ba50810d3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:59.422430 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-79dba80a-9666-4394-b6d1-2ba50810d3f6 None None] MFA Rules not processed for user `989272e5e803405d87d0833d503bb572`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:37:59.424306 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-79dba80a-9666-4394-b6d1-2ba50810d3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:59.427076 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c2b37-eb3a-4d48-8dec-4b4c85443f69 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:59.440082 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:37:59.566994 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 836/1678] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Jul 15 17:37:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:37:59.569752 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dba80a-9666-4394-b6d1-2ba50810d3f6 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:59.586819 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e30153-194d-4443-8cca-4e76cd4e6c9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:59.587808 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e30153-194d-4443-8cca-4e76cd4e6c9b service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:59.588247 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e30153-194d-4443-8cca-4e76cd4e6c9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:59.588667 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e30153-194d-4443-8cca-4e76cd4e6c9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:59.661875 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:37:59.741869 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e30153-194d-4443-8cca-4e76cd4e6c9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:59.745732 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e30153-194d-4443-8cca-4e76cd4e6c9b service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:59.754823 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dba80a-9666-4394-b6d1-2ba50810d3f6 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:59.763329 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb72a91-a23a-460f-8181-4d9c37ef0b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:59.764088 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb72a91-a23a-460f-8181-4d9c37ef0b23 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:59.764367 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb72a91-a23a-460f-8181-4d9c37ef0b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:59.764635 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb72a91-a23a-460f-8181-4d9c37ef0b23 admin admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:59.765621 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb72a91-a23a-460f-8181-4d9c37ef0b23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:59.766216 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 843/1679] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:37:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 734 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:37:59.767303 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e30153-194d-4443-8cca-4e76cd4e6c9b service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:59.767567 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb72a91-a23a-460f-8181-4d9c37ef0b23 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:59.769808 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d2e30153-194d-4443-8cca-4e76cd4e6c9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:59.804748 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 837/1680] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:37:59 2022] POST /identity/v3/users => generated 284 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:37:59.810420 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb72a91-a23a-460f-8181-4d9c37ef0b23 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:37:59.812390 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-4cb72a91-a23a-460f-8181-4d9c37ef0b23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:37:59.814368 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e30153-194d-4443-8cca-4e76cd4e6c9b service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:59.822016 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beae17d-0c60-497b-99be-b2648158e911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:59.823361 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beae17d-0c60-497b-99be-b2648158e911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:59.823943 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beae17d-0c60-497b-99be-b2648158e911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:59.824359 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beae17d-0c60-497b-99be-b2648158e911 admin admin] PATH_INFO: `/v3/projects/85c233e0e33647a58a8557b7b6837c27` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:59.829731 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb72a91-a23a-460f-8181-4d9c37ef0b23 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:37:59.830232 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beae17d-0c60-497b-99be-b2648158e911 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85c233e0e33647a58a8557b7b6837c27)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:59.832955 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beae17d-0c60-497b-99be-b2648158e911 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:59.833496 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af506ae1-9385-4e49-9d59-a3e7aa8f5f4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:37:59.834211 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af506ae1-9385-4e49-9d59-a3e7aa8f5f4a service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:59.834533 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af506ae1-9385-4e49-9d59-a3e7aa8f5f4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:59.834808 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af506ae1-9385-4e49-9d59-a3e7aa8f5f4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:59.843828 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af506ae1-9385-4e49-9d59-a3e7aa8f5f4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:37:59.845392 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af506ae1-9385-4e49-9d59-a3e7aa8f5f4a service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:37:59.856816 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 838/1681] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:37:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:37:59.858306 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a61b67-fc21-4431-b4f2-6d7c39f843a4 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:37:59.858590 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a61b67-fc21-4431-b4f2-6d7c39f843a4 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:37:59.858862 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a61b67-fc21-4431-b4f2-6d7c39f843a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:37:59.902034 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-27a61b67-fc21-4431-b4f2-6d7c39f843a4 None None] MFA Rules not processed for user `0f7c910cba2b48b393805fcc4df8884a`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:37:59.906151 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-27a61b67-fc21-4431-b4f2-6d7c39f843a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:00.019097 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-2beae17d-0c60-497b-99be-b2648158e911 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85c233e0e33647a58a8557b7b6837c27', 'request_id': 'req-2beae17d-0c60-497b-99be-b2648158e911'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:00.044555 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-2beae17d-0c60-497b-99be-b2648158e911 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85c233e0e33647a58a8557b7b6837c27', 'request_id': 'req-2beae17d-0c60-497b-99be-b2648158e911'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:00.055509 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-2beae17d-0c60-497b-99be-b2648158e911 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85c233e0e33647a58a8557b7b6837c27', 'request_id': 'req-2beae17d-0c60-497b-99be-b2648158e911'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:00.055952 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 839/1682] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:37:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:00.057063 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a61b67-fc21-4431-b4f2-6d7c39f843a4 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:00.072141 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a61b67-fc21-4431-b4f2-6d7c39f843a4 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:00.089297 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-2beae17d-0c60-497b-99be-b2648158e911 admin admin] The token cache is being invalidate because project 85c233e0e33647a58a8557b7b6837c27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:38:00.089592 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-2beae17d-0c60-497b-99be-b2648158e911 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:00.096267 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-2beae17d-0c60-497b-99be-b2648158e911 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:00.103044 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 844/1683] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:37:59 2022] DELETE /identity/v3/projects/85c233e0e33647a58a8557b7b6837c27 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:00.104283 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beae17d-0c60-497b-99be-b2648158e911 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:00.115037 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:00.117397 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-2beae17d-0c60-497b-99be-b2648158e911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:00.179455 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1022e124-2304-4eb5-ac15-1d04921a23cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:00.181979 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022e124-2304-4eb5-ac15-1d04921a23cb admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:00.183262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022e124-2304-4eb5-ac15-1d04921a23cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:00.185256 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022e124-2304-4eb5-ac15-1d04921a23cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:00.186170 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1022e124-2304-4eb5-ac15-1d04921a23cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:00.189492 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1022e124-2304-4eb5-ac15-1d04921a23cb admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:00.212326 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 840/1684] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:38:00.218224 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4203b07-4eea-43f4-815c-d43074ec6dda None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:00.219593 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4203b07-4eea-43f4-815c-d43074ec6dda None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:00.220016 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4203b07-4eea-43f4-815c-d43074ec6dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:00.251218 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-c4203b07-4eea-43f4-815c-d43074ec6dda None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:00.252736 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-c4203b07-4eea-43f4-815c-d43074ec6dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:00.265077 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 841/1685] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:00.267940 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beae17d-0c60-497b-99be-b2648158e911 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:00.272787 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4203b07-4eea-43f4-815c-d43074ec6dda None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:00.275013 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-c4203b07-4eea-43f4-815c-d43074ec6dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:00.287859 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a3e9a-abac-44ad-a12c-3bfeea61e46e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:00.288687 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a3e9a-abac-44ad-a12c-3bfeea61e46e service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:00.289318 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a3e9a-abac-44ad-a12c-3bfeea61e46e service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:00.289733 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a3e9a-abac-44ad-a12c-3bfeea61e46e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:00.293850 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4203b07-4eea-43f4-815c-d43074ec6dda None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:00.294378 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d63a3e9a-abac-44ad-a12c-3bfeea61e46e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:00.299003 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af709f-122f-43bf-b912-585ba083aa73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:00.300247 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af709f-122f-43bf-b912-585ba083aa73 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:00.300247 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af709f-122f-43bf-b912-585ba083aa73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:00.300247 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af709f-122f-43bf-b912-585ba083aa73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:00.300945 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af709f-122f-43bf-b912-585ba083aa73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:00.302760 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af709f-122f-43bf-b912-585ba083aa73 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:00.334968 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 842/1686] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:38:00.336794 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746db7e0-4d0e-4269-829d-9bee0db54ef4 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:00.337085 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746db7e0-4d0e-4269-829d-9bee0db54ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:00.337411 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746db7e0-4d0e-4269-829d-9bee0db54ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:00.365313 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-746db7e0-4d0e-4269-829d-9bee0db54ef4 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:00.367250 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-746db7e0-4d0e-4269-829d-9bee0db54ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:00.384472 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 843/1687] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:00.385567 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746db7e0-4d0e-4269-829d-9bee0db54ef4 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:00.387019 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:00.401375 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746db7e0-4d0e-4269-829d-9bee0db54ef4 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:00.407368 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ffe44-7d1a-4f0c-84a0-829964afc433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:00.408537 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ffe44-7d1a-4f0c-84a0-829964afc433 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:00.408819 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ffe44-7d1a-4f0c-84a0-829964afc433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:00.409092 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ffe44-7d1a-4f0c-84a0-829964afc433 admin admin] PATH_INFO: `/v3/projects/883debe7aba5416e8444005e966485e2/users/490f0eb8708443cfbb313d370a43c3f6/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:00.423090 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63a3e9a-abac-44ad-a12c-3bfeea61e46e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:00.424755 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63a3e9a-abac-44ad-a12c-3bfeea61e46e service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:00.431696 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ffe44-7d1a-4f0c-84a0-829964afc433 admin admin] RBAC: Authorizing `identity:create_grant(project_id=883debe7aba5416e8444005e966485e2, user_id=490f0eb8708443cfbb313d370a43c3f6, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:00.436011 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ffe44-7d1a-4f0c-84a0-829964afc433 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:00.439003 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 845/1688] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:38:00 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:38:00.439954 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a3e9a-abac-44ad-a12c-3bfeea61e46e service nova] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:00.456216 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a3e9a-abac-44ad-a12c-3bfeea61e46e service nova] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:00.470552 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6925365-8c43-454c-b1d6-3f2e5f9b8229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:00.471964 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6925365-8c43-454c-b1d6-3f2e5f9b8229 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:00.472384 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6925365-8c43-454c-b1d6-3f2e5f9b8229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:00.472784 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6925365-8c43-454c-b1d6-3f2e5f9b8229 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:00.473980 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6925365-8c43-454c-b1d6-3f2e5f9b8229 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:38:00.474446 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6925365-8c43-454c-b1d6-3f2e5f9b8229 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:00.477058 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6925365-8c43-454c-b1d6-3f2e5f9b8229 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:00.498881 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 846/1689] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:38:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:38:00.510888 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 844/1690] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:38:00 2022] PUT /identity/v3/projects/883debe7aba5416e8444005e966485e2/users/490f0eb8708443cfbb313d370a43c3f6/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:00.513903 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6925365-8c43-454c-b1d6-3f2e5f9b8229 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:00.514302 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5c77d-5a5b-4e7f-ad8b-5cc754a586af None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:00.514839 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5c77d-5a5b-4e7f-ad8b-5cc754a586af None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:00.515208 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5c77d-5a5b-4e7f-ad8b-5cc754a586af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:00.526222 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6925365-8c43-454c-b1d6-3f2e5f9b8229 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:00.564070 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-b0a5c77d-5a5b-4e7f-ad8b-5cc754a586af None None] MFA Rules not processed for user `490f0eb8708443cfbb313d370a43c3f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:00.565643 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-b0a5c77d-5a5b-4e7f-ad8b-5cc754a586af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:00.656357 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08d8a7-f98c-43fd-bce9-b8a31221c267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:00.657124 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08d8a7-f98c-43fd-bce9-b8a31221c267 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:00.657388 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08d8a7-f98c-43fd-bce9-b8a31221c267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:00.657663 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08d8a7-f98c-43fd-bce9-b8a31221c267 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:00.658451 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08d8a7-f98c-43fd-bce9-b8a31221c267 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:00.660530 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08d8a7-f98c-43fd-bce9-b8a31221c267 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:00.689443 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 845/1691] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:00 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:38:00.693945 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5c77d-5a5b-4e7f-ad8b-5cc754a586af None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:00.734841 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 847/1692] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:38:00 2022] POST /identity/v3/projects => generated 403 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:38:00.736180 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08d8a7-f98c-43fd-bce9-b8a31221c267 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:00.736906 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5c77d-5a5b-4e7f-ad8b-5cc754a586af None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:00.829300 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08d8a7-f98c-43fd-bce9-b8a31221c267 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:00.834917 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd315c85-8634-4c8d-a826-5ebf0f392d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:00.835611 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd315c85-8634-4c8d-a826-5ebf0f392d0b admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:00.835893 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd315c85-8634-4c8d-a826-5ebf0f392d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:00.836167 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd315c85-8634-4c8d-a826-5ebf0f392d0b admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:00.837723 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd315c85-8634-4c8d-a826-5ebf0f392d0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:00.839631 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd315c85-8634-4c8d-a826-5ebf0f392d0b admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:00.853531 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f9210e-e238-4fa7-8ec8-2f8eca329cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:00.855015 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9210e-e238-4fa7-8ec8-2f8eca329cfb admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:00.855513 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9210e-e238-4fa7-8ec8-2f8eca329cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:00.856039 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9210e-e238-4fa7-8ec8-2f8eca329cfb admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:00.857104 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f9210e-e238-4fa7-8ec8-2f8eca329cfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:00.861495 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f9210e-e238-4fa7-8ec8-2f8eca329cfb admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:00.875609 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 848/1693] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:38:00 2022] POST /identity/v3/users => generated 302 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:38:00.876699 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd315c85-8634-4c8d-a826-5ebf0f392d0b admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:00.879914 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:00.892832 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd315c85-8634-4c8d-a826-5ebf0f392d0b admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:00.902307 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c866c53-382b-44e6-8267-79807f64e704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:00.902966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c866c53-382b-44e6-8267-79807f64e704 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:00.903253 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c866c53-382b-44e6-8267-79807f64e704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:00.903572 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c866c53-382b-44e6-8267-79807f64e704 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:00.904472 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c866c53-382b-44e6-8267-79807f64e704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:00.907025 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c866c53-382b-44e6-8267-79807f64e704 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:00.921493 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 849/1694] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:38:00.930266 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c866c53-382b-44e6-8267-79807f64e704 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:00.931752 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 846/1695] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:38:00 2022] POST /identity/v3/projects => generated 369 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 17:38:00.938646 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f9210e-e238-4fa7-8ec8-2f8eca329cfb admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:00.955165 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c866c53-382b-44e6-8267-79807f64e704 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:01.041442 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:01.148000 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f9210e-e238-4fa7-8ec8-2f8eca329cfb admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:01.174743 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dffd5d-7a84-425a-922d-02ade4df9336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:01.175459 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dffd5d-7a84-425a-922d-02ade4df9336 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:01.175737 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dffd5d-7a84-425a-922d-02ade4df9336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:01.176006 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dffd5d-7a84-425a-922d-02ade4df9336 admin admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:01.176717 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dffd5d-7a84-425a-922d-02ade4df9336 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:01.177862 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586600a-021f-4997-84dd-a63a2e84f21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:01.178763 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586600a-021f-4997-84dd-a63a2e84f21c admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:01.178984 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586600a-021f-4997-84dd-a63a2e84f21c admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:01.179264 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586600a-021f-4997-84dd-a63a2e84f21c admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:01.179998 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0586600a-021f-4997-84dd-a63a2e84f21c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:01.181611 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0586600a-021f-4997-84dd-a63a2e84f21c admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:01.182744 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dffd5d-7a84-425a-922d-02ade4df9336 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:01.227355 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 850/1696] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 17:38:01.228524 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586600a-021f-4997-84dd-a63a2e84f21c admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:01.251006 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586600a-021f-4997-84dd-a63a2e84f21c admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:01.262968 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02790a23-d8ee-425b-b1b7-4a7d39f87270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:01.263899 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02790a23-d8ee-425b-b1b7-4a7d39f87270 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:01.264179 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02790a23-d8ee-425b-b1b7-4a7d39f87270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:01.265874 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02790a23-d8ee-425b-b1b7-4a7d39f87270 admin admin] PATH_INFO: `/v3/projects/82fde18236d94dca9cf161a6aa49d6ae/users/81067b350f5a431da87af8a86d66c246/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:01.266124 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 847/1697] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:38:00 2022] POST /identity/v3/users => generated 291 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:38:01.271488 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dffd5d-7a84-425a-922d-02ade4df9336 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:01.306690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dffd5d-7a84-425a-922d-02ade4df9336 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:01.311813 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02790a23-d8ee-425b-b1b7-4a7d39f87270 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82fde18236d94dca9cf161a6aa49d6ae, user_id=81067b350f5a431da87af8a86d66c246, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:01.314528 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02790a23-d8ee-425b-b1b7-4a7d39f87270 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:01.333751 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1709208c-ab74-4b21-baa1-3bc353970da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:01.334520 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709208c-ab74-4b21-baa1-3bc353970da8 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:01.334811 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709208c-ab74-4b21-baa1-3bc353970da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:01.335083 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709208c-ab74-4b21-baa1-3bc353970da8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:01.335825 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1709208c-ab74-4b21-baa1-3bc353970da8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:01.342534 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1709208c-ab74-4b21-baa1-3bc353970da8 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:01.345819 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 851/1698] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:38:01 2022] PUT /identity/v3/projects/82fde18236d94dca9cf161a6aa49d6ae/users/81067b350f5a431da87af8a86d66c246/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:01.347210 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e1d67-29d1-4698-a766-26b315d4653e None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:01.347495 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e1d67-29d1-4698-a766-26b315d4653e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:01.349749 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e1d67-29d1-4698-a766-26b315d4653e None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:01.353261 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 852/1699] 10.222.0.27 () {54 vars in 960 bytes} [Fri Jul 15 17:38:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:38:01.364054 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afb949-c934-4dd3-a3b2-35d92c5af642 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:01.364337 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afb949-c934-4dd3-a3b2-35d92c5af642 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:01.364614 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afb949-c934-4dd3-a3b2-35d92c5af642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:01.376284 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 848/1700] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:38:01.386848 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9f3c0-980e-4590-8e7e-76e9605577b5 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:01.388310 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9f3c0-980e-4590-8e7e-76e9605577b5 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:01.388750 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9f3c0-980e-4590-8e7e-76e9605577b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:01.426955 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-a4afb949-c934-4dd3-a3b2-35d92c5af642 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:01.431035 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a4afb949-c934-4dd3-a3b2-35d92c5af642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:01.474496 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-1da9f3c0-980e-4590-8e7e-76e9605577b5 None None] MFA Rules not processed for user `96b2105f8d29443383ed51a8fd5cec6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:01.484709 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-1da9f3c0-980e-4590-8e7e-76e9605577b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:01.614993 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 853/1701] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:01.614993 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afb949-c934-4dd3-a3b2-35d92c5af642 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:01.635366 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afb949-c934-4dd3-a3b2-35d92c5af642 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:01.650280 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab645024-b545-4560-a536-8a8312008ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:01.651220 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab645024-b545-4560-a536-8a8312008ca7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:01.651496 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab645024-b545-4560-a536-8a8312008ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:01.651909 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab645024-b545-4560-a536-8a8312008ca7 admin admin] PATH_INFO: `/v3/projects/7cfec03e70c047579d8533986a62786a/users/3c768f44ae544622aed7eb8f6ad78854/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:01.675892 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 849/1702] 10.222.0.27 () {58 vars in 1057 bytes} [Fri Jul 15 17:38:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:01.682721 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab645024-b545-4560-a536-8a8312008ca7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cfec03e70c047579d8533986a62786a, user_id=3c768f44ae544622aed7eb8f6ad78854, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:01.684689 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da9f3c0-980e-4590-8e7e-76e9605577b5 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:01.695479 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab645024-b545-4560-a536-8a8312008ca7 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:01.698553 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da9f3c0-980e-4590-8e7e-76e9605577b5 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:01.718021 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3cdae-2c96-471d-824e-e350d235e219 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96b2105f8d29443383ed51a8fd5cec6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:01.718857 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3cdae-2c96-471d-824e-e350d235e219 service placement] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:01.719136 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3cdae-2c96-471d-824e-e350d235e219 service placement] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:01.719409 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3cdae-2c96-471d-824e-e350d235e219 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:01.734249 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-92d3cdae-2c96-471d-824e-e350d235e219 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:01.738191 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 854/1703] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:38:01 2022] PUT /identity/v3/projects/7cfec03e70c047579d8533986a62786a/users/3c768f44ae544622aed7eb8f6ad78854/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:01.741910 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab645024-b545-4560-a536-8a8312008ca7 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:01.762136 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d3cdae-2c96-471d-824e-e350d235e219 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:01.768593 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d3cdae-2c96-471d-824e-e350d235e219 service placement] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:01.800018 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 850/1704] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:38:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 17:38:01.848448 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab645024-b545-4560-a536-8a8312008ca7 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:01.854290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07f189c-6b96-4b3e-a552-69377501d908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:01.855204 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f189c-6b96-4b3e-a552-69377501d908 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:01.855466 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f189c-6b96-4b3e-a552-69377501d908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:01.855925 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f189c-6b96-4b3e-a552-69377501d908 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:01.856932 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07f189c-6b96-4b3e-a552-69377501d908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:01.859120 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07f189c-6b96-4b3e-a552-69377501d908 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:01.874601 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 855/1705] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:38:01.876012 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3cdae-2c96-471d-824e-e350d235e219 service placement] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:01.887806 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3cdae-2c96-471d-824e-e350d235e219 service placement] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:01.892624 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d279bcb1-8ae4-4d8e-8501-8d50ee14d5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:01.893591 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d279bcb1-8ae4-4d8e-8501-8d50ee14d5e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:01.894053 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d279bcb1-8ae4-4d8e-8501-8d50ee14d5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:01.894333 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d279bcb1-8ae4-4d8e-8501-8d50ee14d5e6 admin admin] PATH_INFO: `/v3/projects/7cfec03e70c047579d8533986a62786a/users/3c768f44ae544622aed7eb8f6ad78854/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:01.896319 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d279bcb1-8ae4-4d8e-8501-8d50ee14d5e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cfec03e70c047579d8533986a62786a, user_id=3c768f44ae544622aed7eb8f6ad78854, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:01.899908 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d279bcb1-8ae4-4d8e-8501-8d50ee14d5e6 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:01.918426 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 851/1706] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:38:01 2022] PUT /identity/v3/projects/7cfec03e70c047579d8533986a62786a/users/3c768f44ae544622aed7eb8f6ad78854/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:01.928751 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab9ae7-eb5c-4812-8a3e-3e20f7d37736 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:01.929085 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab9ae7-eb5c-4812-8a3e-3e20f7d37736 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:01.929321 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab9ae7-eb5c-4812-8a3e-3e20f7d37736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:01.972609 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-40ab9ae7-eb5c-4812-8a3e-3e20f7d37736 None None] MFA Rules not processed for user `3c768f44ae544622aed7eb8f6ad78854`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:01.973899 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-40ab9ae7-eb5c-4812-8a3e-3e20f7d37736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:01.985763 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:02.083488 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d279bcb1-8ae4-4d8e-8501-8d50ee14d5e6 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:02.086219 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-d279bcb1-8ae4-4d8e-8501-8d50ee14d5e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:02.241631 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:02.254929 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 856/1707] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:01 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:02.254929 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab9ae7-eb5c-4812-8a3e-3e20f7d37736 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:02.259581 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-40ab9ae7-eb5c-4812-8a3e-3e20f7d37736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:02.296535 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d279bcb1-8ae4-4d8e-8501-8d50ee14d5e6 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:02.315506 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1024f-50bd-4dc7-a910-1c1289d59729 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:02.316222 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1024f-50bd-4dc7-a910-1c1289d59729 service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:02.316222 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1024f-50bd-4dc7-a910-1c1289d59729 service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:02.316451 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1024f-50bd-4dc7-a910-1c1289d59729 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:02.436889 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab9ae7-eb5c-4812-8a3e-3e20f7d37736 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:02.449377 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb2580-bde2-49d3-ba38-d5935ce3106e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:02.455744 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb2580-bde2-49d3-ba38-d5935ce3106e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:02.455744 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb2580-bde2-49d3-ba38-d5935ce3106e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:02.455744 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb2580-bde2-49d3-ba38-d5935ce3106e admin admin] PATH_INFO: `/v3/projects/cadaffec06304d9ba5ac199fab5f1e63` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:02.455744 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fb2580-bde2-49d3-ba38-d5935ce3106e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cadaffec06304d9ba5ac199fab5f1e63)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:02.464680 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fb2580-bde2-49d3-ba38-d5935ce3106e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:02.494404 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f1024f-50bd-4dc7-a910-1c1289d59729 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:02.501956 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f1024f-50bd-4dc7-a910-1c1289d59729 service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:02.526011 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 852/1708] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:38:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:38:02.530120 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1024f-50bd-4dc7-a910-1c1289d59729 service neutron] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:02.547843 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-88f1024f-50bd-4dc7-a910-1c1289d59729 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:02.630652 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-b5fb2580-bde2-49d3-ba38-d5935ce3106e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cadaffec06304d9ba5ac199fab5f1e63', 'request_id': 'req-b5fb2580-bde2-49d3-ba38-d5935ce3106e'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:02.654226 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-b5fb2580-bde2-49d3-ba38-d5935ce3106e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cadaffec06304d9ba5ac199fab5f1e63', 'request_id': 'req-b5fb2580-bde2-49d3-ba38-d5935ce3106e'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:02.662208 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-b5fb2580-bde2-49d3-ba38-d5935ce3106e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cadaffec06304d9ba5ac199fab5f1e63', 'request_id': 'req-b5fb2580-bde2-49d3-ba38-d5935ce3106e'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:02.690680 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-b5fb2580-bde2-49d3-ba38-d5935ce3106e admin admin] The token cache is being invalidate because project cadaffec06304d9ba5ac199fab5f1e63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:38:02.692304 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-b5fb2580-bde2-49d3-ba38-d5935ce3106e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:02.694128 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-b5fb2580-bde2-49d3-ba38-d5935ce3106e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:02.696202 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 857/1709] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:38:02 2022] DELETE /identity/v3/projects/cadaffec06304d9ba5ac199fab5f1e63 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:02.700844 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c868038-a486-44f3-8a61-7f5f45b5ae10 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:02.702204 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c868038-a486-44f3-8a61-7f5f45b5ae10 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:02.702661 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c868038-a486-44f3-8a61-7f5f45b5ae10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:02.751532 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1024f-50bd-4dc7-a910-1c1289d59729 service neutron] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:02.805148 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-1c868038-a486-44f3-8a61-7f5f45b5ae10 None None] MFA Rules not processed for user `9a6b1637ae344e6fa593b0aa10c003d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:02.807287 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1c868038-a486-44f3-8a61-7f5f45b5ae10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:02.859558 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:02.883985 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d85dd1-cfa6-40f4-8e8f-954843e71bf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:02.884808 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d85dd1-cfa6-40f4-8e8f-954843e71bf2 service cinder] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:02.885195 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d85dd1-cfa6-40f4-8e8f-954843e71bf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:02.885574 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d85dd1-cfa6-40f4-8e8f-954843e71bf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:02.895807 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-50d85dd1-cfa6-40f4-8e8f-954843e71bf2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:03.002479 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 858/1710] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:03.003385 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c868038-a486-44f3-8a61-7f5f45b5ae10 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:03.004752 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1c868038-a486-44f3-8a61-7f5f45b5ae10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:03.049466 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:03.076865 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d85dd1-cfa6-40f4-8e8f-954843e71bf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:03.078785 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d85dd1-cfa6-40f4-8e8f-954843e71bf2 service cinder] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:03.109466 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 853/1711] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:38:02 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:38:03.110888 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262740ec-4f48-4d32-9d69-f371eed9e8c6 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:03.111303 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262740ec-4f48-4d32-9d69-f371eed9e8c6 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:03.111602 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262740ec-4f48-4d32-9d69-f371eed9e8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:03.129304 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c868038-a486-44f3-8a61-7f5f45b5ae10 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:03.141686 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e7ac46-1452-4a46-bbe0-50dc29156c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:03.142708 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7ac46-1452-4a46-bbe0-50dc29156c50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:03.143001 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7ac46-1452-4a46-bbe0-50dc29156c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:03.143281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7ac46-1452-4a46-bbe0-50dc29156c50 admin admin] PATH_INFO: `/v3/users/eed958c0abd24a579081c69cbebfb1d1` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:03.146615 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e7ac46-1452-4a46-bbe0-50dc29156c50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eed958c0abd24a579081c69cbebfb1d1)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:03.149356 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e7ac46-1452-4a46-bbe0-50dc29156c50 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:03.151440 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-262740ec-4f48-4d32-9d69-f371eed9e8c6 None None] MFA Rules not processed for user `9a6b1637ae344e6fa593b0aa10c003d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:03.158001 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-262740ec-4f48-4d32-9d69-f371eed9e8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:03.199990 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 854/1712] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:03.200999 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262740ec-4f48-4d32-9d69-f371eed9e8c6 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:03.208231 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-262740ec-4f48-4d32-9d69-f371eed9e8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:03.241771 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262740ec-4f48-4d32-9d69-f371eed9e8c6 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:03.251810 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab4be33-3021-4ac3-97e0-3fc963982cdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:03.254307 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4be33-3021-4ac3-97e0-3fc963982cdd service cinder] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:03.254603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4be33-3021-4ac3-97e0-3fc963982cdd service cinder] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:03.255543 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4be33-3021-4ac3-97e0-3fc963982cdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:03.259935 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-8ab4be33-3021-4ac3-97e0-3fc963982cdd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:03.292142 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f6e7ac46-1452-4a46-bbe0-50dc29156c50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eed958c0abd24a579081c69cbebfb1d1'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:03.294664 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f6e7ac46-1452-4a46-bbe0-50dc29156c50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eed958c0abd24a579081c69cbebfb1d1'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:03.330672 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f6e7ac46-1452-4a46-bbe0-50dc29156c50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eed958c0abd24a579081c69cbebfb1d1'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:03.366010 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f6e7ac46-1452-4a46-bbe0-50dc29156c50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eed958c0abd24a579081c69cbebfb1d1'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:03.386896 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f6e7ac46-1452-4a46-bbe0-50dc29156c50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eed958c0abd24a579081c69cbebfb1d1'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:03.408204 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 859/1713] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:38:03 2022] DELETE /identity/v3/users/eed958c0abd24a579081c69cbebfb1d1 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:03.408204 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e7ac46-1452-4a46-bbe0-50dc29156c50 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:03.408455 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab4be33-3021-4ac3-97e0-3fc963982cdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:03.410263 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab4be33-3021-4ac3-97e0-3fc963982cdd service cinder] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:03.422413 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f6e7ac46-1452-4a46-bbe0-50dc29156c50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:03.432304 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 855/1714] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:38:03 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:38:03.518906 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:03.586328 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e7ac46-1452-4a46-bbe0-50dc29156c50 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:03.592799 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ce3a8-cbdb-4ae4-a0cb-860284d34948 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:03.594152 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ce3a8-cbdb-4ae4-a0cb-860284d34948 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:03.594499 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ce3a8-cbdb-4ae4-a0cb-860284d34948 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:03.594779 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ce3a8-cbdb-4ae4-a0cb-860284d34948 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:03.597089 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d47ce3a8-cbdb-4ae4-a0cb-860284d34948 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:03.772162 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ce3a8-cbdb-4ae4-a0cb-860284d34948 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:03.773893 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ce3a8-cbdb-4ae4-a0cb-860284d34948 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:03.813322 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 860/1715] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:38:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:38:04.421232 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a303e-8641-4f23-9c53-4cd15b186943 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:04.424746 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a303e-8641-4f23-9c53-4cd15b186943 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:04.425138 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a303e-8641-4f23-9c53-4cd15b186943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:04.524330 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-c86a303e-8641-4f23-9c53-4cd15b186943 None None] MFA Rules not processed for user `9925dde3c53843e48e59cf353a857956`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:04.525982 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-c86a303e-8641-4f23-9c53-4cd15b186943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:04.889820 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 856/1716] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:04.901746 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ce3a8-cbdb-4ae4-a0cb-860284d34948 service nova] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:04.903851 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d47ce3a8-cbdb-4ae4-a0cb-860284d34948 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:04.940739 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ce3a8-cbdb-4ae4-a0cb-860284d34948 service nova] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:04.959594 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f792e-65b1-4869-80c7-377c4ad5c115 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:04.961154 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f792e-65b1-4869-80c7-377c4ad5c115 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:04.962709 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f792e-65b1-4869-80c7-377c4ad5c115 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:04.963110 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f792e-65b1-4869-80c7-377c4ad5c115 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:04.979802 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f792e-65b1-4869-80c7-377c4ad5c115 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:04.981652 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f792e-65b1-4869-80c7-377c4ad5c115 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:05.018124 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 861/1717] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:38:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:38:05.192114 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84e663-be0f-49e0-b3bc-f2314543214b None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:05.193400 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84e663-be0f-49e0-b3bc-f2314543214b None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:05.196570 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84e663-be0f-49e0-b3bc-f2314543214b None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:05.204775 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 857/1718] 10.222.0.27 () {54 vars in 912 bytes} [Fri Jul 15 17:38:05 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:38:05.208631 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33a7ed-e86e-49a6-a8fa-c84dbb18582a None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:05.209051 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33a7ed-e86e-49a6-a8fa-c84dbb18582a None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:05.209445 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33a7ed-e86e-49a6-a8fa-c84dbb18582a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:05.249008 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-1b33a7ed-e86e-49a6-a8fa-c84dbb18582a None None] MFA Rules not processed for user `989272e5e803405d87d0833d503bb572`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:05.251603 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1b33a7ed-e86e-49a6-a8fa-c84dbb18582a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:05.519021 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 862/1719] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Jul 15 17:38:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:05.534225 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa74d33-d08e-41dd-a4c0-88803c898ac6 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:05.534757 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa74d33-d08e-41dd-a4c0-88803c898ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:05.534757 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa74d33-d08e-41dd-a4c0-88803c898ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:05.638345 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-dfa74d33-d08e-41dd-a4c0-88803c898ac6 None None] MFA Rules not processed for user `b73d09bd7c1e4753a45cfdb00cc5abe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:05.639601 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-dfa74d33-d08e-41dd-a4c0-88803c898ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:05.688985 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b33a7ed-e86e-49a6-a8fa-c84dbb18582a None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:05.690472 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1b33a7ed-e86e-49a6-a8fa-c84dbb18582a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:05.708411 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b33a7ed-e86e-49a6-a8fa-c84dbb18582a None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:05.727646 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f24e36-e044-402d-b61d-9906bebc8830 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:05.729040 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f24e36-e044-402d-b61d-9906bebc8830 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:05.729403 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f24e36-e044-402d-b61d-9906bebc8830 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:05.729865 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f24e36-e044-402d-b61d-9906bebc8830 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:05.745605 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f24e36-e044-402d-b61d-9906bebc8830 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:05.747890 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f24e36-e044-402d-b61d-9906bebc8830 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:05.767561 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 863/1720] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:38:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:38:05.807094 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:05.817452 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f24e36-e044-402d-b61d-9906bebc8830 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:05.837164 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-32f24e36-e044-402d-b61d-9906bebc8830 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:05.892776 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 858/1721] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Jul 15 17:38:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:06.149341 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf6994-78f5-41bb-a36b-8944d5f6d27a None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:06.149341 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf6994-78f5-41bb-a36b-8944d5f6d27a None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:06.149341 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf6994-78f5-41bb-a36b-8944d5f6d27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:06.157545 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f24e36-e044-402d-b61d-9906bebc8830 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:06.182309 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e3ec2-7f8e-4b4e-a343-b2da3253df67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:06.187480 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e3ec2-7f8e-4b4e-a343-b2da3253df67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:06.188293 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e3ec2-7f8e-4b4e-a343-b2da3253df67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:06.189172 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e3ec2-7f8e-4b4e-a343-b2da3253df67 admin admin] PATH_INFO: `/v3/projects/feb944d8ff874614af2fd7ec3e33cf08` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:06.193356 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e3ec2-7f8e-4b4e-a343-b2da3253df67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=feb944d8ff874614af2fd7ec3e33cf08)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:06.200626 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e3ec2-7f8e-4b4e-a343-b2da3253df67 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:06.210851 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:06.242315 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-d4cf6994-78f5-41bb-a36b-8944d5f6d27a None None] MFA Rules not processed for user `1332dc25fb5c4d5b8ed7bd0bd77243d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:06.243775 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-d4cf6994-78f5-41bb-a36b-8944d5f6d27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:06.404836 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f35e3ec2-7f8e-4b4e-a343-b2da3253df67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'feb944d8ff874614af2fd7ec3e33cf08', 'request_id': 'req-f35e3ec2-7f8e-4b4e-a343-b2da3253df67'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:06.417820 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 859/1722] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:06.418772 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf6994-78f5-41bb-a36b-8944d5f6d27a None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:06.420327 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-d4cf6994-78f5-41bb-a36b-8944d5f6d27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:06.451520 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f35e3ec2-7f8e-4b4e-a343-b2da3253df67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'feb944d8ff874614af2fd7ec3e33cf08', 'request_id': 'req-f35e3ec2-7f8e-4b4e-a343-b2da3253df67'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:06.478162 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f35e3ec2-7f8e-4b4e-a343-b2da3253df67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'feb944d8ff874614af2fd7ec3e33cf08', 'request_id': 'req-f35e3ec2-7f8e-4b4e-a343-b2da3253df67'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:06.523588 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f35e3ec2-7f8e-4b4e-a343-b2da3253df67 admin admin] The token cache is being invalidate because project feb944d8ff874614af2fd7ec3e33cf08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:38:06.524026 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f35e3ec2-7f8e-4b4e-a343-b2da3253df67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:06.528518 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f35e3ec2-7f8e-4b4e-a343-b2da3253df67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:06.538454 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 864/1723] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:38:05 2022] DELETE /identity/v3/projects/feb944d8ff874614af2fd7ec3e33cf08 => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:06.538454 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e3ec2-7f8e-4b4e-a343-b2da3253df67 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:06.542926 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f35e3ec2-7f8e-4b4e-a343-b2da3253df67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:06.734060 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf6994-78f5-41bb-a36b-8944d5f6d27a None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:06.748052 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e3ec2-7f8e-4b4e-a343-b2da3253df67 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:06.755319 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a56a7-f025-4f0e-8373-e566a8ce22e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:06.756330 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a56a7-f025-4f0e-8373-e566a8ce22e0 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:06.756788 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a56a7-f025-4f0e-8373-e566a8ce22e0 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:06.758312 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a56a7-f025-4f0e-8373-e566a8ce22e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:06.763038 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-775a56a7-f025-4f0e-8373-e566a8ce22e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:06.869685 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:06.893541 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0376832-d117-49a4-a6b1-ee65fc767010 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dea565b75784465a8ea073883261d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:06.894269 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0376832-d117-49a4-a6b1-ee65fc767010 service swift] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:06.894917 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0376832-d117-49a4-a6b1-ee65fc767010 service swift] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:06.894917 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0376832-d117-49a4-a6b1-ee65fc767010 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:06.901015 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-f0376832-d117-49a4-a6b1-ee65fc767010 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:06.918553 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775a56a7-f025-4f0e-8373-e566a8ce22e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:06.920253 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775a56a7-f025-4f0e-8373-e566a8ce22e0 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:06.945889 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 865/1724] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:38:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:38:06.946642 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856a05d-2499-48ca-9dea-0050b152441f None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:06.946939 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856a05d-2499-48ca-9dea-0050b152441f None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:06.947209 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856a05d-2499-48ca-9dea-0050b152441f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:07.025180 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-3856a05d-2499-48ca-9dea-0050b152441f None None] MFA Rules not processed for user `81067b350f5a431da87af8a86d66c246`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:07.030244 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-3856a05d-2499-48ca-9dea-0050b152441f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:07.069900 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:07.189473 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0376832-d117-49a4-a6b1-ee65fc767010 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:07.241085 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0376832-d117-49a4-a6b1-ee65fc767010 service swift] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:07.315888 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 860/1725] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Jul 15 17:38:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 897 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 17:38:07.319323 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ad789-c288-44cb-bc1a-bd533cf83748 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:07.319616 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ad789-c288-44cb-bc1a-bd533cf83748 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:07.319893 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ad789-c288-44cb-bc1a-bd533cf83748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:07.380810 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 866/1726] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:06 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:07.382254 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856a05d-2499-48ca-9dea-0050b152441f None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:07.384525 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-3856a05d-2499-48ca-9dea-0050b152441f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:07.397976 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-d11ad789-c288-44cb-bc1a-bd533cf83748 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:07.399833 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-d11ad789-c288-44cb-bc1a-bd533cf83748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:07.654236 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856a05d-2499-48ca-9dea-0050b152441f None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:07.680980 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af7953-c8ad-440a-848e-acebeaf5041a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:07.681759 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af7953-c8ad-440a-848e-acebeaf5041a admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:07.683657 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af7953-c8ad-440a-848e-acebeaf5041a admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:07.683995 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af7953-c8ad-440a-848e-acebeaf5041a admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:07.685627 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af7953-c8ad-440a-848e-acebeaf5041a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:07.691144 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af7953-c8ad-440a-848e-acebeaf5041a admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:07.691921 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 861/1727] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:07.693827 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d377ca-7f5d-49b1-82ad-ed2effaef0c9 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:07.694163 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d377ca-7f5d-49b1-82ad-ed2effaef0c9 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:07.694512 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d377ca-7f5d-49b1-82ad-ed2effaef0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:07.790283 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-f9d377ca-7f5d-49b1-82ad-ed2effaef0c9 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:07.791773 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-f9d377ca-7f5d-49b1-82ad-ed2effaef0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:07.852168 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 862/1728] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:07.878952 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d377ca-7f5d-49b1-82ad-ed2effaef0c9 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:07.886829 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 867/1729] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:38:07 2022] POST /identity/v3/projects => generated 405 bytes in 505 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:38:07.901036 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af7953-c8ad-440a-848e-acebeaf5041a admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:07.942074 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d377ca-7f5d-49b1-82ad-ed2effaef0c9 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:08.182456 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af7953-c8ad-440a-848e-acebeaf5041a admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:08.198798 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b234f3-d8c4-414c-8dcb-bb1918fd8d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:08.200473 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b234f3-d8c4-414c-8dcb-bb1918fd8d0b admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:08.200822 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b234f3-d8c4-414c-8dcb-bb1918fd8d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:08.201149 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b234f3-d8c4-414c-8dcb-bb1918fd8d0b admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:08.202604 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b234f3-d8c4-414c-8dcb-bb1918fd8d0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:08.206230 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3061e-9bc3-40f7-837a-843ee1b231a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:08.207561 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3061e-9bc3-40f7-837a-843ee1b231a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:08.208042 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3061e-9bc3-40f7-837a-843ee1b231a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:08.208572 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3061e-9bc3-40f7-837a-843ee1b231a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:08.208690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b234f3-d8c4-414c-8dcb-bb1918fd8d0b admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:08.209401 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3061e-9bc3-40f7-837a-843ee1b231a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:38:08.218170 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3061e-9bc3-40f7-837a-843ee1b231a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:08.220556 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3061e-9bc3-40f7-837a-843ee1b231a3 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:08.265449 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 868/1730] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:38:07 2022] POST /identity/v3/users => generated 309 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:38:08.273155 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b234f3-d8c4-414c-8dcb-bb1918fd8d0b admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:08.301643 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 863/1731] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:38:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 436 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:38:08.310909 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3061e-9bc3-40f7-837a-843ee1b231a3 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:08.324520 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b234f3-d8c4-414c-8dcb-bb1918fd8d0b admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:08.345448 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e0df5-dcc3-43bf-97b6-0d81e5fe4552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:08.349041 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e0df5-dcc3-43bf-97b6-0d81e5fe4552 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:08.350871 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e0df5-dcc3-43bf-97b6-0d81e5fe4552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:08.352486 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e0df5-dcc3-43bf-97b6-0d81e5fe4552 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:08.355164 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e0df5-dcc3-43bf-97b6-0d81e5fe4552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:08.363613 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3061e-9bc3-40f7-837a-843ee1b231a3 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:08.364733 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e0df5-dcc3-43bf-97b6-0d81e5fe4552 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:08.398085 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91eee4a-14cc-45e0-99be-7c4fce5a28e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:08.398835 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91eee4a-14cc-45e0-99be-7c4fce5a28e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:08.399482 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91eee4a-14cc-45e0-99be-7c4fce5a28e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:08.399482 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91eee4a-14cc-45e0-99be-7c4fce5a28e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:08.400198 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91eee4a-14cc-45e0-99be-7c4fce5a28e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:08.418648 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91eee4a-14cc-45e0-99be-7c4fce5a28e5 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:08.429813 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 869/1732] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:38:08.431271 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e0df5-dcc3-43bf-97b6-0d81e5fe4552 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:08.470016 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e0df5-dcc3-43bf-97b6-0d81e5fe4552 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:08.511753 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f12b8-3986-4f68-b0df-7289862a118e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:08.512740 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f12b8-3986-4f68-b0df-7289862a118e admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:08.513010 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f12b8-3986-4f68-b0df-7289862a118e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:08.513285 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f12b8-3986-4f68-b0df-7289862a118e admin admin] PATH_INFO: `/v3/projects/ea4a3cc0bfa94c7f933fa88cd3b23b9f/users/cedaaef55fe34192877bc89234727a87/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:08.619334 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f12b8-3986-4f68-b0df-7289862a118e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea4a3cc0bfa94c7f933fa88cd3b23b9f, user_id=cedaaef55fe34192877bc89234727a87, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:08.631609 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f12b8-3986-4f68-b0df-7289862a118e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:08.640466 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 864/1733] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:38:08 2022] POST /identity/v3/projects => generated 363 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:38:08.641521 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91eee4a-14cc-45e0-99be-7c4fce5a28e5 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:08.664894 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:08.669481 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:08.717874 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 870/1734] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:38:08 2022] PUT /identity/v3/projects/ea4a3cc0bfa94c7f933fa88cd3b23b9f/users/cedaaef55fe34192877bc89234727a87/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:08.722124 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f12b8-3986-4f68-b0df-7289862a118e admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:08.983638 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91eee4a-14cc-45e0-99be-7c4fce5a28e5 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:09.093979 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f12b8-3986-4f68-b0df-7289862a118e admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:09.113991 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c2edb-3be3-4273-8bff-a145149e3e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:09.117253 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c2edb-3be3-4273-8bff-a145149e3e3e admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:09.118836 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c2edb-3be3-4273-8bff-a145149e3e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:09.119749 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c2edb-3be3-4273-8bff-a145149e3e3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:09.122437 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474c2edb-3be3-4273-8bff-a145149e3e3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:09.136480 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474c2edb-3be3-4273-8bff-a145149e3e3e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:09.212168 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 871/1735] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 488 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:38:09.221006 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19dfdee-3528-4f62-8520-3eab31f7f0c2 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:09.221384 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19dfdee-3528-4f62-8520-3eab31f7f0c2 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:09.225017 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19dfdee-3528-4f62-8520-3eab31f7f0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:09.241507 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd91298-1542-4957-aa75-58d2ac72cda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:09.243640 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd91298-1542-4957-aa75-58d2ac72cda3 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:09.244122 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd91298-1542-4957-aa75-58d2ac72cda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:09.246234 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd91298-1542-4957-aa75-58d2ac72cda3 admin admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:09.247794 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd91298-1542-4957-aa75-58d2ac72cda3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:09.256624 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd91298-1542-4957-aa75-58d2ac72cda3 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:09.326677 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-b19dfdee-3528-4f62-8520-3eab31f7f0c2 None None] MFA Rules not processed for user `9a6b1637ae344e6fa593b0aa10c003d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:09.330995 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b19dfdee-3528-4f62-8520-3eab31f7f0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:09.350864 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 865/1736] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:38:08 2022] POST /identity/v3/users => generated 282 bytes in 710 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:38:09.356041 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd91298-1542-4957-aa75-58d2ac72cda3 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:09.402805 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd91298-1542-4957-aa75-58d2ac72cda3 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:09.439425 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f053a8-cea1-470c-ae5e-66121a2c6bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:09.441054 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f053a8-cea1-470c-ae5e-66121a2c6bbd admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:09.448507 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f053a8-cea1-470c-ae5e-66121a2c6bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:09.454357 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f053a8-cea1-470c-ae5e-66121a2c6bbd admin admin] PATH_INFO: `/v3/projects/ea4a3cc0bfa94c7f933fa88cd3b23b9f/users/cedaaef55fe34192877bc89234727a87/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:09.467724 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f053a8-cea1-470c-ae5e-66121a2c6bbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea4a3cc0bfa94c7f933fa88cd3b23b9f, user_id=cedaaef55fe34192877bc89234727a87, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:09.478317 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f053a8-cea1-470c-ae5e-66121a2c6bbd admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:09.527586 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 866/1737] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:38:09 2022] PUT /identity/v3/projects/ea4a3cc0bfa94c7f933fa88cd3b23b9f/users/cedaaef55fe34192877bc89234727a87/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:09.549088 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f053a8-cea1-470c-ae5e-66121a2c6bbd admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:09.623245 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 872/1738] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:09.624352 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19dfdee-3528-4f62-8520-3eab31f7f0c2 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:09.631941 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b19dfdee-3528-4f62-8520-3eab31f7f0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:09.688615 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19dfdee-3528-4f62-8520-3eab31f7f0c2 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:09.899979 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f053a8-cea1-470c-ae5e-66121a2c6bbd admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:09.921452 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d212e-7eaa-4ed5-b900-f9ac77e89092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:09.922467 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d212e-7eaa-4ed5-b900-f9ac77e89092 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:09.922792 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d212e-7eaa-4ed5-b900-f9ac77e89092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:09.923220 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d212e-7eaa-4ed5-b900-f9ac77e89092 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:09.924041 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58d212e-7eaa-4ed5-b900-f9ac77e89092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:09.939105 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58d212e-7eaa-4ed5-b900-f9ac77e89092 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:10.003462 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 867/1739] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 475 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:38:10.013129 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d212e-7eaa-4ed5-b900-f9ac77e89092 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:10.052419 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d212e-7eaa-4ed5-b900-f9ac77e89092 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:10.084172 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a1f17-3830-4ec0-acb8-8d126ec85248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:10.085053 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a1f17-3830-4ec0-acb8-8d126ec85248 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:10.085342 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a1f17-3830-4ec0-acb8-8d126ec85248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:10.085618 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a1f17-3830-4ec0-acb8-8d126ec85248 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:10.087776 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360a1f17-3830-4ec0-acb8-8d126ec85248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:10.089543 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360a1f17-3830-4ec0-acb8-8d126ec85248 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:10.143976 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 868/1740] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:38:10.144924 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe90352-5708-48b5-a1a2-77a5ff725086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:10.146021 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe90352-5708-48b5-a1a2-77a5ff725086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:10.148284 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe90352-5708-48b5-a1a2-77a5ff725086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:10.148846 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe90352-5708-48b5-a1a2-77a5ff725086 admin admin] PATH_INFO: `/v3/users/490f0eb8708443cfbb313d370a43c3f6` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:10.161022 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a1f17-3830-4ec0-acb8-8d126ec85248 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:10.176876 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe90352-5708-48b5-a1a2-77a5ff725086 admin admin] RBAC: Authorizing `identity:delete_user(user_id=490f0eb8708443cfbb313d370a43c3f6)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:10.181452 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe90352-5708-48b5-a1a2-77a5ff725086 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:10.208024 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a1f17-3830-4ec0-acb8-8d126ec85248 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:10.236309 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d1a0d-8105-4c5e-99b1-8bf92263fe00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:10.253081 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d1a0d-8105-4c5e-99b1-8bf92263fe00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:10.258607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d1a0d-8105-4c5e-99b1-8bf92263fe00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:10.259252 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d1a0d-8105-4c5e-99b1-8bf92263fe00 admin admin] PATH_INFO: `/v3/projects/a9063b9b87ec4b36abb0a943cea07515/users/65733dae10e6409eb3c43c14df1c9ec4/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:10.342108 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:10.359537 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d1a0d-8105-4c5e-99b1-8bf92263fe00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9063b9b87ec4b36abb0a943cea07515, user_id=65733dae10e6409eb3c43c14df1c9ec4, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:10.363782 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d1a0d-8105-4c5e-99b1-8bf92263fe00 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:10.373994 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:10.410996 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7fe90352-5708-48b5-a1a2-77a5ff725086 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '490f0eb8708443cfbb313d370a43c3f6'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:10.414313 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7fe90352-5708-48b5-a1a2-77a5ff725086 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '490f0eb8708443cfbb313d370a43c3f6'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:10.440124 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 869/1741] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:38:10 2022] PUT /identity/v3/projects/a9063b9b87ec4b36abb0a943cea07515/users/65733dae10e6409eb3c43c14df1c9ec4/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:10.441811 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41248e3d-ce79-471c-b0dd-a0552f3b3440 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:10.442127 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41248e3d-ce79-471c-b0dd-a0552f3b3440 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:10.442396 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41248e3d-ce79-471c-b0dd-a0552f3b3440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:10.468374 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7fe90352-5708-48b5-a1a2-77a5ff725086 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '490f0eb8708443cfbb313d370a43c3f6'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:10.548617 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7fe90352-5708-48b5-a1a2-77a5ff725086 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '490f0eb8708443cfbb313d370a43c3f6'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:10.575462 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-41248e3d-ce79-471c-b0dd-a0552f3b3440 None None] MFA Rules not processed for user `65733dae10e6409eb3c43c14df1c9ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:10.578026 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7fe90352-5708-48b5-a1a2-77a5ff725086 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '490f0eb8708443cfbb313d370a43c3f6'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:10.579743 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-41248e3d-ce79-471c-b0dd-a0552f3b3440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:10.612247 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 873/1742] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:38:09 2022] DELETE /identity/v3/users/490f0eb8708443cfbb313d370a43c3f6 => generated 0 bytes in 988 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:10.625582 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f20c03-4b75-4588-9818-303549f1c372 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:10.634414 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f20c03-4b75-4588-9818-303549f1c372 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:10.635204 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f20c03-4b75-4588-9818-303549f1c372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:10.737057 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-45f20c03-4b75-4588-9818-303549f1c372 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:10.739956 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-45f20c03-4b75-4588-9818-303549f1c372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:10.811341 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 870/1743] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:10 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:10.813051 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41248e3d-ce79-471c-b0dd-a0552f3b3440 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:10.815325 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-41248e3d-ce79-471c-b0dd-a0552f3b3440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:11.068575 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 874/1744] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 451 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:11.083893 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41248e3d-ce79-471c-b0dd-a0552f3b3440 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:11.089666 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099f9d5-22f3-455f-9300-abd66e3bd836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:11.090640 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099f9d5-22f3-455f-9300-abd66e3bd836 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:11.090997 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099f9d5-22f3-455f-9300-abd66e3bd836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:11.091360 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099f9d5-22f3-455f-9300-abd66e3bd836 admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:11.092513 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2099f9d5-22f3-455f-9300-abd66e3bd836 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:11.094953 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2099f9d5-22f3-455f-9300-abd66e3bd836 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:11.155968 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 871/1745] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:38:10 2022] POST /identity/v3/projects => generated 365 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:38:11.160539 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f20c03-4b75-4588-9818-303549f1c372 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:11.177694 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f20c03-4b75-4588-9818-303549f1c372 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:11.314740 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429bad2e-319b-4ca5-ad5c-ec248b515855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:11.315460 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429bad2e-319b-4ca5-ad5c-ec248b515855 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:11.316244 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429bad2e-319b-4ca5-ad5c-ec248b515855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:11.316244 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429bad2e-319b-4ca5-ad5c-ec248b515855 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:11.316799 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429bad2e-319b-4ca5-ad5c-ec248b515855 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:11.321451 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429bad2e-319b-4ca5-ad5c-ec248b515855 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:11.372042 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 875/1746] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:38:11 2022] POST /identity/v3/users => generated 289 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:38:11.377335 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099f9d5-22f3-455f-9300-abd66e3bd836 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:11.404543 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099f9d5-22f3-455f-9300-abd66e3bd836 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:11.415652 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc9a98-3bc7-4d34-ad8c-3b6b854396e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:11.416628 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc9a98-3bc7-4d34-ad8c-3b6b854396e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:11.417416 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc9a98-3bc7-4d34-ad8c-3b6b854396e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:11.417817 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc9a98-3bc7-4d34-ad8c-3b6b854396e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:11.418680 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc9a98-3bc7-4d34-ad8c-3b6b854396e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:11.425241 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc9a98-3bc7-4d34-ad8c-3b6b854396e4 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:11.431575 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429bad2e-319b-4ca5-ad5c-ec248b515855 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:11.433497 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-429bad2e-319b-4ca5-ad5c-ec248b515855 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:11.468422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 872/1747] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:38:11.474320 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc9a98-3bc7-4d34-ad8c-3b6b854396e4 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:11.509956 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc9a98-3bc7-4d34-ad8c-3b6b854396e4 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:11.537555 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284cf528-d357-4f5e-956a-1f5878f1c576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:11.538582 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284cf528-d357-4f5e-956a-1f5878f1c576 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:11.538823 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284cf528-d357-4f5e-956a-1f5878f1c576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:11.539192 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284cf528-d357-4f5e-956a-1f5878f1c576 admin admin] PATH_INFO: `/v3/projects/1cf8e15f122c4bf1b329e5702879ed69/users/524a2b4d72304263abac011ce451fc47/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:11.603813 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284cf528-d357-4f5e-956a-1f5878f1c576 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cf8e15f122c4bf1b329e5702879ed69, user_id=524a2b4d72304263abac011ce451fc47, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:11.612091 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284cf528-d357-4f5e-956a-1f5878f1c576 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:11.669836 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 873/1748] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:38:11 2022] PUT /identity/v3/projects/1cf8e15f122c4bf1b329e5702879ed69/users/524a2b4d72304263abac011ce451fc47/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:38:11.674853 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284cf528-d357-4f5e-956a-1f5878f1c576 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:11.686295 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:11.712491 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429bad2e-319b-4ca5-ad5c-ec248b515855 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:11.769048 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:11.844481 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284cf528-d357-4f5e-956a-1f5878f1c576 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:11.858566 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf3ff3-ae40-4a05-8224-b6e5df90db33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:11.859772 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf3ff3-ae40-4a05-8224-b6e5df90db33 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:11.860095 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf3ff3-ae40-4a05-8224-b6e5df90db33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:11.860337 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf3ff3-ae40-4a05-8224-b6e5df90db33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:11.861261 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf3ff3-ae40-4a05-8224-b6e5df90db33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:11.863078 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf3ff3-ae40-4a05-8224-b6e5df90db33 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:11.882689 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ef5ef-8d21-4be4-a5be-69677d0896f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:11.883469 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ef5ef-8d21-4be4-a5be-69677d0896f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:11.884089 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ef5ef-8d21-4be4-a5be-69677d0896f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:11.884187 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ef5ef-8d21-4be4-a5be-69677d0896f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:11.889113 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 874/1749] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:38:11.890593 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243c19f-0fac-4a1a-a2ca-2d1fd0561d40 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:11.890874 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243c19f-0fac-4a1a-a2ca-2d1fd0561d40 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:11.891168 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243c19f-0fac-4a1a-a2ca-2d1fd0561d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:11.908424 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046ef5ef-8d21-4be4-a5be-69677d0896f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:11.910167 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046ef5ef-8d21-4be4-a5be-69677d0896f9 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:11.936745 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 876/1750] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:38:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:38:11.937762 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ef5ef-8d21-4be4-a5be-69677d0896f9 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:11.956725 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-b243c19f-0fac-4a1a-a2ca-2d1fd0561d40 None None] MFA Rules not processed for user `989272e5e803405d87d0833d503bb572`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:11.959765 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-b243c19f-0fac-4a1a-a2ca-2d1fd0561d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:11.975342 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ef5ef-8d21-4be4-a5be-69677d0896f9 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:11.977079 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 875/1751] 10.222.0.69 () {58 vars in 1015 bytes} [Fri Jul 15 17:38:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:11.991338 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241bfc42-a2d7-40d8-9890-ae10920cf731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:11.992423 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bfc42-a2d7-40d8-9890-ae10920cf731 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:11.992949 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bfc42-a2d7-40d8-9890-ae10920cf731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:11.993234 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bfc42-a2d7-40d8-9890-ae10920cf731 admin admin] PATH_INFO: `/v3/projects/1cf8e15f122c4bf1b329e5702879ed69/users/524a2b4d72304263abac011ce451fc47/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:11.999210 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241bfc42-a2d7-40d8-9890-ae10920cf731 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cf8e15f122c4bf1b329e5702879ed69, user_id=524a2b4d72304263abac011ce451fc47, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:12.004967 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241bfc42-a2d7-40d8-9890-ae10920cf731 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:12.044302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 877/1752] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:38:11 2022] PUT /identity/v3/projects/1cf8e15f122c4bf1b329e5702879ed69/users/524a2b4d72304263abac011ce451fc47/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:12.054746 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbda6cb-f638-4dcf-866e-53006f571fdc None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:12.055196 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbda6cb-f638-4dcf-866e-53006f571fdc None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:12.055980 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbda6cb-f638-4dcf-866e-53006f571fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:12.100852 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-cdbda6cb-f638-4dcf-866e-53006f571fdc None None] MFA Rules not processed for user `524a2b4d72304263abac011ce451fc47`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:12.102261 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-cdbda6cb-f638-4dcf-866e-53006f571fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:12.127648 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241bfc42-a2d7-40d8-9890-ae10920cf731 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:12.253809 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 876/1753] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:12 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:12.266962 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbda6cb-f638-4dcf-866e-53006f571fdc None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:12.286635 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241bfc42-a2d7-40d8-9890-ae10920cf731 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:12.297587 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-cdbda6cb-f638-4dcf-866e-53006f571fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:12.299993 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec0ec6-fdca-426d-9eef-34e327c5dae0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:12.299993 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec0ec6-fdca-426d-9eef-34e327c5dae0 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:12.299993 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec0ec6-fdca-426d-9eef-34e327c5dae0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:12.299993 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec0ec6-fdca-426d-9eef-34e327c5dae0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:12.331393 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec0ec6-fdca-426d-9eef-34e327c5dae0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:12.339082 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec0ec6-fdca-426d-9eef-34e327c5dae0 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:12.377064 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 878/1754] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:38:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 17:38:12.491133 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbda6cb-f638-4dcf-866e-53006f571fdc None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:12.517238 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f9496-c60c-488e-86f8-d4c195f1f480 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:12.518571 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f9496-c60c-488e-86f8-d4c195f1f480 service cinder] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:12.519830 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f9496-c60c-488e-86f8-d4c195f1f480 service cinder] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:12.520424 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f9496-c60c-488e-86f8-d4c195f1f480 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:12.580522 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f9496-c60c-488e-86f8-d4c195f1f480 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:12.589365 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f9496-c60c-488e-86f8-d4c195f1f480 service cinder] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:12.603449 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787ea93-9425-4471-8f6a-e9051f2fa1c8 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:12.604060 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787ea93-9425-4471-8f6a-e9051f2fa1c8 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:12.604643 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787ea93-9425-4471-8f6a-e9051f2fa1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:12.666662 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-4787ea93-9425-4471-8f6a-e9051f2fa1c8 None None] MFA Rules not processed for user `0f7c910cba2b48b393805fcc4df8884a`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:12.667652 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-4787ea93-9425-4471-8f6a-e9051f2fa1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:12.669181 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 877/1755] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:38:12 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:38:12.942723 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 879/1756] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:38:12.945804 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f9496-c60c-488e-86f8-d4c195f1f480 service cinder] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:12.960032 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f9496-c60c-488e-86f8-d4c195f1f480 service cinder] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:12.967166 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229a17b-6e93-4db3-b367-7f8d3cd740a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:12.968602 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229a17b-6e93-4db3-b367-7f8d3cd740a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:12.970295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229a17b-6e93-4db3-b367-7f8d3cd740a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:12.971563 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229a17b-6e93-4db3-b367-7f8d3cd740a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:13.097523 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:13.136432 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b229a17b-6e93-4db3-b367-7f8d3cd740a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:13.139823 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b229a17b-6e93-4db3-b367-7f8d3cd740a5 service cinder] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:13.168166 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 878/1757] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:38:12 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:38:14.472428 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787ea93-9425-4471-8f6a-e9051f2fa1c8 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:14.474585 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-4787ea93-9425-4471-8f6a-e9051f2fa1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:14.576206 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:14.692531 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787ea93-9425-4471-8f6a-e9051f2fa1c8 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:14.724074 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d3d62-7147-4115-b326-2476820340d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:14.725025 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d3d62-7147-4115-b326-2476820340d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:14.727030 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d3d62-7147-4115-b326-2476820340d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:14.727315 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d3d62-7147-4115-b326-2476820340d4 admin admin] PATH_INFO: `/v3/projects/883debe7aba5416e8444005e966485e2` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:14.734514 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365d3d62-7147-4115-b326-2476820340d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=883debe7aba5416e8444005e966485e2)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:14.743741 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365d3d62-7147-4115-b326-2476820340d4 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:14.970842 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-365d3d62-7147-4115-b326-2476820340d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '883debe7aba5416e8444005e966485e2', 'request_id': 'req-365d3d62-7147-4115-b326-2476820340d4'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:14.997965 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-365d3d62-7147-4115-b326-2476820340d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '883debe7aba5416e8444005e966485e2', 'request_id': 'req-365d3d62-7147-4115-b326-2476820340d4'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:15.019223 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-365d3d62-7147-4115-b326-2476820340d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '883debe7aba5416e8444005e966485e2', 'request_id': 'req-365d3d62-7147-4115-b326-2476820340d4'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:15.052197 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-365d3d62-7147-4115-b326-2476820340d4 admin admin] The token cache is being invalidate because project 883debe7aba5416e8444005e966485e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:38:15.052499 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-365d3d62-7147-4115-b326-2476820340d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:15.058174 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-365d3d62-7147-4115-b326-2476820340d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:15.065244 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 880/1758] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:38:14 2022] DELETE /identity/v3/projects/883debe7aba5416e8444005e966485e2 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:15.069062 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229a17b-6e93-4db3-b367-7f8d3cd740a5 service cinder] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:15.092332 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229a17b-6e93-4db3-b367-7f8d3cd740a5 service cinder] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:15.353617 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157111c-fb82-4adb-8813-1100f9864f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:15.355462 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157111c-fb82-4adb-8813-1100f9864f8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:15.355742 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157111c-fb82-4adb-8813-1100f9864f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:15.356024 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157111c-fb82-4adb-8813-1100f9864f8d admin admin] PATH_INFO: `/v3/users/3c768f44ae544622aed7eb8f6ad78854` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:15.358594 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157111c-fb82-4adb-8813-1100f9864f8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c768f44ae544622aed7eb8f6ad78854)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:15.366521 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157111c-fb82-4adb-8813-1100f9864f8d admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:15.565084 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-6157111c-fb82-4adb-8813-1100f9864f8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c768f44ae544622aed7eb8f6ad78854'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:15.567251 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-6157111c-fb82-4adb-8813-1100f9864f8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c768f44ae544622aed7eb8f6ad78854'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:15.609595 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-6157111c-fb82-4adb-8813-1100f9864f8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c768f44ae544622aed7eb8f6ad78854'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:15.613180 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-6157111c-fb82-4adb-8813-1100f9864f8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c768f44ae544622aed7eb8f6ad78854'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:15.708186 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-6157111c-fb82-4adb-8813-1100f9864f8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c768f44ae544622aed7eb8f6ad78854'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:15.750279 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 879/1759] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:38:15 2022] DELETE /identity/v3/users/3c768f44ae544622aed7eb8f6ad78854 => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:17.134089 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3fa0b-cfea-4b56-b63a-244710fbf051 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:17.134817 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3fa0b-cfea-4b56-b63a-244710fbf051 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:17.134817 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3fa0b-cfea-4b56-b63a-244710fbf051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:17.249086 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-18f3fa0b-cfea-4b56-b63a-244710fbf051 None None] MFA Rules not processed for user `cedaaef55fe34192877bc89234727a87`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:17.252958 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-18f3fa0b-cfea-4b56-b63a-244710fbf051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:17.433167 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 881/1760] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:17 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:18.428267 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d54477-ba87-4c5f-9b18-26fa651f5394 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:18.428836 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d54477-ba87-4c5f-9b18-26fa651f5394 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:18.429085 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d54477-ba87-4c5f-9b18-26fa651f5394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:18.502121 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-b0d54477-ba87-4c5f-9b18-26fa651f5394 None None] MFA Rules not processed for user `9925dde3c53843e48e59cf353a857956`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:18.504156 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-b0d54477-ba87-4c5f-9b18-26fa651f5394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:18.568073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f3fa0b-cfea-4b56-b63a-244710fbf051 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:18.570619 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-18f3fa0b-cfea-4b56-b63a-244710fbf051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:18.717737 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 880/1761] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:18.837820 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:18.852770 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f3fa0b-cfea-4b56-b63a-244710fbf051 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:18.864637 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349d639-ebba-4e11-9faf-5765a35c75ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:18.868554 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349d639-ebba-4e11-9faf-5765a35c75ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:18.868882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349d639-ebba-4e11-9faf-5765a35c75ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:18.869153 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349d639-ebba-4e11-9faf-5765a35c75ad admin admin] PATH_INFO: `/v3/projects/7cfec03e70c047579d8533986a62786a` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:18.870699 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6349d639-ebba-4e11-9faf-5765a35c75ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cfec03e70c047579d8533986a62786a)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:18.884442 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6349d639-ebba-4e11-9faf-5765a35c75ad admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:18.994918 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6349d639-ebba-4e11-9faf-5765a35c75ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cfec03e70c047579d8533986a62786a', 'request_id': 'req-6349d639-ebba-4e11-9faf-5765a35c75ad'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:19.020712 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6349d639-ebba-4e11-9faf-5765a35c75ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cfec03e70c047579d8533986a62786a', 'request_id': 'req-6349d639-ebba-4e11-9faf-5765a35c75ad'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:19.032080 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6349d639-ebba-4e11-9faf-5765a35c75ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cfec03e70c047579d8533986a62786a', 'request_id': 'req-6349d639-ebba-4e11-9faf-5765a35c75ad'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:19.080819 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6349d639-ebba-4e11-9faf-5765a35c75ad admin admin] The token cache is being invalidate because project 7cfec03e70c047579d8533986a62786a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:38:19.081102 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6349d639-ebba-4e11-9faf-5765a35c75ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:19.085621 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6349d639-ebba-4e11-9faf-5765a35c75ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:19.091547 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 882/1762] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:38:18 2022] DELETE /identity/v3/projects/7cfec03e70c047579d8533986a62786a => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:19.097003 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8b99c-3039-449c-b8ed-1072ea4ba593 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:19.097695 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8b99c-3039-449c-b8ed-1072ea4ba593 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:19.098255 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8b99c-3039-449c-b8ed-1072ea4ba593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:19.155178 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-d7a8b99c-3039-449c-b8ed-1072ea4ba593 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:19.160817 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-d7a8b99c-3039-449c-b8ed-1072ea4ba593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:19.183077 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:19.429055 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 881/1763] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:19.438725 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5215d8d-c1e7-44cb-b938-ea492c77905a None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:19.439000 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5215d8d-c1e7-44cb-b938-ea492c77905a None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:19.439273 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5215d8d-c1e7-44cb-b938-ea492c77905a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:19.491602 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-f5215d8d-c1e7-44cb-b938-ea492c77905a None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:19.491602 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f5215d8d-c1e7-44cb-b938-ea492c77905a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:19.531158 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 883/1764] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:38:19.537300 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8b99c-3039-449c-b8ed-1072ea4ba593 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:19.554462 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8b99c-3039-449c-b8ed-1072ea4ba593 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:19.601667 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e14d4d9-b541-4f63-b110-54dfd0602e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:19.602404 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14d4d9-b541-4f63-b110-54dfd0602e1a admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:19.602693 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14d4d9-b541-4f63-b110-54dfd0602e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:19.602980 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14d4d9-b541-4f63-b110-54dfd0602e1a admin admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:19.603731 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e14d4d9-b541-4f63-b110-54dfd0602e1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:38:19.604037 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e14d4d9-b541-4f63-b110-54dfd0602e1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:19.605849 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e14d4d9-b541-4f63-b110-54dfd0602e1a admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:19.660441 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5215d8d-c1e7-44cb-b938-ea492c77905a None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:19.662436 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 882/1765] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:38:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:38:19.678770 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5215d8d-c1e7-44cb-b938-ea492c77905a None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:19.707947 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8c44c-70fc-457c-95ab-7c7b99ee2713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:19.708936 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8c44c-70fc-457c-95ab-7c7b99ee2713 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:19.715439 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8c44c-70fc-457c-95ab-7c7b99ee2713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:19.724268 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8c44c-70fc-457c-95ab-7c7b99ee2713 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:19.725268 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b8c44c-70fc-457c-95ab-7c7b99ee2713 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:19.727460 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b8c44c-70fc-457c-95ab-7c7b99ee2713 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:19.834926 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 884/1766] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:38:19 2022] POST /identity/v3/projects => generated 387 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:38:19.839168 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e14d4d9-b541-4f63-b110-54dfd0602e1a admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:19.855923 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e14d4d9-b541-4f63-b110-54dfd0602e1a admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:19.872607 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0305a0f2-3491-4703-83a4-8264025b5dd4 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:19.872911 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0305a0f2-3491-4703-83a4-8264025b5dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:19.873311 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0305a0f2-3491-4703-83a4-8264025b5dd4 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:19.875302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 885/1767] 10.222.0.27 () {54 vars in 921 bytes} [Fri Jul 15 17:38:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:38:19.919300 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405e6a3-e15b-4463-8a6f-ce2ed2112857 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:19.919745 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405e6a3-e15b-4463-8a6f-ce2ed2112857 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:19.920114 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405e6a3-e15b-4463-8a6f-ce2ed2112857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:19.978921 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-d405e6a3-e15b-4463-8a6f-ce2ed2112857 None None] MFA Rules not processed for user `f9d548c8199e4fdbbce7597bebd63421`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:19.981654 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d405e6a3-e15b-4463-8a6f-ce2ed2112857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:20.046322 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20565c3f-8ed3-4d67-a06d-23be40aa8b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:20.048933 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20565c3f-8ed3-4d67-a06d-23be40aa8b55 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:20.048933 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20565c3f-8ed3-4d67-a06d-23be40aa8b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:20.048933 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20565c3f-8ed3-4d67-a06d-23be40aa8b55 admin admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:20.048933 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20565c3f-8ed3-4d67-a06d-23be40aa8b55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:20.054662 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20565c3f-8ed3-4d67-a06d-23be40aa8b55 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:20.148874 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 883/1768] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:38:19 2022] POST /identity/v3/users => generated 294 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:38:20.153367 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20565c3f-8ed3-4d67-a06d-23be40aa8b55 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:20.204621 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20565c3f-8ed3-4d67-a06d-23be40aa8b55 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:20.220884 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 886/1769] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Jul 15 17:38:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:20.225723 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f7633-8331-40ba-bf9a-b63b253e1c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:20.226462 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f7633-8331-40ba-bf9a-b63b253e1c4d admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:20.232357 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f7633-8331-40ba-bf9a-b63b253e1c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:20.233037 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f7633-8331-40ba-bf9a-b63b253e1c4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:20.233900 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f7633-8331-40ba-bf9a-b63b253e1c4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:20.241539 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f7633-8331-40ba-bf9a-b63b253e1c4d admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:20.304901 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 884/1770] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:38:20.306296 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d405e6a3-e15b-4463-8a6f-ce2ed2112857 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:20.337939 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d405e6a3-e15b-4463-8a6f-ce2ed2112857 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:20.351623 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9da2d-4573-40c1-91c5-3effae9f3db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:20.355332 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9da2d-4573-40c1-91c5-3effae9f3db7 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:20.356413 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9da2d-4573-40c1-91c5-3effae9f3db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:20.357319 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9da2d-4573-40c1-91c5-3effae9f3db7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:20.359581 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca9da2d-4573-40c1-91c5-3effae9f3db7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:20.365582 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca9da2d-4573-40c1-91c5-3effae9f3db7 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:20.395932 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 887/1771] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:38:20.397293 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f7633-8331-40ba-bf9a-b63b253e1c4d admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:20.413287 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f7633-8331-40ba-bf9a-b63b253e1c4d admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:20.455583 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2f4a1-b7c4-49dd-a67b-7774e62155f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:20.457557 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2f4a1-b7c4-49dd-a67b-7774e62155f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:20.458374 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2f4a1-b7c4-49dd-a67b-7774e62155f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:20.458905 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2f4a1-b7c4-49dd-a67b-7774e62155f9 admin admin] PATH_INFO: `/v3/projects/49fe03bd68b04eacb65b65b87a35c9e7/users/0f266d13dba14b288ca0d9a9a8014e9a/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:20.480992 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a2f4a1-b7c4-49dd-a67b-7774e62155f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49fe03bd68b04eacb65b65b87a35c9e7, user_id=0f266d13dba14b288ca0d9a9a8014e9a, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:20.486244 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a2f4a1-b7c4-49dd-a67b-7774e62155f9 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:20.536729 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 885/1772] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:38:20 2022] PUT /identity/v3/projects/49fe03bd68b04eacb65b65b87a35c9e7/users/0f266d13dba14b288ca0d9a9a8014e9a/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:20.547655 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081d388-b8bf-4328-b78d-203c79a62470 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:20.547995 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081d388-b8bf-4328-b78d-203c79a62470 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:20.548214 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081d388-b8bf-4328-b78d-203c79a62470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:20.646400 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-d081d388-b8bf-4328-b78d-203c79a62470 None None] MFA Rules not processed for user `0f266d13dba14b288ca0d9a9a8014e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:20.648510 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d081d388-b8bf-4328-b78d-203c79a62470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:20.705124 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:20.810914 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 888/1773] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:20.815730 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2f4a1-b7c4-49dd-a67b-7774e62155f9 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:20.828656 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76fc22-0fae-424a-9da7-a045a9249972 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:20.829325 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76fc22-0fae-424a-9da7-a045a9249972 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:20.829816 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76fc22-0fae-424a-9da7-a045a9249972 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:20.831730 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 889/1774] 10.222.0.27 () {54 vars in 921 bytes} [Fri Jul 15 17:38:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 17:38:20.880902 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de44b2-0f1c-4f41-822c-02e61df2b72e None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:20.881457 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de44b2-0f1c-4f41-822c-02e61df2b72e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:20.882037 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de44b2-0f1c-4f41-822c-02e61df2b72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:20.955334 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-76de44b2-0f1c-4f41-822c-02e61df2b72e None None] MFA Rules not processed for user `f9d548c8199e4fdbbce7597bebd63421`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:20.956886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-76de44b2-0f1c-4f41-822c-02e61df2b72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:21.012327 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:21.070003 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2f4a1-b7c4-49dd-a67b-7774e62155f9 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:21.091537 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f278e9-2a5d-4879-9ad8-6f9fbaf327cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:21.092266 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f278e9-2a5d-4879-9ad8-6f9fbaf327cb admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:21.092548 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f278e9-2a5d-4879-9ad8-6f9fbaf327cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:21.092823 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f278e9-2a5d-4879-9ad8-6f9fbaf327cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:21.093535 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f278e9-2a5d-4879-9ad8-6f9fbaf327cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:21.107220 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f278e9-2a5d-4879-9ad8-6f9fbaf327cb admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:21.210095 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 890/1775] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Jul 15 17:38:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 15 17:38:21.214801 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47f580-8942-48e4-a340-b8933558d783 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:21.215096 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47f580-8942-48e4-a340-b8933558d783 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:21.215377 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47f580-8942-48e4-a340-b8933558d783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:21.222058 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 886/1776] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:38:20 2022] POST /identity/v3/projects => generated 387 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:38:21.223222 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f278e9-2a5d-4879-9ad8-6f9fbaf327cb admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:21.233547 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-59f278e9-2a5d-4879-9ad8-6f9fbaf327cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:21.266481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-ff47f580-8942-48e4-a340-b8933558d783 None None] MFA Rules not processed for user `1332dc25fb5c4d5b8ed7bd0bd77243d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:21.284794 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ff47f580-8942-48e4-a340-b8933558d783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:21.515305 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f278e9-2a5d-4879-9ad8-6f9fbaf327cb admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:21.540150 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 891/1777] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:21.546102 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3dfe66-c86a-4768-ab61-c3900bb3892f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:21.546795 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3dfe66-c86a-4768-ab61-c3900bb3892f service nova] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:21.548626 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3dfe66-c86a-4768-ab61-c3900bb3892f service nova] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:21.548626 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3dfe66-c86a-4768-ab61-c3900bb3892f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:21.548836 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47f580-8942-48e4-a340-b8933558d783 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:21.577358 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3dfe66-c86a-4768-ab61-c3900bb3892f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:21.579252 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3dfe66-c86a-4768-ab61-c3900bb3892f service nova] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:21.607167 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 887/1778] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:38:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:38:21.756025 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47f580-8942-48e4-a340-b8933558d783 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:21.783716 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5282e2-eb6a-4f34-9467-bc4b9232ce68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:21.788122 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5282e2-eb6a-4f34-9467-bc4b9232ce68 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:21.790511 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5282e2-eb6a-4f34-9467-bc4b9232ce68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:21.792583 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5282e2-eb6a-4f34-9467-bc4b9232ce68 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:21.797216 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5282e2-eb6a-4f34-9467-bc4b9232ce68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:21.800427 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5282e2-eb6a-4f34-9467-bc4b9232ce68 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:21.838455 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:21.876167 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3dfe66-c86a-4768-ab61-c3900bb3892f service nova] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:21.876389 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 892/1779] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:38:21 2022] POST /identity/v3/users => generated 300 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:38:21.904704 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3dfe66-c86a-4768-ab61-c3900bb3892f service nova] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:21.941255 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade6b2c-6ca9-4395-ba46-864404dc0d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:21.942110 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade6b2c-6ca9-4395-ba46-864404dc0d79 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:21.942423 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade6b2c-6ca9-4395-ba46-864404dc0d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:21.942715 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade6b2c-6ca9-4395-ba46-864404dc0d79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:21.943453 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eade6b2c-6ca9-4395-ba46-864404dc0d79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:21.945082 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eade6b2c-6ca9-4395-ba46-864404dc0d79 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:21.965714 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 888/1780] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:38:21.970445 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5282e2-eb6a-4f34-9467-bc4b9232ce68 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:21.984691 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5282e2-eb6a-4f34-9467-bc4b9232ce68 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:22.001071 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940cb1d4-94aa-4dc7-9040-78c5bd213682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:22.002007 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940cb1d4-94aa-4dc7-9040-78c5bd213682 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:22.002290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940cb1d4-94aa-4dc7-9040-78c5bd213682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:22.002561 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940cb1d4-94aa-4dc7-9040-78c5bd213682 admin admin] PATH_INFO: `/v3/projects/65f96703991142faa5648354aa18eaab/users/e4a096820ae94b2eb87c1dcb0a3ee83d/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:22.024267 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940cb1d4-94aa-4dc7-9040-78c5bd213682 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65f96703991142faa5648354aa18eaab, user_id=e4a096820ae94b2eb87c1dcb0a3ee83d, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:22.028865 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940cb1d4-94aa-4dc7-9040-78c5bd213682 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:22.069565 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 893/1781] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:38:21 2022] PUT /identity/v3/projects/65f96703991142faa5648354aa18eaab/users/e4a096820ae94b2eb87c1dcb0a3ee83d/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:22.070998 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade6b2c-6ca9-4395-ba46-864404dc0d79 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:22.092394 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade6b2c-6ca9-4395-ba46-864404dc0d79 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:22.331962 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea1983-05db-4f19-a65c-da89c0d01374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:22.335687 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea1983-05db-4f19-a65c-da89c0d01374 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:22.336223 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea1983-05db-4f19-a65c-da89c0d01374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:22.336321 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea1983-05db-4f19-a65c-da89c0d01374 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:22.338257 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea1983-05db-4f19-a65c-da89c0d01374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:22.341238 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea1983-05db-4f19-a65c-da89c0d01374 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:22.366021 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 889/1782] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:38:22.370110 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940cb1d4-94aa-4dc7-9040-78c5bd213682 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:22.392394 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940cb1d4-94aa-4dc7-9040-78c5bd213682 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:22.398292 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd37285-7434-40f3-a35d-8d9886af14b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:22.399504 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd37285-7434-40f3-a35d-8d9886af14b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:22.401245 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd37285-7434-40f3-a35d-8d9886af14b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:22.401731 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd37285-7434-40f3-a35d-8d9886af14b3 admin admin] PATH_INFO: `/v3/projects/65f96703991142faa5648354aa18eaab/users/e4a096820ae94b2eb87c1dcb0a3ee83d/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:22.408449 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd37285-7434-40f3-a35d-8d9886af14b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65f96703991142faa5648354aa18eaab, user_id=e4a096820ae94b2eb87c1dcb0a3ee83d, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:22.411650 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd37285-7434-40f3-a35d-8d9886af14b3 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:22.448216 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 894/1783] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:38:22 2022] PUT /identity/v3/projects/65f96703991142faa5648354aa18eaab/users/e4a096820ae94b2eb87c1dcb0a3ee83d/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:38:22.459578 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569ad3b-d275-4cd2-a8fa-4a1021b50dc1 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:22.459904 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569ad3b-d275-4cd2-a8fa-4a1021b50dc1 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:22.460171 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569ad3b-d275-4cd2-a8fa-4a1021b50dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:22.526916 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-a569ad3b-d275-4cd2-a8fa-4a1021b50dc1 None None] MFA Rules not processed for user `e4a096820ae94b2eb87c1dcb0a3ee83d`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:22.528171 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-a569ad3b-d275-4cd2-a8fa-4a1021b50dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:22.612386 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:22.683287 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 890/1784] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:22.701552 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd37285-7434-40f3-a35d-8d9886af14b3 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:22.703393 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1fd37285-7434-40f3-a35d-8d9886af14b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:22.784867 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd37285-7434-40f3-a35d-8d9886af14b3 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:22.790730 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c7976-5cbd-4e4f-b9f2-764c9d08a36f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:22.792252 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c7976-5cbd-4e4f-b9f2-764c9d08a36f service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:22.793335 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c7976-5cbd-4e4f-b9f2-764c9d08a36f service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:22.793854 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c7976-5cbd-4e4f-b9f2-764c9d08a36f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:22.808906 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c7976-5cbd-4e4f-b9f2-764c9d08a36f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:22.811662 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c7976-5cbd-4e4f-b9f2-764c9d08a36f service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:22.840394 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 895/1785] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:38:22 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:38:22.871904 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569ad3b-d275-4cd2-a8fa-4a1021b50dc1 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:22.947305 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c7976-5cbd-4e4f-b9f2-764c9d08a36f service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:23.026481 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569ad3b-d275-4cd2-a8fa-4a1021b50dc1 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:23.039234 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7725a-a396-4195-a366-b04e3a890aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:23.040685 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7725a-a396-4195-a366-b04e3a890aa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:23.040989 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7725a-a396-4195-a366-b04e3a890aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:23.041412 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7725a-a396-4195-a366-b04e3a890aa0 admin admin] PATH_INFO: `/v3/users/0f266d13dba14b288ca0d9a9a8014e9a` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:23.043758 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c7976-5cbd-4e4f-b9f2-764c9d08a36f service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:23.047173 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a7725a-a396-4195-a366-b04e3a890aa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f266d13dba14b288ca0d9a9a8014e9a)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:23.049662 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a7725a-a396-4195-a366-b04e3a890aa0 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:23.059259 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5d250-97bf-46a6-85a2-65e62bf998ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:23.059938 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5d250-97bf-46a6-85a2-65e62bf998ac service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:23.060273 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5d250-97bf-46a6-85a2-65e62bf998ac service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:23.060552 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5d250-97bf-46a6-85a2-65e62bf998ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:23.073110 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c5d250-97bf-46a6-85a2-65e62bf998ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:23.075619 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c5d250-97bf-46a6-85a2-65e62bf998ac service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:23.090851 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 896/1786] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:38:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:38:23.130530 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-04a7725a-a396-4195-a366-b04e3a890aa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f266d13dba14b288ca0d9a9a8014e9a'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:23.131268 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-04a7725a-a396-4195-a366-b04e3a890aa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f266d13dba14b288ca0d9a9a8014e9a'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:23.172697 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-04a7725a-a396-4195-a366-b04e3a890aa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f266d13dba14b288ca0d9a9a8014e9a'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:23.176363 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-04a7725a-a396-4195-a366-b04e3a890aa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f266d13dba14b288ca0d9a9a8014e9a'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:23.211392 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-04a7725a-a396-4195-a366-b04e3a890aa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f266d13dba14b288ca0d9a9a8014e9a'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:23.236032 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 891/1787] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:38:22 2022] DELETE /identity/v3/users/0f266d13dba14b288ca0d9a9a8014e9a => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:23.240406 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44457efa-3e31-454e-a720-087fd14ed6d5 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:23.240998 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44457efa-3e31-454e-a720-087fd14ed6d5 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:23.241714 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44457efa-3e31-454e-a720-087fd14ed6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:23.269600 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-44457efa-3e31-454e-a720-087fd14ed6d5 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:23.271083 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-44457efa-3e31-454e-a720-087fd14ed6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:23.360526 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:23.402794 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 897/1788] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:23.411415 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7725a-a396-4195-a366-b04e3a890aa0 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:23.412979 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-04a7725a-a396-4195-a366-b04e3a890aa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:23.494914 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44457efa-3e31-454e-a720-087fd14ed6d5 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:23.497348 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-44457efa-3e31-454e-a720-087fd14ed6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:23.501175 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7725a-a396-4195-a366-b04e3a890aa0 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:23.505259 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6937e8ef-efd7-49c5-9663-8a19e79aec3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:23.506199 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937e8ef-efd7-49c5-9663-8a19e79aec3b service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:23.506651 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937e8ef-efd7-49c5-9663-8a19e79aec3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:23.507356 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937e8ef-efd7-49c5-9663-8a19e79aec3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:23.516940 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:23.522869 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6937e8ef-efd7-49c5-9663-8a19e79aec3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:23.524328 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44457efa-3e31-454e-a720-087fd14ed6d5 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:23.525510 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6937e8ef-efd7-49c5-9663-8a19e79aec3b service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:23.538197 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a2a90-86d7-4660-a60a-897361f542bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:23.539582 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a2a90-86d7-4660-a60a-897361f542bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:23.539868 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a2a90-86d7-4660-a60a-897361f542bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:23.540180 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a2a90-86d7-4660-a60a-897361f542bf admin admin] PATH_INFO: `/v3/users/65733dae10e6409eb3c43c14df1c9ec4` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:23.541426 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a2a90-86d7-4660-a60a-897361f542bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=65733dae10e6409eb3c43c14df1c9ec4)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:23.557206 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 892/1789] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:38:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:38:23.560305 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a2a90-86d7-4660-a60a-897361f542bf admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:23.565302 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58beda28-9e8a-4d28-ad4a-3fc6285b10e3 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:23.565642 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58beda28-9e8a-4d28-ad4a-3fc6285b10e3 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:23.566134 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58beda28-9e8a-4d28-ad4a-3fc6285b10e3 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:23.571158 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 893/1790] 10.222.0.27 () {54 vars in 921 bytes} [Fri Jul 15 17:38:23 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:38:23.607772 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a55d4-44bf-4936-9b34-01b092159ffd None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:23.608056 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a55d4-44bf-4936-9b34-01b092159ffd None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:23.608314 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a55d4-44bf-4936-9b34-01b092159ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:23.667855 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-d06a55d4-44bf-4936-9b34-01b092159ffd None None] MFA Rules not processed for user `96b2105f8d29443383ed51a8fd5cec6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:23.680344 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-d06a55d4-44bf-4936-9b34-01b092159ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:23.701745 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0b9a2a90-86d7-4660-a60a-897361f542bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65733dae10e6409eb3c43c14df1c9ec4'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:23.703276 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0b9a2a90-86d7-4660-a60a-897361f542bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65733dae10e6409eb3c43c14df1c9ec4'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:23.725460 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0b9a2a90-86d7-4660-a60a-897361f542bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65733dae10e6409eb3c43c14df1c9ec4'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:23.780303 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0b9a2a90-86d7-4660-a60a-897361f542bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65733dae10e6409eb3c43c14df1c9ec4'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:23.798666 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0b9a2a90-86d7-4660-a60a-897361f542bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65733dae10e6409eb3c43c14df1c9ec4'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:23.809663 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 898/1791] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:38:23 2022] DELETE /identity/v3/users/65733dae10e6409eb3c43c14df1c9ec4 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:23.818493 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f86f3f-83a2-4009-8143-6ae422a95edb None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:23.818787 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f86f3f-83a2-4009-8143-6ae422a95edb None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:23.819073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f86f3f-83a2-4009-8143-6ae422a95edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:23.844418 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-f4f86f3f-83a2-4009-8143-6ae422a95edb None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:23.846510 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f4f86f3f-83a2-4009-8143-6ae422a95edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:23.885990 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 894/1792] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Jul 15 17:38:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:38:23.919740 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a55d4-44bf-4936-9b34-01b092159ffd None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:23.921188 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-d06a55d4-44bf-4936-9b34-01b092159ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:23.939903 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a55d4-44bf-4936-9b34-01b092159ffd None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:23.965282 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 899/1793] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:23.997707 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f86f3f-83a2-4009-8143-6ae422a95edb None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:23.999790 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f4f86f3f-83a2-4009-8143-6ae422a95edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:24.060741 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be798a8-92f5-4717-bc4b-57829e48c6ed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96b2105f8d29443383ed51a8fd5cec6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:24.061912 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be798a8-92f5-4717-bc4b-57829e48c6ed service placement] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:24.061912 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be798a8-92f5-4717-bc4b-57829e48c6ed service placement] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:24.062577 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be798a8-92f5-4717-bc4b-57829e48c6ed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:24.080002 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be798a8-92f5-4717-bc4b-57829e48c6ed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:24.092612 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be798a8-92f5-4717-bc4b-57829e48c6ed service placement] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:24.140553 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f86f3f-83a2-4009-8143-6ae422a95edb None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:24.145293 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d1bd2-dc84-419c-adff-5d55fe8dd255 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:24.147139 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d1bd2-dc84-419c-adff-5d55fe8dd255 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:24.147451 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d1bd2-dc84-419c-adff-5d55fe8dd255 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:24.147741 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d1bd2-dc84-419c-adff-5d55fe8dd255 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:24.149988 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 895/1794] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:38:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:38:24.165187 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865d1bd2-dc84-419c-adff-5d55fe8dd255 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:24.167580 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865d1bd2-dc84-419c-adff-5d55fe8dd255 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:24.174299 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:24.187733 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 900/1795] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:38:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:38:24.325305 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be798a8-92f5-4717-bc4b-57829e48c6ed service placement] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:24.327061 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-5be798a8-92f5-4717-bc4b-57829e48c6ed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:24.348649 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be798a8-92f5-4717-bc4b-57829e48c6ed service placement] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:24.357531 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62782c53-bc78-4c61-a87e-5747be0d04ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:24.358685 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62782c53-bc78-4c61-a87e-5747be0d04ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:24.359055 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62782c53-bc78-4c61-a87e-5747be0d04ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:24.359332 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62782c53-bc78-4c61-a87e-5747be0d04ad admin admin] PATH_INFO: `/v3/projects/49fe03bd68b04eacb65b65b87a35c9e7` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:24.360773 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62782c53-bc78-4c61-a87e-5747be0d04ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=49fe03bd68b04eacb65b65b87a35c9e7)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:24.361986 dv-cinder-836973-11-smb devstack@keystone.service[80150]: WARNING py.warnings [None req-62782c53-bc78-4c61-a87e-5747be0d04ad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 17:38:24.361986 dv-cinder-836973-11-smb devstack@keystone.service[80150]: warnings.warn(msg) Jul 15 17:38:24.361986 dv-cinder-836973-11-smb devstack@keystone.service[80150]: Jul 15 17:38:24.363301 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62782c53-bc78-4c61-a87e-5747be0d04ad admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:24.515880 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-62782c53-bc78-4c61-a87e-5747be0d04ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49fe03bd68b04eacb65b65b87a35c9e7', 'request_id': 'req-62782c53-bc78-4c61-a87e-5747be0d04ad'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:24.540447 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-62782c53-bc78-4c61-a87e-5747be0d04ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49fe03bd68b04eacb65b65b87a35c9e7', 'request_id': 'req-62782c53-bc78-4c61-a87e-5747be0d04ad'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:24.556503 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-62782c53-bc78-4c61-a87e-5747be0d04ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49fe03bd68b04eacb65b65b87a35c9e7', 'request_id': 'req-62782c53-bc78-4c61-a87e-5747be0d04ad'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:24.589099 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-62782c53-bc78-4c61-a87e-5747be0d04ad admin admin] The token cache is being invalidate because project 49fe03bd68b04eacb65b65b87a35c9e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80150) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:38:24.590318 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-62782c53-bc78-4c61-a87e-5747be0d04ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:24.591784 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-62782c53-bc78-4c61-a87e-5747be0d04ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:24.594565 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 896/1796] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:38:24 2022] DELETE /identity/v3/projects/49fe03bd68b04eacb65b65b87a35c9e7 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:24.599378 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d1bd2-dc84-419c-adff-5d55fe8dd255 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:24.618417 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d1bd2-dc84-419c-adff-5d55fe8dd255 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:24.723816 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec132f-de81-407c-bd1a-ef5151ee1ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:24.724763 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec132f-de81-407c-bd1a-ef5151ee1ad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:24.725344 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec132f-de81-407c-bd1a-ef5151ee1ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:24.725949 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec132f-de81-407c-bd1a-ef5151ee1ad1 admin admin] PATH_INFO: `/v3/users/e4a096820ae94b2eb87c1dcb0a3ee83d` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:24.727620 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bec132f-de81-407c-bd1a-ef5151ee1ad1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4a096820ae94b2eb87c1dcb0a3ee83d)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:24.730597 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bec132f-de81-407c-bd1a-ef5151ee1ad1 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:24.831115 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0bec132f-de81-407c-bd1a-ef5151ee1ad1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4a096820ae94b2eb87c1dcb0a3ee83d'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:24.831849 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0bec132f-de81-407c-bd1a-ef5151ee1ad1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4a096820ae94b2eb87c1dcb0a3ee83d'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:24.843721 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0bec132f-de81-407c-bd1a-ef5151ee1ad1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4a096820ae94b2eb87c1dcb0a3ee83d'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:24.869910 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0bec132f-de81-407c-bd1a-ef5151ee1ad1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4a096820ae94b2eb87c1dcb0a3ee83d'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:24.881727 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0bec132f-de81-407c-bd1a-ef5151ee1ad1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4a096820ae94b2eb87c1dcb0a3ee83d'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:24.891106 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 901/1797] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:38:24 2022] DELETE /identity/v3/users/e4a096820ae94b2eb87c1dcb0a3ee83d => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:25.600035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62782c53-bc78-4c61-a87e-5747be0d04ad admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:25.601664 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-62782c53-bc78-4c61-a87e-5747be0d04ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:25.613759 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:25.623953 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62782c53-bc78-4c61-a87e-5747be0d04ad admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:25.672075 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec132f-de81-407c-bd1a-ef5151ee1ad1 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:25.674325 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-0bec132f-de81-407c-bd1a-ef5151ee1ad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:25.736254 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a2cad-2e71-4ce9-a090-6238d34b57ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:25.737562 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a2cad-2e71-4ce9-a090-6238d34b57ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:25.738467 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a2cad-2e71-4ce9-a090-6238d34b57ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:25.738970 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a2cad-2e71-4ce9-a090-6238d34b57ca admin admin] PATH_INFO: `/v3/users/81067b350f5a431da87af8a86d66c246` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:25.740831 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a2cad-2e71-4ce9-a090-6238d34b57ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=81067b350f5a431da87af8a86d66c246)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:25.743460 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a2cad-2e71-4ce9-a090-6238d34b57ca admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:25.775025 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec132f-de81-407c-bd1a-ef5151ee1ad1 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:25.782521 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d63cafd-232b-43df-bd7e-ae025f350939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:25.783818 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63cafd-232b-43df-bd7e-ae025f350939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:25.784580 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63cafd-232b-43df-bd7e-ae025f350939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:25.784797 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63cafd-232b-43df-bd7e-ae025f350939 admin admin] PATH_INFO: `/v3/projects/a9063b9b87ec4b36abb0a943cea07515` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:25.786316 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d63cafd-232b-43df-bd7e-ae025f350939 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9063b9b87ec4b36abb0a943cea07515)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:25.790909 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d63cafd-232b-43df-bd7e-ae025f350939 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:25.842176 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-317a2cad-2e71-4ce9-a090-6238d34b57ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81067b350f5a431da87af8a86d66c246'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:25.842990 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-317a2cad-2e71-4ce9-a090-6238d34b57ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81067b350f5a431da87af8a86d66c246'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:25.849657 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:25.852270 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-317a2cad-2e71-4ce9-a090-6238d34b57ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81067b350f5a431da87af8a86d66c246'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:25.853700 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-317a2cad-2e71-4ce9-a090-6238d34b57ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81067b350f5a431da87af8a86d66c246'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:25.873441 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-317a2cad-2e71-4ce9-a090-6238d34b57ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81067b350f5a431da87af8a86d66c246'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:25.899744 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-3d63cafd-232b-43df-bd7e-ae025f350939 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9063b9b87ec4b36abb0a943cea07515', 'request_id': 'req-3d63cafd-232b-43df-bd7e-ae025f350939'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:25.906341 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 897/1798] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:38:25 2022] DELETE /identity/v3/users/81067b350f5a431da87af8a86d66c246 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:25.922829 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-3d63cafd-232b-43df-bd7e-ae025f350939 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9063b9b87ec4b36abb0a943cea07515', 'request_id': 'req-3d63cafd-232b-43df-bd7e-ae025f350939'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:25.933025 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-3d63cafd-232b-43df-bd7e-ae025f350939 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9063b9b87ec4b36abb0a943cea07515', 'request_id': 'req-3d63cafd-232b-43df-bd7e-ae025f350939'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:25.947577 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-3d63cafd-232b-43df-bd7e-ae025f350939 admin admin] The token cache is being invalidate because project a9063b9b87ec4b36abb0a943cea07515 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:38:25.948195 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-3d63cafd-232b-43df-bd7e-ae025f350939 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:25.948727 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-3d63cafd-232b-43df-bd7e-ae025f350939 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:25.951508 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 902/1799] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:38:25 2022] DELETE /identity/v3/projects/a9063b9b87ec4b36abb0a943cea07515 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:25.955433 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a2cad-2e71-4ce9-a090-6238d34b57ca admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:25.959700 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-317a2cad-2e71-4ce9-a090-6238d34b57ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:26.113695 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a2cad-2e71-4ce9-a090-6238d34b57ca admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:26.129063 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dacf5b0-9075-4d0c-a68e-b80d4b139fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:26.129934 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacf5b0-9075-4d0c-a68e-b80d4b139fe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:26.130238 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacf5b0-9075-4d0c-a68e-b80d4b139fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:26.134266 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacf5b0-9075-4d0c-a68e-b80d4b139fe6 admin admin] PATH_INFO: `/v3/users/524a2b4d72304263abac011ce451fc47` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:26.137237 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dacf5b0-9075-4d0c-a68e-b80d4b139fe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=524a2b4d72304263abac011ce451fc47)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:26.140882 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dacf5b0-9075-4d0c-a68e-b80d4b139fe6 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:26.179110 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:26.245937 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-9dacf5b0-9075-4d0c-a68e-b80d4b139fe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '524a2b4d72304263abac011ce451fc47'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:26.247961 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-9dacf5b0-9075-4d0c-a68e-b80d4b139fe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '524a2b4d72304263abac011ce451fc47'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:26.276730 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-9dacf5b0-9075-4d0c-a68e-b80d4b139fe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '524a2b4d72304263abac011ce451fc47'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:26.278159 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-9dacf5b0-9075-4d0c-a68e-b80d4b139fe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '524a2b4d72304263abac011ce451fc47'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:26.329854 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-9dacf5b0-9075-4d0c-a68e-b80d4b139fe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '524a2b4d72304263abac011ce451fc47'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:26.336740 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d63cafd-232b-43df-bd7e-ae025f350939 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:26.338548 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-3d63cafd-232b-43df-bd7e-ae025f350939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:26.362847 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 898/1800] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:38:25 2022] DELETE /identity/v3/users/524a2b4d72304263abac011ce451fc47 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:26.451859 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dacf5b0-9075-4d0c-a68e-b80d4b139fe6 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:26.453715 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-9dacf5b0-9075-4d0c-a68e-b80d4b139fe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:26.490764 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d63cafd-232b-43df-bd7e-ae025f350939 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:26.655628 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb3155-52fe-4d2b-b0f1-b6aa6d52a372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:26.658075 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb3155-52fe-4d2b-b0f1-b6aa6d52a372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:26.658075 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb3155-52fe-4d2b-b0f1-b6aa6d52a372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:26.658075 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb3155-52fe-4d2b-b0f1-b6aa6d52a372 admin admin] PATH_INFO: `/v3/projects/65f96703991142faa5648354aa18eaab` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:26.660192 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb3155-52fe-4d2b-b0f1-b6aa6d52a372 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65f96703991142faa5648354aa18eaab)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:26.669683 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb3155-52fe-4d2b-b0f1-b6aa6d52a372 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:26.692827 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dacf5b0-9075-4d0c-a68e-b80d4b139fe6 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:26.705693 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec2658-5814-48ea-b048-70b9f859344a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:26.706646 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec2658-5814-48ea-b048-70b9f859344a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:26.709686 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec2658-5814-48ea-b048-70b9f859344a admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:26.710092 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec2658-5814-48ea-b048-70b9f859344a admin admin] PATH_INFO: `/v3/projects/82fde18236d94dca9cf161a6aa49d6ae` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:26.714268 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec2658-5814-48ea-b048-70b9f859344a admin admin] RBAC: Authorizing `identity:delete_project(project_id=82fde18236d94dca9cf161a6aa49d6ae)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:26.719455 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec2658-5814-48ea-b048-70b9f859344a admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:26.798887 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-97fb3155-52fe-4d2b-b0f1-b6aa6d52a372 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65f96703991142faa5648354aa18eaab', 'request_id': 'req-97fb3155-52fe-4d2b-b0f1-b6aa6d52a372'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:26.813040 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-97fb3155-52fe-4d2b-b0f1-b6aa6d52a372 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65f96703991142faa5648354aa18eaab', 'request_id': 'req-97fb3155-52fe-4d2b-b0f1-b6aa6d52a372'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:26.816457 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:26.824630 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-9aec2658-5814-48ea-b048-70b9f859344a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82fde18236d94dca9cf161a6aa49d6ae', 'request_id': 'req-9aec2658-5814-48ea-b048-70b9f859344a'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:26.826372 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-97fb3155-52fe-4d2b-b0f1-b6aa6d52a372 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65f96703991142faa5648354aa18eaab', 'request_id': 'req-97fb3155-52fe-4d2b-b0f1-b6aa6d52a372'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:26.852114 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-97fb3155-52fe-4d2b-b0f1-b6aa6d52a372 admin admin] The token cache is being invalidate because project 65f96703991142faa5648354aa18eaab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:38:26.852811 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-97fb3155-52fe-4d2b-b0f1-b6aa6d52a372 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:26.852969 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-97fb3155-52fe-4d2b-b0f1-b6aa6d52a372 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:26.855420 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 903/1801] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:38:26 2022] DELETE /identity/v3/projects/65f96703991142faa5648354aa18eaab => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:38:26.858157 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb3155-52fe-4d2b-b0f1-b6aa6d52a372 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:26.860432 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-97fb3155-52fe-4d2b-b0f1-b6aa6d52a372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:26.874401 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-9aec2658-5814-48ea-b048-70b9f859344a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82fde18236d94dca9cf161a6aa49d6ae', 'request_id': 'req-9aec2658-5814-48ea-b048-70b9f859344a'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:26.885562 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-9aec2658-5814-48ea-b048-70b9f859344a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82fde18236d94dca9cf161a6aa49d6ae', 'request_id': 'req-9aec2658-5814-48ea-b048-70b9f859344a'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:26.901397 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-9aec2658-5814-48ea-b048-70b9f859344a admin admin] The token cache is being invalidate because project 82fde18236d94dca9cf161a6aa49d6ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80150) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:38:26.901843 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-9aec2658-5814-48ea-b048-70b9f859344a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:26.902559 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-9aec2658-5814-48ea-b048-70b9f859344a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:26.904897 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 899/1802] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:38:26 2022] DELETE /identity/v3/projects/82fde18236d94dca9cf161a6aa49d6ae => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:26.908003 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42926c-f565-4ae6-8541-074b38796e17 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:26.908003 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42926c-f565-4ae6-8541-074b38796e17 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:26.908003 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42926c-f565-4ae6-8541-074b38796e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:26.926774 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-4f42926c-f565-4ae6-8541-074b38796e17 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:26.928002 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-4f42926c-f565-4ae6-8541-074b38796e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:26.955956 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:26.976792 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb3155-52fe-4d2b-b0f1-b6aa6d52a372 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:26.993404 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 900/1803] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:26.994353 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42926c-f565-4ae6-8541-074b38796e17 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:27.011766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-4f42926c-f565-4ae6-8541-074b38796e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:27.025801 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42926c-f565-4ae6-8541-074b38796e17 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:27.030529 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab75982d-dd1d-4364-9d95-36f3b25dfca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:27.031459 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75982d-dd1d-4364-9d95-36f3b25dfca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:27.031740 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75982d-dd1d-4364-9d95-36f3b25dfca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:27.032270 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75982d-dd1d-4364-9d95-36f3b25dfca5 admin admin] PATH_INFO: `/v3/users/cedaaef55fe34192877bc89234727a87` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:27.033469 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab75982d-dd1d-4364-9d95-36f3b25dfca5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cedaaef55fe34192877bc89234727a87)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:27.035418 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab75982d-dd1d-4364-9d95-36f3b25dfca5 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:27.057694 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f21717d-6fda-4bfd-a8dd-364d6260c432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:27.058619 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21717d-6fda-4bfd-a8dd-364d6260c432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:27.058902 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21717d-6fda-4bfd-a8dd-364d6260c432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:27.059178 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21717d-6fda-4bfd-a8dd-364d6260c432 admin admin] PATH_INFO: `/v3/projects/1cf8e15f122c4bf1b329e5702879ed69` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:27.060463 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f21717d-6fda-4bfd-a8dd-364d6260c432 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cf8e15f122c4bf1b329e5702879ed69)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:27.062439 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f21717d-6fda-4bfd-a8dd-364d6260c432 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:27.095266 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-ab75982d-dd1d-4364-9d95-36f3b25dfca5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cedaaef55fe34192877bc89234727a87'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:27.095925 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-ab75982d-dd1d-4364-9d95-36f3b25dfca5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cedaaef55fe34192877bc89234727a87'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:27.103229 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-ab75982d-dd1d-4364-9d95-36f3b25dfca5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cedaaef55fe34192877bc89234727a87'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:27.103972 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-ab75982d-dd1d-4364-9d95-36f3b25dfca5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cedaaef55fe34192877bc89234727a87'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:27.117091 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-ab75982d-dd1d-4364-9d95-36f3b25dfca5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cedaaef55fe34192877bc89234727a87'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:27.131357 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 901/1804] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:38:26 2022] DELETE /identity/v3/users/cedaaef55fe34192877bc89234727a87 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:27.134519 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9a30b-c37c-485e-88de-c432c16e75b7 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:27.134519 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9a30b-c37c-485e-88de-c432c16e75b7 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:27.134519 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9a30b-c37c-485e-88de-c432c16e75b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:27.139473 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9f21717d-6fda-4bfd-a8dd-364d6260c432 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cf8e15f122c4bf1b329e5702879ed69', 'request_id': 'req-9f21717d-6fda-4bfd-a8dd-364d6260c432'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:27.149270 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9f21717d-6fda-4bfd-a8dd-364d6260c432 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cf8e15f122c4bf1b329e5702879ed69', 'request_id': 'req-9f21717d-6fda-4bfd-a8dd-364d6260c432'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:27.156185 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9f21717d-6fda-4bfd-a8dd-364d6260c432 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cf8e15f122c4bf1b329e5702879ed69', 'request_id': 'req-9f21717d-6fda-4bfd-a8dd-364d6260c432'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:27.156364 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-7be9a30b-c37c-485e-88de-c432c16e75b7 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:27.157576 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-7be9a30b-c37c-485e-88de-c432c16e75b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:27.168549 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9f21717d-6fda-4bfd-a8dd-364d6260c432 admin admin] The token cache is being invalidate because project 1cf8e15f122c4bf1b329e5702879ed69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:38:27.168836 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9f21717d-6fda-4bfd-a8dd-364d6260c432 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:27.169514 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9f21717d-6fda-4bfd-a8dd-364d6260c432 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:27.171131 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 904/1805] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:38:26 2022] DELETE /identity/v3/projects/1cf8e15f122c4bf1b329e5702879ed69 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:27.175893 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047f39a-34cf-4fe3-aa47-79ff1507de9b None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:27.176266 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047f39a-34cf-4fe3-aa47-79ff1507de9b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:27.176607 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047f39a-34cf-4fe3-aa47-79ff1507de9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:27.196940 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-d047f39a-34cf-4fe3-aa47-79ff1507de9b None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:27.198269 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d047f39a-34cf-4fe3-aa47-79ff1507de9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:27.225264 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:27.248064 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 902/1806] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:27.250757 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9a30b-c37c-485e-88de-c432c16e75b7 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:27.259964 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9a30b-c37c-485e-88de-c432c16e75b7 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:27.265591 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b884f-f252-4c0b-9ebf-1bb6cd84b37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:27.266516 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b884f-f252-4c0b-9ebf-1bb6cd84b37b admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:27.266936 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b884f-f252-4c0b-9ebf-1bb6cd84b37b admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:27.267593 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b884f-f252-4c0b-9ebf-1bb6cd84b37b admin admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:27.268602 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b884f-f252-4c0b-9ebf-1bb6cd84b37b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:38:27.268910 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b884f-f252-4c0b-9ebf-1bb6cd84b37b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:27.270868 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b884f-f252-4c0b-9ebf-1bb6cd84b37b admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:27.276391 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 905/1807] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:27.284246 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de4dbd-f33c-4d97-97e7-3d204c90fdbc None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:27.284651 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de4dbd-f33c-4d97-97e7-3d204c90fdbc None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:27.286253 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de4dbd-f33c-4d97-97e7-3d204c90fdbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:27.286394 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 903/1808] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:38:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:38:27.289047 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b884f-f252-4c0b-9ebf-1bb6cd84b37b admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:27.301965 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b884f-f252-4c0b-9ebf-1bb6cd84b37b admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:27.307285 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-24de4dbd-f33c-4d97-97e7-3d204c90fdbc None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:27.307424 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46919b82-4297-4f42-bca0-8cb1bc7c7400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:27.308045 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46919b82-4297-4f42-bca0-8cb1bc7c7400 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:27.308332 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46919b82-4297-4f42-bca0-8cb1bc7c7400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:27.308612 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46919b82-4297-4f42-bca0-8cb1bc7c7400 admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:27.309332 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46919b82-4297-4f42-bca0-8cb1bc7c7400 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:27.309773 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-24de4dbd-f33c-4d97-97e7-3d204c90fdbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:27.311293 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46919b82-4297-4f42-bca0-8cb1bc7c7400 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:27.320411 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 906/1809] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:38:27.325184 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de4dbd-f33c-4d97-97e7-3d204c90fdbc None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:27.340075 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de4dbd-f33c-4d97-97e7-3d204c90fdbc None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:27.345390 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 904/1810] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:38:27 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 17:38:27.345935 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57a1bb-037d-4d62-9670-06a8b0fc36e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:27.346691 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57a1bb-037d-4d62-9670-06a8b0fc36e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:27.346831 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46919b82-4297-4f42-bca0-8cb1bc7c7400 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:27.347581 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57a1bb-037d-4d62-9670-06a8b0fc36e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:27.347581 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57a1bb-037d-4d62-9670-06a8b0fc36e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:27.348368 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc57a1bb-037d-4d62-9670-06a8b0fc36e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:38:27.348744 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc57a1bb-037d-4d62-9670-06a8b0fc36e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:27.349902 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-46919b82-4297-4f42-bca0-8cb1bc7c7400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:27.359377 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc57a1bb-037d-4d62-9670-06a8b0fc36e2 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:27.361018 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:27.372526 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 907/1811] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:38:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:38:27.376659 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57a1bb-037d-4d62-9670-06a8b0fc36e2 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:27.383695 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57a1bb-037d-4d62-9670-06a8b0fc36e2 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:27.426598 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46919b82-4297-4f42-bca0-8cb1bc7c7400 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:27.431578 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be56bed-5329-48de-81a3-2bfaf93dd1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:27.432663 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be56bed-5329-48de-81a3-2bfaf93dd1f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:27.432968 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be56bed-5329-48de-81a3-2bfaf93dd1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:27.433244 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be56bed-5329-48de-81a3-2bfaf93dd1f9 admin admin] PATH_INFO: `/v3/projects/ea4a3cc0bfa94c7f933fa88cd3b23b9f` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:27.434496 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be56bed-5329-48de-81a3-2bfaf93dd1f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea4a3cc0bfa94c7f933fa88cd3b23b9f)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:27.436447 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be56bed-5329-48de-81a3-2bfaf93dd1f9 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:27.444539 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a0a966-2ede-46d2-8d04-c50913607e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:27.445726 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0a966-2ede-46d2-8d04-c50913607e13 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:27.445726 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0a966-2ede-46d2-8d04-c50913607e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:27.446064 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0a966-2ede-46d2-8d04-c50913607e13 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:27.447069 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a0a966-2ede-46d2-8d04-c50913607e13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:27.449684 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a0a966-2ede-46d2-8d04-c50913607e13 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:27.473925 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 908/1812] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:38:27 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:38:27.474828 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a0a966-2ede-46d2-8d04-c50913607e13 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:27.488624 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a0a966-2ede-46d2-8d04-c50913607e13 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:27.491609 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-7be56bed-5329-48de-81a3-2bfaf93dd1f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea4a3cc0bfa94c7f933fa88cd3b23b9f', 'request_id': 'req-7be56bed-5329-48de-81a3-2bfaf93dd1f9'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:27.501218 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-7be56bed-5329-48de-81a3-2bfaf93dd1f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea4a3cc0bfa94c7f933fa88cd3b23b9f', 'request_id': 'req-7be56bed-5329-48de-81a3-2bfaf93dd1f9'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:27.509283 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-7be56bed-5329-48de-81a3-2bfaf93dd1f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea4a3cc0bfa94c7f933fa88cd3b23b9f', 'request_id': 'req-7be56bed-5329-48de-81a3-2bfaf93dd1f9'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:27.524830 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-7be56bed-5329-48de-81a3-2bfaf93dd1f9 admin admin] The token cache is being invalidate because project ea4a3cc0bfa94c7f933fa88cd3b23b9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80150) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:38:27.525144 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-7be56bed-5329-48de-81a3-2bfaf93dd1f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:27.526080 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-7be56bed-5329-48de-81a3-2bfaf93dd1f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:27.528871 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 905/1813] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:38:27 2022] DELETE /identity/v3/projects/ea4a3cc0bfa94c7f933fa88cd3b23b9f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:27.533491 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be56bed-5329-48de-81a3-2bfaf93dd1f9 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:27.535540 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-7be56bed-5329-48de-81a3-2bfaf93dd1f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:27.552476 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030dbca-ae9a-46e6-8dde-7a9e20754ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:27.553151 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030dbca-ae9a-46e6-8dde-7a9e20754ed9 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:27.553434 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030dbca-ae9a-46e6-8dde-7a9e20754ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:27.553680 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030dbca-ae9a-46e6-8dde-7a9e20754ed9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:27.554405 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030dbca-ae9a-46e6-8dde-7a9e20754ed9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:27.556317 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030dbca-ae9a-46e6-8dde-7a9e20754ed9 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:27.596442 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 909/1814] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:38:27 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:38:27.598038 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf755ce-162d-4b92-b103-4771904b50d9 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:27.598426 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf755ce-162d-4b92-b103-4771904b50d9 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:27.598731 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf755ce-162d-4b92-b103-4771904b50d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:27.623183 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be56bed-5329-48de-81a3-2bfaf93dd1f9 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:27.633026 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-aaf755ce-162d-4b92-b103-4771904b50d9 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:27.636776 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-aaf755ce-162d-4b92-b103-4771904b50d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:27.676323 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:27.692809 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:27.703456 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1629b305-dc1f-472f-b10a-f36a1d980909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:27.704410 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629b305-dc1f-472f-b10a-f36a1d980909 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:27.704696 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629b305-dc1f-472f-b10a-f36a1d980909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:27.704971 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629b305-dc1f-472f-b10a-f36a1d980909 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:27.705713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1629b305-dc1f-472f-b10a-f36a1d980909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:27.707380 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1629b305-dc1f-472f-b10a-f36a1d980909 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:27.719038 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 906/1815] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:38:27.719883 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1629b305-dc1f-472f-b10a-f36a1d980909 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:27.721829 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-1629b305-dc1f-472f-b10a-f36a1d980909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:27.737681 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1629b305-dc1f-472f-b10a-f36a1d980909 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:27.743716 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d4afd-b593-4067-8f7b-afbd9b4bce79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:27.744841 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d4afd-b593-4067-8f7b-afbd9b4bce79 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:27.745365 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d4afd-b593-4067-8f7b-afbd9b4bce79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:27.745916 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d4afd-b593-4067-8f7b-afbd9b4bce79 admin admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:27.747081 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572d4afd-b593-4067-8f7b-afbd9b4bce79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:27.749595 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572d4afd-b593-4067-8f7b-afbd9b4bce79 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:27.778615 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 910/1816] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:27.779482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf755ce-162d-4b92-b103-4771904b50d9 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:27.780187 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 907/1817] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:38:27 2022] POST /identity/v3/users => generated 288 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:38:27.784462 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d4afd-b593-4067-8f7b-afbd9b4bce79 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:27.797591 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d4afd-b593-4067-8f7b-afbd9b4bce79 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:27.800495 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf755ce-162d-4b92-b103-4771904b50d9 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:27.805354 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ce33a-02b8-4574-8ac4-1fb86bb321c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:27.806132 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ce33a-02b8-4574-8ac4-1fb86bb321c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:27.806417 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ce33a-02b8-4574-8ac4-1fb86bb321c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:27.806695 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ce33a-02b8-4574-8ac4-1fb86bb321c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:27.807492 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367ce33a-02b8-4574-8ac4-1fb86bb321c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:27.809323 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367ce33a-02b8-4574-8ac4-1fb86bb321c3 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:27.814166 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425c7a2-0de5-4a34-8833-c4f4772e584b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:27.814940 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425c7a2-0de5-4a34-8833-c4f4772e584b admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:27.815481 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425c7a2-0de5-4a34-8833-c4f4772e584b admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:27.817096 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425c7a2-0de5-4a34-8833-c4f4772e584b admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:27.818461 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425c7a2-0de5-4a34-8833-c4f4772e584b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:27.822173 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 911/1818] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:38:27.822668 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425c7a2-0de5-4a34-8833-c4f4772e584b admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:27.824127 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca49d8-cb96-4ba8-bb40-a46039680f02 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:27.825044 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca49d8-cb96-4ba8-bb40-a46039680f02 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:27.825472 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca49d8-cb96-4ba8-bb40-a46039680f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:27.844213 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 908/1819] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 17:38:27.845749 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425c7a2-0de5-4a34-8833-c4f4772e584b admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:27.846430 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-6fca49d8-cb96-4ba8-bb40-a46039680f02 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:27.847864 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-6fca49d8-cb96-4ba8-bb40-a46039680f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:27.868496 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 912/1820] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:27.870726 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca49d8-cb96-4ba8-bb40-a46039680f02 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:27.876930 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425c7a2-0de5-4a34-8833-c4f4772e584b admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:27.884381 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca49d8-cb96-4ba8-bb40-a46039680f02 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:27.890903 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc284d-ba0e-4508-b919-7b3768c4ace4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:27.891185 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc284d-ba0e-4508-b919-7b3768c4ace4 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:27.891611 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc284d-ba0e-4508-b919-7b3768c4ace4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:27.891724 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc284d-ba0e-4508-b919-7b3768c4ace4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:27.892479 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc284d-ba0e-4508-b919-7b3768c4ace4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:27.894173 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc284d-ba0e-4508-b919-7b3768c4ace4 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:27.895183 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae793ee-8738-46ea-954c-c77e019e8420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:27.897663 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae793ee-8738-46ea-954c-c77e019e8420 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:27.897982 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae793ee-8738-46ea-954c-c77e019e8420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:27.898256 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae793ee-8738-46ea-954c-c77e019e8420 admin admin] PATH_INFO: `/v3/projects/aee9e879174f4366a882d863fd1a05f2/users/30b118c368b0400ea15b61559dc5c0d8/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:27.909643 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 913/1821] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:38:27.909643 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc284d-ba0e-4508-b919-7b3768c4ace4 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:27.925433 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc284d-ba0e-4508-b919-7b3768c4ace4 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:27.934097 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3920397-f026-4420-983b-b67b9da9b127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:27.934797 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3920397-f026-4420-983b-b67b9da9b127 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:27.935086 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3920397-f026-4420-983b-b67b9da9b127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:27.935365 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3920397-f026-4420-983b-b67b9da9b127 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:27.936112 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3920397-f026-4420-983b-b67b9da9b127 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:38:27.936422 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3920397-f026-4420-983b-b67b9da9b127 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:27.939176 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae793ee-8738-46ea-954c-c77e019e8420 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aee9e879174f4366a882d863fd1a05f2, user_id=30b118c368b0400ea15b61559dc5c0d8, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:27.942526 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae793ee-8738-46ea-954c-c77e019e8420 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:27.952378 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3920397-f026-4420-983b-b67b9da9b127 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:27.989021 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 914/1822] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:38:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:38:27.991741 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3920397-f026-4420-983b-b67b9da9b127 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:28.019074 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3920397-f026-4420-983b-b67b9da9b127 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:28.019484 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 909/1823] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:38:27 2022] PUT /identity/v3/projects/aee9e879174f4366a882d863fd1a05f2/users/30b118c368b0400ea15b61559dc5c0d8/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:28.020966 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae793ee-8738-46ea-954c-c77e019e8420 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:28.187296 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5d894-137a-45b6-a0f9-6583238eee05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:28.188521 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5d894-137a-45b6-a0f9-6583238eee05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:28.189165 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5d894-137a-45b6-a0f9-6583238eee05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:28.189664 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5d894-137a-45b6-a0f9-6583238eee05 admin admin] PATH_INFO: `/v3/projects/3f2976dc821641e8a64015997ad31c3d/users/8973f7162f6a47ec9c8b4c9783dd7316/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:28.195512 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae793ee-8738-46ea-954c-c77e019e8420 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:28.201747 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6d138-6835-42f9-b237-86de8808e234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:28.202754 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6d138-6835-42f9-b237-86de8808e234 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:28.203197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6d138-6835-42f9-b237-86de8808e234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:28.203622 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6d138-6835-42f9-b237-86de8808e234 admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:28.204472 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a6d138-6835-42f9-b237-86de8808e234 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:28.207286 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a6d138-6835-42f9-b237-86de8808e234 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:28.230093 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a5d894-137a-45b6-a0f9-6583238eee05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f2976dc821641e8a64015997ad31c3d, user_id=8973f7162f6a47ec9c8b4c9783dd7316, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:28.232792 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a5d894-137a-45b6-a0f9-6583238eee05 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:28.255736 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 910/1824] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:38:28 2022] POST /identity/v3/projects => generated 381 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:38:28.257280 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb50969-d362-4667-90e6-24dd0cd4f04a None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:28.260499 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 915/1825] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:38:27 2022] PUT /identity/v3/projects/3f2976dc821641e8a64015997ad31c3d/users/8973f7162f6a47ec9c8b4c9783dd7316/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:28.262042 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb50969-d362-4667-90e6-24dd0cd4f04a None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:28.262042 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb50969-d362-4667-90e6-24dd0cd4f04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:28.263278 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5d894-137a-45b6-a0f9-6583238eee05 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:28.323812 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-9cb50969-d362-4667-90e6-24dd0cd4f04a None None] MFA Rules not processed for user `30b118c368b0400ea15b61559dc5c0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:28.325699 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-9cb50969-d362-4667-90e6-24dd0cd4f04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:28.398243 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5d894-137a-45b6-a0f9-6583238eee05 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:28.409927 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:28.418554 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 911/1826] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:28.420063 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e209b-5fab-45c9-9f54-c31e8b9af2ef None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:28.420427 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e209b-5fab-45c9-9f54-c31e8b9af2ef None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:28.420817 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e209b-5fab-45c9-9f54-c31e8b9af2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:28.428641 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:28.461281 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-e28e209b-5fab-45c9-9f54-c31e8b9af2ef None None] MFA Rules not processed for user `8973f7162f6a47ec9c8b4c9783dd7316`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:28.462634 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-e28e209b-5fab-45c9-9f54-c31e8b9af2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:28.516274 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea1087-1ba8-467a-aa5a-62deeea957df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:28.517225 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea1087-1ba8-467a-aa5a-62deeea957df admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:28.517648 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea1087-1ba8-467a-aa5a-62deeea957df admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:28.518212 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea1087-1ba8-467a-aa5a-62deeea957df admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:28.519287 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea1087-1ba8-467a-aa5a-62deeea957df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:28.522187 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea1087-1ba8-467a-aa5a-62deeea957df admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:28.551304 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 912/1827] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:28.552400 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e209b-5fab-45c9-9f54-c31e8b9af2ef None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:28.552917 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 916/1828] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:38:28 2022] POST /identity/v3/users => generated 291 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:38:28.554306 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-e28e209b-5fab-45c9-9f54-c31e8b9af2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:28.557036 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea1087-1ba8-467a-aa5a-62deeea957df admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:28.570302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea1087-1ba8-467a-aa5a-62deeea957df admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:28.577012 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff16f3-5ad9-4305-b53c-075a48cd2019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:28.577805 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff16f3-5ad9-4305-b53c-075a48cd2019 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:28.578257 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff16f3-5ad9-4305-b53c-075a48cd2019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:28.578600 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff16f3-5ad9-4305-b53c-075a48cd2019 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:28.579439 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff16f3-5ad9-4305-b53c-075a48cd2019 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:28.581460 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff16f3-5ad9-4305-b53c-075a48cd2019 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:28.617308 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 917/1829] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:38:28 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:38:28.617308 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff16f3-5ad9-4305-b53c-075a48cd2019 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:28.627361 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e209b-5fab-45c9-9f54-c31e8b9af2ef None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:28.706476 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad6742-dbfe-4dee-93ae-d38b57effdc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:28.707248 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad6742-dbfe-4dee-93ae-d38b57effdc5 service cinder] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:28.707599 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad6742-dbfe-4dee-93ae-d38b57effdc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:28.707943 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad6742-dbfe-4dee-93ae-d38b57effdc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:28.716732 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff16f3-5ad9-4305-b53c-075a48cd2019 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:28.723277 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c0999-95c1-4ceb-a180-5bcc7f43fdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:28.724018 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c0999-95c1-4ceb-a180-5bcc7f43fdb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:28.724300 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c0999-95c1-4ceb-a180-5bcc7f43fdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:28.725105 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c0999-95c1-4ceb-a180-5bcc7f43fdb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:28.725311 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c0999-95c1-4ceb-a180-5bcc7f43fdb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:28.727447 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c0999-95c1-4ceb-a180-5bcc7f43fdb6 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:28.742065 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 918/1830] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:38:28.743429 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c0999-95c1-4ceb-a180-5bcc7f43fdb6 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:28.759680 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c0999-95c1-4ceb-a180-5bcc7f43fdb6 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:28.769605 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4f3b9-3f60-4122-adc5-8b6f71c85c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:28.770586 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4f3b9-3f60-4122-adc5-8b6f71c85c85 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:28.771034 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4f3b9-3f60-4122-adc5-8b6f71c85c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:28.771543 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4f3b9-3f60-4122-adc5-8b6f71c85c85 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:28.772492 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f4f3b9-3f60-4122-adc5-8b6f71c85c85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:28.774765 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f4f3b9-3f60-4122-adc5-8b6f71c85c85 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:28.818440 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad6742-dbfe-4dee-93ae-d38b57effdc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:28.819929 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 919/1831] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:38:28 2022] POST /identity/v3/users => generated 295 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:38:28.820457 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad6742-dbfe-4dee-93ae-d38b57effdc5 service cinder] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:28.822077 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4f3b9-3f60-4122-adc5-8b6f71c85c85 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:28.833652 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 913/1832] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:38:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:38:28.835732 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad6742-dbfe-4dee-93ae-d38b57effdc5 service cinder] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:28.844460 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:28.847338 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4f3b9-3f60-4122-adc5-8b6f71c85c85 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:28.849849 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad6742-dbfe-4dee-93ae-d38b57effdc5 service cinder] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:28.854013 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c4665-d72c-418c-998a-3f821cec98c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:28.855277 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c4665-d72c-418c-998a-3f821cec98c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:28.856735 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c4665-d72c-418c-998a-3f821cec98c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:28.857146 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c4665-d72c-418c-998a-3f821cec98c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:28.858159 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430c4665-d72c-418c-998a-3f821cec98c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:28.859181 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab806a-9aeb-4ab7-8b63-9297cce054b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:28.860198 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab806a-9aeb-4ab7-8b63-9297cce054b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:28.860335 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430c4665-d72c-418c-998a-3f821cec98c0 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:28.861076 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab806a-9aeb-4ab7-8b63-9297cce054b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:28.861624 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab806a-9aeb-4ab7-8b63-9297cce054b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:28.863039 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab806a-9aeb-4ab7-8b63-9297cce054b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:28.866091 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab806a-9aeb-4ab7-8b63-9297cce054b8 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:28.876328 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 920/1833] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:38:28.880282 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c4665-d72c-418c-998a-3f821cec98c0 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:28.885894 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 914/1834] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:38:28.890912 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab806a-9aeb-4ab7-8b63-9297cce054b8 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:28.901018 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c4665-d72c-418c-998a-3f821cec98c0 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:28.909488 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab806a-9aeb-4ab7-8b63-9297cce054b8 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:28.913662 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281480e1-9979-4cf1-8512-9fb5230610c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:28.914660 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4d831-705f-430f-9382-ce9545f2b64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:28.915397 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281480e1-9979-4cf1-8512-9fb5230610c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:28.916394 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4d831-705f-430f-9382-ce9545f2b64a admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:28.916394 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4d831-705f-430f-9382-ce9545f2b64a admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:28.916394 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4d831-705f-430f-9382-ce9545f2b64a admin admin] PATH_INFO: `/v3/projects/d2a2f3ad990641bdb239850e86e95f4a/users/98376505d3604210aafbe2e778bdc106/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:28.917129 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281480e1-9979-4cf1-8512-9fb5230610c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:28.917666 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281480e1-9979-4cf1-8512-9fb5230610c5 admin admin] PATH_INFO: `/v3/projects/52a6c882d869416e8cba6e3e67cf30e0/users/07ccf6aea36647c09c2fc835aa44ba33/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:28.945138 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde4d831-705f-430f-9382-ce9545f2b64a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2a2f3ad990641bdb239850e86e95f4a, user_id=98376505d3604210aafbe2e778bdc106, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:28.945715 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281480e1-9979-4cf1-8512-9fb5230610c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52a6c882d869416e8cba6e3e67cf30e0, user_id=07ccf6aea36647c09c2fc835aa44ba33, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:28.948535 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde4d831-705f-430f-9382-ce9545f2b64a admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:28.950052 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281480e1-9979-4cf1-8512-9fb5230610c5 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:28.970198 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 921/1835] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:38:28 2022] PUT /identity/v3/projects/52a6c882d869416e8cba6e3e67cf30e0/users/07ccf6aea36647c09c2fc835aa44ba33/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:28.985260 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c4074-d4de-4a7d-b1c7-d1bb65a0ab7c None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:28.985562 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c4074-d4de-4a7d-b1c7-d1bb65a0ab7c None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:28.985840 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c4074-d4de-4a7d-b1c7-d1bb65a0ab7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:28.995268 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 915/1836] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:38:28 2022] PUT /identity/v3/projects/d2a2f3ad990641bdb239850e86e95f4a/users/98376505d3604210aafbe2e778bdc106/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:28.999444 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4d831-705f-430f-9382-ce9545f2b64a admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:29.044729 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-7f6c4074-d4de-4a7d-b1c7-d1bb65a0ab7c None None] MFA Rules not processed for user `07ccf6aea36647c09c2fc835aa44ba33`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:29.047871 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7f6c4074-d4de-4a7d-b1c7-d1bb65a0ab7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:29.065680 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:29.088409 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4d831-705f-430f-9382-ce9545f2b64a admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:29.094144 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ecec9-4ca0-4369-83cc-0bbdb97b4a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:29.094837 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ecec9-4ca0-4369-83cc-0bbdb97b4a0e admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:29.095117 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ecec9-4ca0-4369-83cc-0bbdb97b4a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:29.095393 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ecec9-4ca0-4369-83cc-0bbdb97b4a0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:29.096127 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981ecec9-4ca0-4369-83cc-0bbdb97b4a0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:29.097750 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981ecec9-4ca0-4369-83cc-0bbdb97b4a0e admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:29.110230 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 916/1837] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:38:29.114788 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ecec9-4ca0-4369-83cc-0bbdb97b4a0e admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:29.127943 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ecec9-4ca0-4369-83cc-0bbdb97b4a0e admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:29.133557 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48314bf-e189-4494-a48c-1d96a7debac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:29.135298 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48314bf-e189-4494-a48c-1d96a7debac3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:29.135468 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48314bf-e189-4494-a48c-1d96a7debac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:29.135640 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48314bf-e189-4494-a48c-1d96a7debac3 admin admin] PATH_INFO: `/v3/projects/d2a2f3ad990641bdb239850e86e95f4a/users/98376505d3604210aafbe2e778bdc106/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:29.138607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48314bf-e189-4494-a48c-1d96a7debac3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2a2f3ad990641bdb239850e86e95f4a, user_id=98376505d3604210aafbe2e778bdc106, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:29.141555 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48314bf-e189-4494-a48c-1d96a7debac3 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:29.146671 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 922/1838] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:29.152172 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c4074-d4de-4a7d-b1c7-d1bb65a0ab7c None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:29.165189 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c4074-d4de-4a7d-b1c7-d1bb65a0ab7c None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:29.169684 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 917/1839] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:38:29 2022] PUT /identity/v3/projects/d2a2f3ad990641bdb239850e86e95f4a/users/98376505d3604210aafbe2e778bdc106/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:29.171258 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6cf7c-bb0e-4c3d-8b0f-e0e2c5823141 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:29.171553 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6cf7c-bb0e-4c3d-8b0f-e0e2c5823141 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:29.171830 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6cf7c-bb0e-4c3d-8b0f-e0e2c5823141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:29.213705 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-48a6cf7c-bb0e-4c3d-8b0f-e0e2c5823141 None None] MFA Rules not processed for user `98376505d3604210aafbe2e778bdc106`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:29.217174 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-48a6cf7c-bb0e-4c3d-8b0f-e0e2c5823141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:29.259342 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdcd465-98d3-46ae-9fdc-dff8d1409435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:29.260358 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdcd465-98d3-46ae-9fdc-dff8d1409435 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:29.260863 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdcd465-98d3-46ae-9fdc-dff8d1409435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:29.261248 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdcd465-98d3-46ae-9fdc-dff8d1409435 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:29.262206 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdcd465-98d3-46ae-9fdc-dff8d1409435 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:29.278148 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdcd465-98d3-46ae-9fdc-dff8d1409435 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:29.332253 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 923/1840] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:38:29 2022] POST /identity/v3/projects => generated 379 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 17:38:29.336352 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdcd465-98d3-46ae-9fdc-dff8d1409435 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:29.337809 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 918/1841] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:29 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:29.350042 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6cf7c-bb0e-4c3d-8b0f-e0e2c5823141 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:29.404482 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:29.423482 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6cf7c-bb0e-4c3d-8b0f-e0e2c5823141 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:29.452552 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdcd465-98d3-46ae-9fdc-dff8d1409435 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:29.457940 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba0b52-6173-4a39-8083-0e840b8c85fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:29.460831 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba0b52-6173-4a39-8083-0e840b8c85fa admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:29.460831 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba0b52-6173-4a39-8083-0e840b8c85fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:29.460831 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba0b52-6173-4a39-8083-0e840b8c85fa admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:29.460831 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcba0b52-6173-4a39-8083-0e840b8c85fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:29.463301 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcba0b52-6173-4a39-8083-0e840b8c85fa admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:29.493377 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0854052-8a50-4b70-9c8c-0a8ef77ea060 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:29.494617 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0854052-8a50-4b70-9c8c-0a8ef77ea060 service cinder] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:29.494617 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0854052-8a50-4b70-9c8c-0a8ef77ea060 service cinder] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:29.494804 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0854052-8a50-4b70-9c8c-0a8ef77ea060 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:29.497313 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 924/1842] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:38:29 2022] POST /identity/v3/users => generated 296 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 17:38:29.510968 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba0b52-6173-4a39-8083-0e840b8c85fa admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:29.522766 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba0b52-6173-4a39-8083-0e840b8c85fa admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:29.529755 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b87aa-8596-4f8f-9d4a-1a36b01a95b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:29.530117 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b87aa-8596-4f8f-9d4a-1a36b01a95b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:29.530412 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b87aa-8596-4f8f-9d4a-1a36b01a95b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:29.530692 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b87aa-8596-4f8f-9d4a-1a36b01a95b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:29.531573 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0b87aa-8596-4f8f-9d4a-1a36b01a95b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:29.534052 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0b87aa-8596-4f8f-9d4a-1a36b01a95b1 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:29.546798 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 925/1843] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:38:29.551368 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b87aa-8596-4f8f-9d4a-1a36b01a95b1 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:29.558065 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0854052-8a50-4b70-9c8c-0a8ef77ea060 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:29.559536 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0854052-8a50-4b70-9c8c-0a8ef77ea060 service cinder] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:29.565819 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b87aa-8596-4f8f-9d4a-1a36b01a95b1 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:29.570496 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3fd1ec-3643-41b0-bb96-4b3f7908e161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:29.571480 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fd1ec-3643-41b0-bb96-4b3f7908e161 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:29.571896 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fd1ec-3643-41b0-bb96-4b3f7908e161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:29.572380 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fd1ec-3643-41b0-bb96-4b3f7908e161 admin admin] PATH_INFO: `/v3/projects/43137517a61f4ea0b5ab2261e76c91b6/users/f228b3daaa9e451da0ad9317ebe2a813/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:29.573981 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 919/1844] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:38:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 17:38:29.587061 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:29.591649 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3fd1ec-3643-41b0-bb96-4b3f7908e161 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43137517a61f4ea0b5ab2261e76c91b6, user_id=f228b3daaa9e451da0ad9317ebe2a813, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:29.594637 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3fd1ec-3643-41b0-bb96-4b3f7908e161 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:29.612886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 926/1845] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:38:29 2022] PUT /identity/v3/projects/43137517a61f4ea0b5ab2261e76c91b6/users/f228b3daaa9e451da0ad9317ebe2a813/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:38:29.617750 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0854052-8a50-4b70-9c8c-0a8ef77ea060 service cinder] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:29.637347 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0854052-8a50-4b70-9c8c-0a8ef77ea060 service cinder] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:29.714960 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c8531-2d9c-43b6-ada7-baf10ab3aaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:29.715618 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c8531-2d9c-43b6-ada7-baf10ab3aaae admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:29.715780 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c8531-2d9c-43b6-ada7-baf10ab3aaae admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:29.716061 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c8531-2d9c-43b6-ada7-baf10ab3aaae admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:29.716892 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4c8531-2d9c-43b6-ada7-baf10ab3aaae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:29.718680 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4c8531-2d9c-43b6-ada7-baf10ab3aaae admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:29.733733 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 920/1846] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:38:29.736998 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3fd1ec-3643-41b0-bb96-4b3f7908e161 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:29.750213 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3fd1ec-3643-41b0-bb96-4b3f7908e161 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:29.755614 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef6615-fd8b-485d-b21d-b5fc3f1a96f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:29.756644 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef6615-fd8b-485d-b21d-b5fc3f1a96f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:29.757024 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef6615-fd8b-485d-b21d-b5fc3f1a96f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:29.757488 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef6615-fd8b-485d-b21d-b5fc3f1a96f1 admin admin] PATH_INFO: `/v3/projects/43137517a61f4ea0b5ab2261e76c91b6/users/f228b3daaa9e451da0ad9317ebe2a813/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:29.766683 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ef6615-fd8b-485d-b21d-b5fc3f1a96f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43137517a61f4ea0b5ab2261e76c91b6, user_id=f228b3daaa9e451da0ad9317ebe2a813, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:29.766683 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ef6615-fd8b-485d-b21d-b5fc3f1a96f1 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:29.777290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 927/1847] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:38:29 2022] PUT /identity/v3/projects/43137517a61f4ea0b5ab2261e76c91b6/users/f228b3daaa9e451da0ad9317ebe2a813/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:29.789613 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f0411-af7b-47e3-9cb1-c0e1f27f244a None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:29.789928 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f0411-af7b-47e3-9cb1-c0e1f27f244a None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:29.790203 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f0411-af7b-47e3-9cb1-c0e1f27f244a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:29.824844 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-026f0411-af7b-47e3-9cb1-c0e1f27f244a None None] MFA Rules not processed for user `f228b3daaa9e451da0ad9317ebe2a813`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:29.826215 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-026f0411-af7b-47e3-9cb1-c0e1f27f244a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:29.873317 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:29.928108 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 921/1848] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:29 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:29.941790 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef6615-fd8b-485d-b21d-b5fc3f1a96f1 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:30.029723 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef6615-fd8b-485d-b21d-b5fc3f1a96f1 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:30.035075 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41958b33-5e30-45d3-b4af-9b9a6be3af4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:30.035740 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41958b33-5e30-45d3-b4af-9b9a6be3af4f service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:30.036017 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41958b33-5e30-45d3-b4af-9b9a6be3af4f service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:30.036371 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41958b33-5e30-45d3-b4af-9b9a6be3af4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:30.048736 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41958b33-5e30-45d3-b4af-9b9a6be3af4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:30.050256 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41958b33-5e30-45d3-b4af-9b9a6be3af4f service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:30.064544 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 928/1849] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:38:29 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:38:30.155398 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f0411-af7b-47e3-9cb1-c0e1f27f244a None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:30.165054 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f0411-af7b-47e3-9cb1-c0e1f27f244a None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:30.169061 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aebf01-ea58-4570-b79c-aeff45e1e49b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:30.169720 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aebf01-ea58-4570-b79c-aeff45e1e49b service cinder] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:30.170039 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aebf01-ea58-4570-b79c-aeff45e1e49b service cinder] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:30.170344 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aebf01-ea58-4570-b79c-aeff45e1e49b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:30.228617 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aebf01-ea58-4570-b79c-aeff45e1e49b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:30.230122 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aebf01-ea58-4570-b79c-aeff45e1e49b service cinder] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:30.239093 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 922/1850] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:38:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:38:32.361610 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41958b33-5e30-45d3-b4af-9b9a6be3af4f service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:32.364817 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-41958b33-5e30-45d3-b4af-9b9a6be3af4f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:32.381933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41958b33-5e30-45d3-b4af-9b9a6be3af4f service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:32.386797 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a1ea6-610e-4060-9180-9108a323624c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:32.387708 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a1ea6-610e-4060-9180-9108a323624c service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:32.388085 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a1ea6-610e-4060-9180-9108a323624c service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:32.388454 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a1ea6-610e-4060-9180-9108a323624c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:32.438301 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd03d8c-b15a-460c-a0ab-f7986d06bd2f None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:32.438783 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd03d8c-b15a-460c-a0ab-f7986d06bd2f None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:32.439038 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd03d8c-b15a-460c-a0ab-f7986d06bd2f None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:32.441291 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 923/1851] 10.222.0.27 () {54 vars in 921 bytes} [Fri Jul 15 17:38:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 17:38:32.461989 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3f96c-2612-4c24-9597-57eb2a9299a4 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:32.462281 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3f96c-2612-4c24-9597-57eb2a9299a4 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:32.462562 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3f96c-2612-4c24-9597-57eb2a9299a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:32.507108 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-69a3f96c-2612-4c24-9597-57eb2a9299a4 None None] MFA Rules not processed for user `f9d548c8199e4fdbbce7597bebd63421`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:32.508760 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-69a3f96c-2612-4c24-9597-57eb2a9299a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:32.557157 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a1ea6-610e-4060-9180-9108a323624c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:32.563192 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a1ea6-610e-4060-9180-9108a323624c service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:32.587972 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 929/1852] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:38:32 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:38:32.668031 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 924/1853] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Jul 15 17:38:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:38:33.014674 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a1ea6-610e-4060-9180-9108a323624c service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:33.016942 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e47a1ea6-610e-4060-9180-9108a323624c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:33.055889 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a1ea6-610e-4060-9180-9108a323624c service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:33.087802 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ccf8b5-55eb-4376-819f-94ab963ca02a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:33.088607 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ccf8b5-55eb-4376-819f-94ab963ca02a service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:33.088894 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ccf8b5-55eb-4376-819f-94ab963ca02a service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:33.089175 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ccf8b5-55eb-4376-819f-94ab963ca02a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:33.124712 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ccf8b5-55eb-4376-819f-94ab963ca02a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:33.126408 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ccf8b5-55eb-4376-819f-94ab963ca02a service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:33.151887 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 930/1854] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:38:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:38:37.890082 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3f96c-2612-4c24-9597-57eb2a9299a4 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:38.000761 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3f96c-2612-4c24-9597-57eb2a9299a4 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:38.005303 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e79de8-3c38-4a2b-818f-e716bb0a4cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:38.006244 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e79de8-3c38-4a2b-818f-e716bb0a4cd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:38.006524 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e79de8-3c38-4a2b-818f-e716bb0a4cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:38.006795 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e79de8-3c38-4a2b-818f-e716bb0a4cd6 admin admin] PATH_INFO: `/v3/users/07ccf6aea36647c09c2fc835aa44ba33` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:38.008012 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e79de8-3c38-4a2b-818f-e716bb0a4cd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07ccf6aea36647c09c2fc835aa44ba33)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:38.010081 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e79de8-3c38-4a2b-818f-e716bb0a4cd6 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:38.013064 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:38.070470 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-33e79de8-3c38-4a2b-818f-e716bb0a4cd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07ccf6aea36647c09c2fc835aa44ba33'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:38.071436 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-33e79de8-3c38-4a2b-818f-e716bb0a4cd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07ccf6aea36647c09c2fc835aa44ba33'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:38.083948 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-33e79de8-3c38-4a2b-818f-e716bb0a4cd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07ccf6aea36647c09c2fc835aa44ba33'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:38.084699 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-33e79de8-3c38-4a2b-818f-e716bb0a4cd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07ccf6aea36647c09c2fc835aa44ba33'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:38.098283 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-33e79de8-3c38-4a2b-818f-e716bb0a4cd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07ccf6aea36647c09c2fc835aa44ba33'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:38.121582 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 925/1855] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:38:37 2022] DELETE /identity/v3/users/07ccf6aea36647c09c2fc835aa44ba33 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:38.124431 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c676c65-9315-416d-b8fd-2abad0f7d20c None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:38.124928 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c676c65-9315-416d-b8fd-2abad0f7d20c None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:38.125004 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c676c65-9315-416d-b8fd-2abad0f7d20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:38.146859 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-5c676c65-9315-416d-b8fd-2abad0f7d20c None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:38.148414 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5c676c65-9315-416d-b8fd-2abad0f7d20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:38.210941 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:38.228151 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 931/1856] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:38.234823 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e79de8-3c38-4a2b-818f-e716bb0a4cd6 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:38.236414 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-33e79de8-3c38-4a2b-818f-e716bb0a4cd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:38.395689 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e79de8-3c38-4a2b-818f-e716bb0a4cd6 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:38.409462 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee70425-7bd9-45fa-8e87-e93f7d3d97bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:38.410197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee70425-7bd9-45fa-8e87-e93f7d3d97bf service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:38.410463 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee70425-7bd9-45fa-8e87-e93f7d3d97bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:38.411124 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee70425-7bd9-45fa-8e87-e93f7d3d97bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:38.427136 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee70425-7bd9-45fa-8e87-e93f7d3d97bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:38.429608 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee70425-7bd9-45fa-8e87-e93f7d3d97bf service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:38.469901 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 926/1857] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:38:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:38:38.966141 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c676c65-9315-416d-b8fd-2abad0f7d20c None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:38.967641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5c676c65-9315-416d-b8fd-2abad0f7d20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:38.986190 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c676c65-9315-416d-b8fd-2abad0f7d20c None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:38.991360 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dedbad-b3e3-4b76-b72e-045bb2dfaadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:38.992200 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dedbad-b3e3-4b76-b72e-045bb2dfaadc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:38.992477 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dedbad-b3e3-4b76-b72e-045bb2dfaadc admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:38.992775 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dedbad-b3e3-4b76-b72e-045bb2dfaadc admin admin] PATH_INFO: `/v3/projects/52a6c882d869416e8cba6e3e67cf30e0` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:38.994113 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dedbad-b3e3-4b76-b72e-045bb2dfaadc admin admin] RBAC: Authorizing `identity:delete_project(project_id=52a6c882d869416e8cba6e3e67cf30e0)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:38.996195 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dedbad-b3e3-4b76-b72e-045bb2dfaadc admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:39.050078 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f9dedbad-b3e3-4b76-b72e-045bb2dfaadc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52a6c882d869416e8cba6e3e67cf30e0', 'request_id': 'req-f9dedbad-b3e3-4b76-b72e-045bb2dfaadc'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:39.062861 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f9dedbad-b3e3-4b76-b72e-045bb2dfaadc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52a6c882d869416e8cba6e3e67cf30e0', 'request_id': 'req-f9dedbad-b3e3-4b76-b72e-045bb2dfaadc'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:39.068745 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f9dedbad-b3e3-4b76-b72e-045bb2dfaadc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52a6c882d869416e8cba6e3e67cf30e0', 'request_id': 'req-f9dedbad-b3e3-4b76-b72e-045bb2dfaadc'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:39.080400 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f9dedbad-b3e3-4b76-b72e-045bb2dfaadc admin admin] The token cache is being invalidate because project 52a6c882d869416e8cba6e3e67cf30e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:38:39.080683 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f9dedbad-b3e3-4b76-b72e-045bb2dfaadc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:39.081330 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f9dedbad-b3e3-4b76-b72e-045bb2dfaadc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:39.082929 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 932/1858] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:38:38 2022] DELETE /identity/v3/projects/52a6c882d869416e8cba6e3e67cf30e0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:39.087260 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee70425-7bd9-45fa-8e87-e93f7d3d97bf service neutron] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:39.097375 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee70425-7bd9-45fa-8e87-e93f7d3d97bf service neutron] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:39.158544 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64739ec1-335f-4eae-9f67-f0b8f2375464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:39.159357 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64739ec1-335f-4eae-9f67-f0b8f2375464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:39.159633 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64739ec1-335f-4eae-9f67-f0b8f2375464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:39.159903 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64739ec1-335f-4eae-9f67-f0b8f2375464 admin admin] PATH_INFO: `/v3/users/f228b3daaa9e451da0ad9317ebe2a813` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:39.161084 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64739ec1-335f-4eae-9f67-f0b8f2375464 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f228b3daaa9e451da0ad9317ebe2a813)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:39.163033 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64739ec1-335f-4eae-9f67-f0b8f2375464 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:39.186578 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:39.222481 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-64739ec1-335f-4eae-9f67-f0b8f2375464 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f228b3daaa9e451da0ad9317ebe2a813'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:39.223127 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-64739ec1-335f-4eae-9f67-f0b8f2375464 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f228b3daaa9e451da0ad9317ebe2a813'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:39.230385 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-64739ec1-335f-4eae-9f67-f0b8f2375464 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f228b3daaa9e451da0ad9317ebe2a813'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:39.231071 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-64739ec1-335f-4eae-9f67-f0b8f2375464 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f228b3daaa9e451da0ad9317ebe2a813'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:39.243973 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-64739ec1-335f-4eae-9f67-f0b8f2375464 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f228b3daaa9e451da0ad9317ebe2a813'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:39.259220 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 927/1859] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:38:39 2022] DELETE /identity/v3/users/f228b3daaa9e451da0ad9317ebe2a813 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:39.710533 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dedbad-b3e3-4b76-b72e-045bb2dfaadc admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:39.712782 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f9dedbad-b3e3-4b76-b72e-045bb2dfaadc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:39.748914 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dedbad-b3e3-4b76-b72e-045bb2dfaadc admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:39.825839 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c3eda-a36a-405b-968f-721fb7cf7180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:39.827824 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c3eda-a36a-405b-968f-721fb7cf7180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:39.828203 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c3eda-a36a-405b-968f-721fb7cf7180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:39.828570 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c3eda-a36a-405b-968f-721fb7cf7180 admin admin] PATH_INFO: `/v3/projects/43137517a61f4ea0b5ab2261e76c91b6` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:39.830945 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6c3eda-a36a-405b-968f-721fb7cf7180 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43137517a61f4ea0b5ab2261e76c91b6)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:39.834091 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6c3eda-a36a-405b-968f-721fb7cf7180 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:39.913523 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9e6c3eda-a36a-405b-968f-721fb7cf7180 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43137517a61f4ea0b5ab2261e76c91b6', 'request_id': 'req-9e6c3eda-a36a-405b-968f-721fb7cf7180'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:39.930957 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9e6c3eda-a36a-405b-968f-721fb7cf7180 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43137517a61f4ea0b5ab2261e76c91b6', 'request_id': 'req-9e6c3eda-a36a-405b-968f-721fb7cf7180'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:39.941396 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9e6c3eda-a36a-405b-968f-721fb7cf7180 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43137517a61f4ea0b5ab2261e76c91b6', 'request_id': 'req-9e6c3eda-a36a-405b-968f-721fb7cf7180'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:39.958706 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9e6c3eda-a36a-405b-968f-721fb7cf7180 admin admin] The token cache is being invalidate because project 43137517a61f4ea0b5ab2261e76c91b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:38:39.961667 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9e6c3eda-a36a-405b-968f-721fb7cf7180 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:39.962768 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9e6c3eda-a36a-405b-968f-721fb7cf7180 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:39.965065 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 933/1860] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:38:39 2022] DELETE /identity/v3/projects/43137517a61f4ea0b5ab2261e76c91b6 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:39.972924 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac872164-4294-4630-84f1-7d5156a935a1 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:39.973429 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac872164-4294-4630-84f1-7d5156a935a1 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:39.974001 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac872164-4294-4630-84f1-7d5156a935a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:40.018072 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-ac872164-4294-4630-84f1-7d5156a935a1 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:40.019166 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-ac872164-4294-4630-84f1-7d5156a935a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:40.125796 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6dba43-0faa-4371-9036-77e8738db7bb None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:40.126302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6dba43-0faa-4371-9036-77e8738db7bb None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:40.126780 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6dba43-0faa-4371-9036-77e8738db7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:40.129585 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 928/1861] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:40.154142 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-5c6dba43-0faa-4371-9036-77e8738db7bb None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:40.155364 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5c6dba43-0faa-4371-9036-77e8738db7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:40.163719 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 934/1862] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:40.169059 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac872164-4294-4630-84f1-7d5156a935a1 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:40.179102 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac872164-4294-4630-84f1-7d5156a935a1 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:40.184485 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1423761-da9f-47f0-bfe7-3e422aacfb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:40.185201 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1423761-da9f-47f0-bfe7-3e422aacfb71 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:40.185480 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1423761-da9f-47f0-bfe7-3e422aacfb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:40.185756 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1423761-da9f-47f0-bfe7-3e422aacfb71 admin admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:40.186610 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1423761-da9f-47f0-bfe7-3e422aacfb71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:38:40.186910 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1423761-da9f-47f0-bfe7-3e422aacfb71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:40.188582 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1423761-da9f-47f0-bfe7-3e422aacfb71 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:40.205963 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 929/1863] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:38:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:38:40.206865 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6dba43-0faa-4371-9036-77e8738db7bb None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:40.217356 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6dba43-0faa-4371-9036-77e8738db7bb None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:40.222376 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9210fb7a-acc3-43a4-9557-17e009bada19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:40.223047 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210fb7a-acc3-43a4-9557-17e009bada19 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:40.223325 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210fb7a-acc3-43a4-9557-17e009bada19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:40.223594 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210fb7a-acc3-43a4-9557-17e009bada19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:40.224277 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9210fb7a-acc3-43a4-9557-17e009bada19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:40.226222 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9210fb7a-acc3-43a4-9557-17e009bada19 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:40.230080 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:40.263200 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 935/1864] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:38:40 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:38:40.267930 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1423761-da9f-47f0-bfe7-3e422aacfb71 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:40.281985 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1423761-da9f-47f0-bfe7-3e422aacfb71 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:40.350441 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc166c-ae46-443c-a741-9eedc500d877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:40.351140 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc166c-ae46-443c-a741-9eedc500d877 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:40.351428 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc166c-ae46-443c-a741-9eedc500d877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:40.351704 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc166c-ae46-443c-a741-9eedc500d877 admin admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:40.352406 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc166c-ae46-443c-a741-9eedc500d877 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:40.354701 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc166c-ae46-443c-a741-9eedc500d877 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:40.379488 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 930/1865] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:38:40 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:38:40.380781 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9210fb7a-acc3-43a4-9557-17e009bada19 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:40.391236 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9210fb7a-acc3-43a4-9557-17e009bada19 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:40.397497 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ae833-ebef-4aa1-b229-983806fbe32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:40.398358 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ae833-ebef-4aa1-b229-983806fbe32c admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:40.398638 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ae833-ebef-4aa1-b229-983806fbe32c admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:40.398911 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ae833-ebef-4aa1-b229-983806fbe32c admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:40.399871 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ae833-ebef-4aa1-b229-983806fbe32c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:40.401759 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ae833-ebef-4aa1-b229-983806fbe32c admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:40.421757 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 936/1866] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:38:40.423008 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc166c-ae46-443c-a741-9eedc500d877 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:40.433422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc166c-ae46-443c-a741-9eedc500d877 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:40.438639 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee43505-4997-4bf8-ba57-3cad61c853ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:40.439307 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee43505-4997-4bf8-ba57-3cad61c853ad admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:40.439595 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee43505-4997-4bf8-ba57-3cad61c853ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:40.439901 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee43505-4997-4bf8-ba57-3cad61c853ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:40.440614 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee43505-4997-4bf8-ba57-3cad61c853ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:40.442290 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee43505-4997-4bf8-ba57-3cad61c853ad admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:40.453409 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 931/1867] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 17:38:40.457954 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ae833-ebef-4aa1-b229-983806fbe32c admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:40.468689 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ae833-ebef-4aa1-b229-983806fbe32c admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:40.473432 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a25803-3f56-4d72-982e-7b8d5425e2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:40.474351 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a25803-3f56-4d72-982e-7b8d5425e2ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:40.474636 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a25803-3f56-4d72-982e-7b8d5425e2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:40.474917 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a25803-3f56-4d72-982e-7b8d5425e2ca admin admin] PATH_INFO: `/v3/projects/3c64ebe4d69e41d29e7f27cd77fc3f1c/users/5eb66cca7f394353b9ba7302e5c41934/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:40.493446 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a25803-3f56-4d72-982e-7b8d5425e2ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c64ebe4d69e41d29e7f27cd77fc3f1c, user_id=5eb66cca7f394353b9ba7302e5c41934, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:40.496211 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a25803-3f56-4d72-982e-7b8d5425e2ca admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:40.511649 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 937/1868] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:38:40 2022] PUT /identity/v3/projects/3c64ebe4d69e41d29e7f27cd77fc3f1c/users/5eb66cca7f394353b9ba7302e5c41934/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:40.523647 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308f06c-e8d4-44aa-a4cd-2e77453e493d None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:40.523941 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308f06c-e8d4-44aa-a4cd-2e77453e493d None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:40.524223 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308f06c-e8d4-44aa-a4cd-2e77453e493d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:40.537720 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:40.555881 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-4308f06c-e8d4-44aa-a4cd-2e77453e493d None None] MFA Rules not processed for user `5eb66cca7f394353b9ba7302e5c41934`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:40.557247 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-4308f06c-e8d4-44aa-a4cd-2e77453e493d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:40.633302 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 932/1869] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:40.645638 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a25803-3f56-4d72-982e-7b8d5425e2ca admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:40.647591 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-08a25803-3f56-4d72-982e-7b8d5425e2ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:40.710039 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a25803-3f56-4d72-982e-7b8d5425e2ca admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:40.714108 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e1ecfa-2385-45b2-9bb7-733ce5ec1571 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:40.714798 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1ecfa-2385-45b2-9bb7-733ce5ec1571 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:40.715092 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1ecfa-2385-45b2-9bb7-733ce5ec1571 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:40.715350 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1ecfa-2385-45b2-9bb7-733ce5ec1571 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:40.724440 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e1ecfa-2385-45b2-9bb7-733ce5ec1571 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:40.725910 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e1ecfa-2385-45b2-9bb7-733ce5ec1571 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:40.735603 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 938/1870] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:38:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:38:40.755255 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4308f06c-e8d4-44aa-a4cd-2e77453e493d None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:40.825407 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4308f06c-e8d4-44aa-a4cd-2e77453e493d None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:40.830498 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398518ff-ace7-4868-8ace-2af10f9c635d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:40.831480 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398518ff-ace7-4868-8ace-2af10f9c635d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:40.831831 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398518ff-ace7-4868-8ace-2af10f9c635d admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:40.832172 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398518ff-ace7-4868-8ace-2af10f9c635d admin admin] PATH_INFO: `/v3/users/5eb66cca7f394353b9ba7302e5c41934` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:40.835175 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398518ff-ace7-4868-8ace-2af10f9c635d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5eb66cca7f394353b9ba7302e5c41934)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:40.837246 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398518ff-ace7-4868-8ace-2af10f9c635d admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:40.889453 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-398518ff-ace7-4868-8ace-2af10f9c635d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5eb66cca7f394353b9ba7302e5c41934'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:40.890205 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-398518ff-ace7-4868-8ace-2af10f9c635d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5eb66cca7f394353b9ba7302e5c41934'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:40.897141 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-398518ff-ace7-4868-8ace-2af10f9c635d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5eb66cca7f394353b9ba7302e5c41934'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:40.897886 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-398518ff-ace7-4868-8ace-2af10f9c635d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5eb66cca7f394353b9ba7302e5c41934'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:40.910136 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-398518ff-ace7-4868-8ace-2af10f9c635d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5eb66cca7f394353b9ba7302e5c41934'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:40.925430 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 933/1871] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:38:40 2022] DELETE /identity/v3/users/5eb66cca7f394353b9ba7302e5c41934 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:40.931729 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c7b5e-0a46-4fa1-a9fb-b251044e9d35 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:40.932096 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c7b5e-0a46-4fa1-a9fb-b251044e9d35 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:40.932447 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c7b5e-0a46-4fa1-a9fb-b251044e9d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:40.952787 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-fb2c7b5e-0a46-4fa1-a9fb-b251044e9d35 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:40.954032 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-fb2c7b5e-0a46-4fa1-a9fb-b251044e9d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:41.020027 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 939/1872] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:41.030396 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398518ff-ace7-4868-8ace-2af10f9c635d admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:41.031698 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-398518ff-ace7-4868-8ace-2af10f9c635d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:41.053216 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:41.147436 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398518ff-ace7-4868-8ace-2af10f9c635d admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:41.152503 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9202d372-3710-41fc-91c8-5f5344a81b22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:41.153916 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202d372-3710-41fc-91c8-5f5344a81b22 service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:41.153916 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202d372-3710-41fc-91c8-5f5344a81b22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:41.153916 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202d372-3710-41fc-91c8-5f5344a81b22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:41.168155 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9202d372-3710-41fc-91c8-5f5344a81b22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:41.169709 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9202d372-3710-41fc-91c8-5f5344a81b22 service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:41.181066 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 934/1873] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:38:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:38:41.625447 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c7b5e-0a46-4fa1-a9fb-b251044e9d35 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:41.627024 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-fb2c7b5e-0a46-4fa1-a9fb-b251044e9d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:41.645595 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c7b5e-0a46-4fa1-a9fb-b251044e9d35 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:41.652523 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44954072-e4c5-426d-900f-2a2fb4f4fbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:41.653418 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44954072-e4c5-426d-900f-2a2fb4f4fbc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:41.653697 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44954072-e4c5-426d-900f-2a2fb4f4fbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:41.653988 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44954072-e4c5-426d-900f-2a2fb4f4fbc7 admin admin] PATH_INFO: `/v3/projects/3c64ebe4d69e41d29e7f27cd77fc3f1c` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:41.655184 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44954072-e4c5-426d-900f-2a2fb4f4fbc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c64ebe4d69e41d29e7f27cd77fc3f1c)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:41.657150 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44954072-e4c5-426d-900f-2a2fb4f4fbc7 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:41.706777 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:41.708210 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-44954072-e4c5-426d-900f-2a2fb4f4fbc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c64ebe4d69e41d29e7f27cd77fc3f1c', 'request_id': 'req-44954072-e4c5-426d-900f-2a2fb4f4fbc7'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:41.716563 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-44954072-e4c5-426d-900f-2a2fb4f4fbc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c64ebe4d69e41d29e7f27cd77fc3f1c', 'request_id': 'req-44954072-e4c5-426d-900f-2a2fb4f4fbc7'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:41.723452 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-44954072-e4c5-426d-900f-2a2fb4f4fbc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c64ebe4d69e41d29e7f27cd77fc3f1c', 'request_id': 'req-44954072-e4c5-426d-900f-2a2fb4f4fbc7'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:41.735846 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-44954072-e4c5-426d-900f-2a2fb4f4fbc7 admin admin] The token cache is being invalidate because project 3c64ebe4d69e41d29e7f27cd77fc3f1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:38:41.736056 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-44954072-e4c5-426d-900f-2a2fb4f4fbc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:41.736801 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-44954072-e4c5-426d-900f-2a2fb4f4fbc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:41.738554 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 940/1874] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:38:41 2022] DELETE /identity/v3/projects/3c64ebe4d69e41d29e7f27cd77fc3f1c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:41.743648 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f40ce-4f96-4c02-9422-3b8acc6fb3f7 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:41.744008 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f40ce-4f96-4c02-9422-3b8acc6fb3f7 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:41.744283 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f40ce-4f96-4c02-9422-3b8acc6fb3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:41.764043 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-657f40ce-4f96-4c02-9422-3b8acc6fb3f7 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:41.765286 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-657f40ce-4f96-4c02-9422-3b8acc6fb3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:41.845209 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 935/1875] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:41.853864 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ae508-dcdf-4dcc-97d9-b4773b5b7acf None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:41.854313 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ae508-dcdf-4dcc-97d9-b4773b5b7acf None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:41.854719 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ae508-dcdf-4dcc-97d9-b4773b5b7acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:41.882569 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-a85ae508-dcdf-4dcc-97d9-b4773b5b7acf None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:41.884481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a85ae508-dcdf-4dcc-97d9-b4773b5b7acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:41.898677 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 941/1876] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:41.904396 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f40ce-4f96-4c02-9422-3b8acc6fb3f7 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:41.923511 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f40ce-4f96-4c02-9422-3b8acc6fb3f7 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:41.930593 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd39fe2-1e92-4928-9079-264d515b39a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:41.931316 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd39fe2-1e92-4928-9079-264d515b39a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:41.932101 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd39fe2-1e92-4928-9079-264d515b39a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:41.932511 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd39fe2-1e92-4928-9079-264d515b39a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:41.933278 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd39fe2-1e92-4928-9079-264d515b39a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:38:41.933652 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd39fe2-1e92-4928-9079-264d515b39a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:41.935434 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd39fe2-1e92-4928-9079-264d515b39a2 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:41.950280 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 936/1877] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:38:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:38:41.957893 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ae508-dcdf-4dcc-97d9-b4773b5b7acf None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:41.971241 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ae508-dcdf-4dcc-97d9-b4773b5b7acf None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:41.980008 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e133d9-9243-40a0-907b-2104a9dce98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:41.981178 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e133d9-9243-40a0-907b-2104a9dce98f admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:41.981965 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e133d9-9243-40a0-907b-2104a9dce98f admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:41.982727 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e133d9-9243-40a0-907b-2104a9dce98f admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:41.984981 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e133d9-9243-40a0-907b-2104a9dce98f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:41.990271 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e133d9-9243-40a0-907b-2104a9dce98f admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:42.050554 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 942/1878] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:38:41 2022] POST /identity/v3/projects => generated 375 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:38:42.052387 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd39fe2-1e92-4928-9079-264d515b39a2 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:42.065083 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd39fe2-1e92-4928-9079-264d515b39a2 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:42.144612 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f915d-6d3f-4115-a6ed-f7f9ba7b22c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:42.145372 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f915d-6d3f-4115-a6ed-f7f9ba7b22c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:42.145722 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f915d-6d3f-4115-a6ed-f7f9ba7b22c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:42.145991 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f915d-6d3f-4115-a6ed-f7f9ba7b22c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:42.146703 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f915d-6d3f-4115-a6ed-f7f9ba7b22c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:42.148911 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f915d-6d3f-4115-a6ed-f7f9ba7b22c0 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:42.198661 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 937/1879] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:38:42 2022] POST /identity/v3/users => generated 288 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 17:38:42.202583 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e133d9-9243-40a0-907b-2104a9dce98f admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:42.216018 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e133d9-9243-40a0-907b-2104a9dce98f admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:42.224151 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694270a7-12a0-4a41-aac0-ce469c784e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:42.225554 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694270a7-12a0-4a41-aac0-ce469c784e25 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:42.225554 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694270a7-12a0-4a41-aac0-ce469c784e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:42.225744 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694270a7-12a0-4a41-aac0-ce469c784e25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:42.226711 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694270a7-12a0-4a41-aac0-ce469c784e25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:42.228783 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694270a7-12a0-4a41-aac0-ce469c784e25 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:42.240629 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 943/1880] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 17:38:42.246892 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f915d-6d3f-4115-a6ed-f7f9ba7b22c0 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:42.259716 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f915d-6d3f-4115-a6ed-f7f9ba7b22c0 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:42.264898 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77739d8-5bc2-4e57-b9c2-65d452873135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:42.266230 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77739d8-5bc2-4e57-b9c2-65d452873135 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:42.266599 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77739d8-5bc2-4e57-b9c2-65d452873135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:42.266952 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77739d8-5bc2-4e57-b9c2-65d452873135 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:42.267874 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77739d8-5bc2-4e57-b9c2-65d452873135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:42.270200 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77739d8-5bc2-4e57-b9c2-65d452873135 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:42.283172 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 938/1881] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 17:38:42.287987 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694270a7-12a0-4a41-aac0-ce469c784e25 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:42.299677 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694270a7-12a0-4a41-aac0-ce469c784e25 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:42.308451 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a875c127-5ed2-4212-886c-be182723068c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:42.309687 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875c127-5ed2-4212-886c-be182723068c admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:42.310025 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875c127-5ed2-4212-886c-be182723068c admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:42.310305 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875c127-5ed2-4212-886c-be182723068c admin admin] PATH_INFO: `/v3/projects/dea0ada0e30147a0b95cf6915f518e62/users/a3e242f70e7b4ba993b8cdce387dbbb3/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:42.343600 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a875c127-5ed2-4212-886c-be182723068c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dea0ada0e30147a0b95cf6915f518e62, user_id=a3e242f70e7b4ba993b8cdce387dbbb3, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:42.347894 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a875c127-5ed2-4212-886c-be182723068c admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:42.392754 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 944/1882] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:38:42 2022] PUT /identity/v3/projects/dea0ada0e30147a0b95cf6915f518e62/users/a3e242f70e7b4ba993b8cdce387dbbb3/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:42.405585 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b5c72-17d4-43df-b094-088ef184f409 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:42.405904 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b5c72-17d4-43df-b094-088ef184f409 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:42.406182 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b5c72-17d4-43df-b094-088ef184f409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:42.463078 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-334b5c72-17d4-43df-b094-088ef184f409 None None] MFA Rules not processed for user `a3e242f70e7b4ba993b8cdce387dbbb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:42.465435 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-334b5c72-17d4-43df-b094-088ef184f409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:42.485947 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:42.580267 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 939/1883] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:42.585078 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a875c127-5ed2-4212-886c-be182723068c admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:42.717488 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a875c127-5ed2-4212-886c-be182723068c admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:42.725088 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae63223-b553-4569-a6a1-f772df0f814e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:42.726389 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae63223-b553-4569-a6a1-f772df0f814e admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:42.726781 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae63223-b553-4569-a6a1-f772df0f814e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:42.727250 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae63223-b553-4569-a6a1-f772df0f814e admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:42.735865 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae63223-b553-4569-a6a1-f772df0f814e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:42.738574 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae63223-b553-4569-a6a1-f772df0f814e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:42.768898 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 945/1884] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:38:42 2022] POST /identity/v3/projects => generated 373 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:38:42.773265 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b5c72-17d4-43df-b094-088ef184f409 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:42.785248 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b5c72-17d4-43df-b094-088ef184f409 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:42.847215 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4148fc-ef24-4020-a254-234555da6488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:42.847902 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4148fc-ef24-4020-a254-234555da6488 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:42.848186 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4148fc-ef24-4020-a254-234555da6488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:42.848462 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4148fc-ef24-4020-a254-234555da6488 admin admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:42.849173 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4148fc-ef24-4020-a254-234555da6488 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:42.851127 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4148fc-ef24-4020-a254-234555da6488 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:42.874687 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 940/1885] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:38:42 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 17:38:42.880566 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae63223-b553-4569-a6a1-f772df0f814e admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:42.892944 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae63223-b553-4569-a6a1-f772df0f814e admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:42.897920 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9562fd-e0db-4c68-8f56-4ded29171e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:42.898678 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9562fd-e0db-4c68-8f56-4ded29171e12 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:42.898965 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9562fd-e0db-4c68-8f56-4ded29171e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:42.899271 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9562fd-e0db-4c68-8f56-4ded29171e12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:42.900037 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9562fd-e0db-4c68-8f56-4ded29171e12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:42.901883 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9562fd-e0db-4c68-8f56-4ded29171e12 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:42.915460 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 946/1886] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 17:38:42.920634 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4148fc-ef24-4020-a254-234555da6488 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:42.931970 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4148fc-ef24-4020-a254-234555da6488 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:42.936953 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98026b-51c8-47ae-9695-ad4f95b04ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:42.937946 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98026b-51c8-47ae-9695-ad4f95b04ec8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:42.938232 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98026b-51c8-47ae-9695-ad4f95b04ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:42.938506 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98026b-51c8-47ae-9695-ad4f95b04ec8 admin admin] PATH_INFO: `/v3/projects/53b5bb8165324d4fa92867c3ada87424/users/0f894814efcb4e32af8076a28245ca81/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:42.956731 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98026b-51c8-47ae-9695-ad4f95b04ec8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53b5bb8165324d4fa92867c3ada87424, user_id=0f894814efcb4e32af8076a28245ca81, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:42.959576 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98026b-51c8-47ae-9695-ad4f95b04ec8 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:42.976497 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 941/1887] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:38:42 2022] PUT /identity/v3/projects/53b5bb8165324d4fa92867c3ada87424/users/0f894814efcb4e32af8076a28245ca81/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:42.981277 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9562fd-e0db-4c68-8f56-4ded29171e12 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:42.992230 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9562fd-e0db-4c68-8f56-4ded29171e12 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:43.039010 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:43.054959 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f17ac4-ee90-49ae-9ac1-e21558685d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:43.055666 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f17ac4-ee90-49ae-9ac1-e21558685d9e admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:43.055951 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f17ac4-ee90-49ae-9ac1-e21558685d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:43.056221 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f17ac4-ee90-49ae-9ac1-e21558685d9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:43.057254 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f17ac4-ee90-49ae-9ac1-e21558685d9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:43.064522 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f17ac4-ee90-49ae-9ac1-e21558685d9e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:43.083496 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 947/1888] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:38:43.088177 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98026b-51c8-47ae-9695-ad4f95b04ec8 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:43.100085 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98026b-51c8-47ae-9695-ad4f95b04ec8 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:43.106863 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9880341b-0175-447f-a3cb-42e5dcfa27de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:43.106863 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880341b-0175-447f-a3cb-42e5dcfa27de admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:43.106863 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880341b-0175-447f-a3cb-42e5dcfa27de admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:43.107223 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880341b-0175-447f-a3cb-42e5dcfa27de admin admin] PATH_INFO: `/v3/projects/53b5bb8165324d4fa92867c3ada87424/users/0f894814efcb4e32af8076a28245ca81/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:43.109353 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9880341b-0175-447f-a3cb-42e5dcfa27de admin admin] RBAC: Authorizing `identity:create_grant(project_id=53b5bb8165324d4fa92867c3ada87424, user_id=0f894814efcb4e32af8076a28245ca81, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:43.112701 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9880341b-0175-447f-a3cb-42e5dcfa27de admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:43.127847 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 942/1889] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:38:43 2022] PUT /identity/v3/projects/53b5bb8165324d4fa92867c3ada87424/users/0f894814efcb4e32af8076a28245ca81/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:43.139300 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa377ff-3272-4065-adbb-c53763fd7cb0 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:43.139621 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa377ff-3272-4065-adbb-c53763fd7cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:43.139909 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa377ff-3272-4065-adbb-c53763fd7cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:43.173720 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-baa377ff-3272-4065-adbb-c53763fd7cb0 None None] MFA Rules not processed for user `0f894814efcb4e32af8076a28245ca81`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:43.175978 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-baa377ff-3272-4065-adbb-c53763fd7cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:43.270097 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 948/1890] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:43 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:43.281167 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9880341b-0175-447f-a3cb-42e5dcfa27de admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:43.283085 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-9880341b-0175-447f-a3cb-42e5dcfa27de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:43.356859 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9880341b-0175-447f-a3cb-42e5dcfa27de admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:43.360555 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb3da3f-0018-4d01-8ed4-70b8a6346edd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:43.361218 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3da3f-0018-4d01-8ed4-70b8a6346edd service cinder] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:43.361501 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3da3f-0018-4d01-8ed4-70b8a6346edd service cinder] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:43.361799 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3da3f-0018-4d01-8ed4-70b8a6346edd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:43.381160 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:43.423131 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb3da3f-0018-4d01-8ed4-70b8a6346edd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:43.424580 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb3da3f-0018-4d01-8ed4-70b8a6346edd service cinder] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:43.434581 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 943/1891] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:38:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:38:43.977273 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa377ff-3272-4065-adbb-c53763fd7cb0 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:43.981358 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-baa377ff-3272-4065-adbb-c53763fd7cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:44.084920 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa377ff-3272-4065-adbb-c53763fd7cb0 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:44.089797 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35063bc1-9e51-4655-a9df-1f941e835e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:44.090715 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35063bc1-9e51-4655-a9df-1f941e835e31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:44.090995 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35063bc1-9e51-4655-a9df-1f941e835e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:44.091421 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35063bc1-9e51-4655-a9df-1f941e835e31 admin admin] PATH_INFO: `/v3/users/30b118c368b0400ea15b61559dc5c0d8` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:44.092883 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35063bc1-9e51-4655-a9df-1f941e835e31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30b118c368b0400ea15b61559dc5c0d8)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:44.094888 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35063bc1-9e51-4655-a9df-1f941e835e31 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:44.164049 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-35063bc1-9e51-4655-a9df-1f941e835e31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30b118c368b0400ea15b61559dc5c0d8'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:44.164888 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-35063bc1-9e51-4655-a9df-1f941e835e31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30b118c368b0400ea15b61559dc5c0d8'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:44.178538 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-35063bc1-9e51-4655-a9df-1f941e835e31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30b118c368b0400ea15b61559dc5c0d8'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:44.194864 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:44.198217 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-35063bc1-9e51-4655-a9df-1f941e835e31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30b118c368b0400ea15b61559dc5c0d8'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:44.218987 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-35063bc1-9e51-4655-a9df-1f941e835e31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30b118c368b0400ea15b61559dc5c0d8'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:44.232924 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 949/1892] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:38:43 2022] DELETE /identity/v3/users/30b118c368b0400ea15b61559dc5c0d8 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:44.237977 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15a7fc-2e79-40e2-8322-04eafa8f3086 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:44.238156 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15a7fc-2e79-40e2-8322-04eafa8f3086 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:44.238554 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15a7fc-2e79-40e2-8322-04eafa8f3086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:44.264777 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-3e15a7fc-2e79-40e2-8322-04eafa8f3086 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:44.267697 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-3e15a7fc-2e79-40e2-8322-04eafa8f3086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:44.397311 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 944/1893] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:44.412771 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35063bc1-9e51-4655-a9df-1f941e835e31 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:44.414205 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-35063bc1-9e51-4655-a9df-1f941e835e31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:44.507648 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35063bc1-9e51-4655-a9df-1f941e835e31 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:44.511660 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904331a-8229-4c55-90b0-87b3786c412c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:44.512357 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904331a-8229-4c55-90b0-87b3786c412c service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:44.512579 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904331a-8229-4c55-90b0-87b3786c412c service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:44.512848 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904331a-8229-4c55-90b0-87b3786c412c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:44.527102 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0904331a-8229-4c55-90b0-87b3786c412c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:44.528736 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0904331a-8229-4c55-90b0-87b3786c412c service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:44.544836 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 950/1894] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:38:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:38:44.898397 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e15a7fc-2e79-40e2-8322-04eafa8f3086 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:44.900800 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-3e15a7fc-2e79-40e2-8322-04eafa8f3086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:44.918825 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e15a7fc-2e79-40e2-8322-04eafa8f3086 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:44.925433 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a69040-eb81-46d9-a096-b98f571af51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:44.926288 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a69040-eb81-46d9-a096-b98f571af51e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:44.926446 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a69040-eb81-46d9-a096-b98f571af51e admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:44.927090 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a69040-eb81-46d9-a096-b98f571af51e admin admin] PATH_INFO: `/v3/projects/aee9e879174f4366a882d863fd1a05f2` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:44.928440 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a69040-eb81-46d9-a096-b98f571af51e admin admin] RBAC: Authorizing `identity:delete_project(project_id=aee9e879174f4366a882d863fd1a05f2)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:44.930516 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a69040-eb81-46d9-a096-b98f571af51e admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:44.988326 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-21a69040-eb81-46d9-a096-b98f571af51e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aee9e879174f4366a882d863fd1a05f2', 'request_id': 'req-21a69040-eb81-46d9-a096-b98f571af51e'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:44.996705 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-21a69040-eb81-46d9-a096-b98f571af51e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aee9e879174f4366a882d863fd1a05f2', 'request_id': 'req-21a69040-eb81-46d9-a096-b98f571af51e'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:45.002336 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-21a69040-eb81-46d9-a096-b98f571af51e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aee9e879174f4366a882d863fd1a05f2', 'request_id': 'req-21a69040-eb81-46d9-a096-b98f571af51e'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:45.014620 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-21a69040-eb81-46d9-a096-b98f571af51e admin admin] The token cache is being invalidate because project aee9e879174f4366a882d863fd1a05f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80150) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:38:45.014907 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-21a69040-eb81-46d9-a096-b98f571af51e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:45.015878 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-21a69040-eb81-46d9-a096-b98f571af51e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:45.017121 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 945/1895] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:38:44 2022] DELETE /identity/v3/projects/aee9e879174f4366a882d863fd1a05f2 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:45.022690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a768a-5542-46b3-8ea0-5ebeccc06879 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:45.023200 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a768a-5542-46b3-8ea0-5ebeccc06879 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:45.023291 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a768a-5542-46b3-8ea0-5ebeccc06879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:45.043107 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-7d1a768a-5542-46b3-8ea0-5ebeccc06879 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:45.044295 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7d1a768a-5542-46b3-8ea0-5ebeccc06879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:45.107605 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 951/1896] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:45.117569 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84522eaa-db47-42de-9bca-be0ce070df24 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:45.117876 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84522eaa-db47-42de-9bca-be0ce070df24 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:45.118153 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84522eaa-db47-42de-9bca-be0ce070df24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:45.137128 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-84522eaa-db47-42de-9bca-be0ce070df24 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:45.138401 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-84522eaa-db47-42de-9bca-be0ce070df24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:45.149250 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 946/1897] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:45.154082 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a768a-5542-46b3-8ea0-5ebeccc06879 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:45.164373 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a768a-5542-46b3-8ea0-5ebeccc06879 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:45.169692 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a198898-f40b-44fb-8c29-2f569beb7611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:45.170400 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a198898-f40b-44fb-8c29-2f569beb7611 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:45.170686 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a198898-f40b-44fb-8c29-2f569beb7611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:45.170964 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a198898-f40b-44fb-8c29-2f569beb7611 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:45.171705 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a198898-f40b-44fb-8c29-2f569beb7611 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:38:45.172014 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a198898-f40b-44fb-8c29-2f569beb7611 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:45.173645 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a198898-f40b-44fb-8c29-2f569beb7611 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:45.186611 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 952/1898] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:38:45.191446 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84522eaa-db47-42de-9bca-be0ce070df24 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:45.206052 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84522eaa-db47-42de-9bca-be0ce070df24 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:45.213453 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec0640-b14e-4ba0-b0c6-60bdb0e7dac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:45.214178 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec0640-b14e-4ba0-b0c6-60bdb0e7dac1 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:45.214462 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec0640-b14e-4ba0-b0c6-60bdb0e7dac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:45.214739 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec0640-b14e-4ba0-b0c6-60bdb0e7dac1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:45.215497 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dec0640-b14e-4ba0-b0c6-60bdb0e7dac1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:45.217487 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dec0640-b14e-4ba0-b0c6-60bdb0e7dac1 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:45.248876 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 947/1899] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:38:45 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:38:45.253222 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a198898-f40b-44fb-8c29-2f569beb7611 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:45.263734 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a198898-f40b-44fb-8c29-2f569beb7611 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:45.333230 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3721e-f3ea-44aa-a594-f80b2ce52e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:45.333953 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3721e-f3ea-44aa-a594-f80b2ce52e48 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:45.334239 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3721e-f3ea-44aa-a594-f80b2ce52e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:45.334516 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3721e-f3ea-44aa-a594-f80b2ce52e48 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:45.335237 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe3721e-f3ea-44aa-a594-f80b2ce52e48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:45.337162 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe3721e-f3ea-44aa-a594-f80b2ce52e48 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:45.359507 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 953/1900] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:38:45 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 17:38:45.363927 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec0640-b14e-4ba0-b0c6-60bdb0e7dac1 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:45.374985 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec0640-b14e-4ba0-b0c6-60bdb0e7dac1 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:45.380273 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe770b-f544-453d-9747-c048aa83af2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:45.381061 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe770b-f544-453d-9747-c048aa83af2a admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:45.381281 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe770b-f544-453d-9747-c048aa83af2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:45.381549 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe770b-f544-453d-9747-c048aa83af2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:45.382311 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe770b-f544-453d-9747-c048aa83af2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:45.383943 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe770b-f544-453d-9747-c048aa83af2a admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:45.397512 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 948/1901] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 17:38:45.401979 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3721e-f3ea-44aa-a594-f80b2ce52e48 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:45.413676 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3721e-f3ea-44aa-a594-f80b2ce52e48 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:45.419805 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2f1a9-5d13-489e-9e40-1ac2f491b201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:45.420653 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2f1a9-5d13-489e-9e40-1ac2f491b201 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:45.421065 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2f1a9-5d13-489e-9e40-1ac2f491b201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:45.421348 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2f1a9-5d13-489e-9e40-1ac2f491b201 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:45.422116 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa2f1a9-5d13-489e-9e40-1ac2f491b201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:45.423720 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa2f1a9-5d13-489e-9e40-1ac2f491b201 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:45.425577 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:45.439491 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 954/1902] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:38:45.443693 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe770b-f544-453d-9747-c048aa83af2a admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:45.455406 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:45.457529 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe770b-f544-453d-9747-c048aa83af2a admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:45.463407 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bcf3a-d8c2-4e4f-ab5f-382794e5b73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:45.464398 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bcf3a-d8c2-4e4f-ab5f-382794e5b73b admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:45.464881 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bcf3a-d8c2-4e4f-ab5f-382794e5b73b admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:45.465302 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bcf3a-d8c2-4e4f-ab5f-382794e5b73b admin admin] PATH_INFO: `/v3/projects/2e40700337b44957981c2e0f25069237/users/fbdb40c18ed24ab1916af7d136743090/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:45.483365 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572bcf3a-d8c2-4e4f-ab5f-382794e5b73b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e40700337b44957981c2e0f25069237, user_id=fbdb40c18ed24ab1916af7d136743090, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:45.488228 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572bcf3a-d8c2-4e4f-ab5f-382794e5b73b admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:45.519987 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 949/1903] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:38:45 2022] PUT /identity/v3/projects/2e40700337b44957981c2e0f25069237/users/fbdb40c18ed24ab1916af7d136743090/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:45.530935 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a1260-8bf1-42f2-a8a2-ad60fb891ed4 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:45.531227 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a1260-8bf1-42f2-a8a2-ad60fb891ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:45.531570 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a1260-8bf1-42f2-a8a2-ad60fb891ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:45.560486 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-663a1260-8bf1-42f2-a8a2-ad60fb891ed4 None None] MFA Rules not processed for user `fbdb40c18ed24ab1916af7d136743090`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:45.561710 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-663a1260-8bf1-42f2-a8a2-ad60fb891ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:45.647721 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 955/1904] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:45.652914 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bcf3a-d8c2-4e4f-ab5f-382794e5b73b admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:45.733166 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bcf3a-d8c2-4e4f-ab5f-382794e5b73b admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:45.737830 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369caaf-cce2-4cca-be65-2d36bf0ee2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:45.738519 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369caaf-cce2-4cca-be65-2d36bf0ee2fb admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:45.738795 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369caaf-cce2-4cca-be65-2d36bf0ee2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:45.739068 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369caaf-cce2-4cca-be65-2d36bf0ee2fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:45.739786 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7369caaf-cce2-4cca-be65-2d36bf0ee2fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:45.741905 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7369caaf-cce2-4cca-be65-2d36bf0ee2fb admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:45.771518 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 950/1905] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:38:45 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:38:45.776063 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a1260-8bf1-42f2-a8a2-ad60fb891ed4 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:45.788000 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a1260-8bf1-42f2-a8a2-ad60fb891ed4 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:45.849333 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc11ce-18fa-497f-9d0d-aaf180591397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:45.850056 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc11ce-18fa-497f-9d0d-aaf180591397 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:45.850337 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc11ce-18fa-497f-9d0d-aaf180591397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:45.850611 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc11ce-18fa-497f-9d0d-aaf180591397 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:45.851297 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cc11ce-18fa-497f-9d0d-aaf180591397 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:45.853371 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cc11ce-18fa-497f-9d0d-aaf180591397 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:45.879264 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 956/1906] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:38:45 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:38:45.880490 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369caaf-cce2-4cca-be65-2d36bf0ee2fb admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:45.891353 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369caaf-cce2-4cca-be65-2d36bf0ee2fb admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:45.896293 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed51da-d42e-4511-b53a-e017ae34e066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:45.896980 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed51da-d42e-4511-b53a-e017ae34e066 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:45.897265 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed51da-d42e-4511-b53a-e017ae34e066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:45.897544 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed51da-d42e-4511-b53a-e017ae34e066 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:45.898324 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ed51da-d42e-4511-b53a-e017ae34e066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:45.899946 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ed51da-d42e-4511-b53a-e017ae34e066 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:45.911773 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 951/1907] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:38:45.916001 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc11ce-18fa-497f-9d0d-aaf180591397 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:45.926640 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc11ce-18fa-497f-9d0d-aaf180591397 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:45.936037 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b00a5e-e796-490d-96b1-a6e9bceac1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:45.936720 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b00a5e-e796-490d-96b1-a6e9bceac1ff admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:45.936998 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b00a5e-e796-490d-96b1-a6e9bceac1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:45.937272 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b00a5e-e796-490d-96b1-a6e9bceac1ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:45.938048 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b00a5e-e796-490d-96b1-a6e9bceac1ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:45.939648 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b00a5e-e796-490d-96b1-a6e9bceac1ff admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:45.951793 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 957/1908] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:38:45.956174 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed51da-d42e-4511-b53a-e017ae34e066 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:45.967377 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed51da-d42e-4511-b53a-e017ae34e066 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:45.972395 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fcc0f5-1843-4c40-a838-3d22c56c3334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:45.973374 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fcc0f5-1843-4c40-a838-3d22c56c3334 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:45.973727 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fcc0f5-1843-4c40-a838-3d22c56c3334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:45.974177 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fcc0f5-1843-4c40-a838-3d22c56c3334 admin admin] PATH_INFO: `/v3/projects/e413f35310d54363aeb057d7d6d37b77/users/70368036381b4064bfd42d6f1987d334/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:45.990199 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fcc0f5-1843-4c40-a838-3d22c56c3334 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e413f35310d54363aeb057d7d6d37b77, user_id=70368036381b4064bfd42d6f1987d334, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:45.992839 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fcc0f5-1843-4c40-a838-3d22c56c3334 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:46.007862 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 952/1909] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:38:45 2022] PUT /identity/v3/projects/e413f35310d54363aeb057d7d6d37b77/users/70368036381b4064bfd42d6f1987d334/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:46.018193 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7c821-83e4-40b5-8613-2fa938c4f547 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:46.018483 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7c821-83e4-40b5-8613-2fa938c4f547 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:46.018757 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7c821-83e4-40b5-8613-2fa938c4f547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:46.047111 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-58f7c821-83e4-40b5-8613-2fa938c4f547 None None] MFA Rules not processed for user `70368036381b4064bfd42d6f1987d334`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:46.048328 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-58f7c821-83e4-40b5-8613-2fa938c4f547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:46.105825 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fcc0f5-1843-4c40-a838-3d22c56c3334 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:46.107730 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-41fcc0f5-1843-4c40-a838-3d22c56c3334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:46.110249 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:46.129598 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 958/1910] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:46.133667 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7c821-83e4-40b5-8613-2fa938c4f547 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:46.204874 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fcc0f5-1843-4c40-a838-3d22c56c3334 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:46.210472 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf5fc41-4465-4d41-ad96-4ae36e787dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:46.211646 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5fc41-4465-4d41-ad96-4ae36e787dca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:46.212114 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5fc41-4465-4d41-ad96-4ae36e787dca admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:46.212748 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5fc41-4465-4d41-ad96-4ae36e787dca admin admin] PATH_INFO: `/v3/users/a3e242f70e7b4ba993b8cdce387dbbb3` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:46.214554 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf5fc41-4465-4d41-ad96-4ae36e787dca admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3e242f70e7b4ba993b8cdce387dbbb3)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:46.214721 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7c821-83e4-40b5-8613-2fa938c4f547 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:46.217849 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf5fc41-4465-4d41-ad96-4ae36e787dca admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:46.219890 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c628d-2aba-4727-bd55-da66ae2299a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:46.220919 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c628d-2aba-4727-bd55-da66ae2299a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:46.221526 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c628d-2aba-4727-bd55-da66ae2299a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:46.222211 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c628d-2aba-4727-bd55-da66ae2299a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:46.222987 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8c628d-2aba-4727-bd55-da66ae2299a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:46.225706 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8c628d-2aba-4727-bd55-da66ae2299a6 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:46.260054 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 959/1911] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:38:46 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:38:46.264146 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c628d-2aba-4727-bd55-da66ae2299a6 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:46.272338 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:46.287734 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-eaf5fc41-4465-4d41-ad96-4ae36e787dca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3e242f70e7b4ba993b8cdce387dbbb3'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:46.288043 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-eaf5fc41-4465-4d41-ad96-4ae36e787dca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3e242f70e7b4ba993b8cdce387dbbb3'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:46.296073 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-eaf5fc41-4465-4d41-ad96-4ae36e787dca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3e242f70e7b4ba993b8cdce387dbbb3'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:46.297559 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-eaf5fc41-4465-4d41-ad96-4ae36e787dca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3e242f70e7b4ba993b8cdce387dbbb3'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:46.310875 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-eaf5fc41-4465-4d41-ad96-4ae36e787dca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3e242f70e7b4ba993b8cdce387dbbb3'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:46.334967 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 953/1912] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:38:46 2022] DELETE /identity/v3/users/a3e242f70e7b4ba993b8cdce387dbbb3 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:38:46.339315 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5aa65d-5edc-40f0-983e-815dc8185632 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:46.339843 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5aa65d-5edc-40f0-983e-815dc8185632 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:46.340497 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5aa65d-5edc-40f0-983e-815dc8185632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:46.358318 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c628d-2aba-4727-bd55-da66ae2299a6 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:46.363935 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-9e5aa65d-5edc-40f0-983e-815dc8185632 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:46.365276 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-9e5aa65d-5edc-40f0-983e-815dc8185632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:46.426377 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6138acf-d842-40a7-b715-c0704c1da1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:46.427066 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6138acf-d842-40a7-b715-c0704c1da1bb admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:46.427349 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6138acf-d842-40a7-b715-c0704c1da1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:46.427626 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6138acf-d842-40a7-b715-c0704c1da1bb admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:46.428330 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6138acf-d842-40a7-b715-c0704c1da1bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:46.430336 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6138acf-d842-40a7-b715-c0704c1da1bb admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:46.440695 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 954/1913] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:38:46.451902 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5aa65d-5edc-40f0-983e-815dc8185632 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:46.455629 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 960/1914] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:38:46 2022] POST /identity/v3/users => generated 299 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:38:46.455775 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-9e5aa65d-5edc-40f0-983e-815dc8185632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:46.456580 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6138acf-d842-40a7-b715-c0704c1da1bb admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:46.458154 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b6138acf-d842-40a7-b715-c0704c1da1bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:46.469505 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6138acf-d842-40a7-b715-c0704c1da1bb admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:46.474053 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02b26f-d37b-4963-ad07-5d5f388f7012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:46.474712 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02b26f-d37b-4963-ad07-5d5f388f7012 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:46.475000 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02b26f-d37b-4963-ad07-5d5f388f7012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:46.475270 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02b26f-d37b-4963-ad07-5d5f388f7012 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:46.475993 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02b26f-d37b-4963-ad07-5d5f388f7012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:46.477595 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02b26f-d37b-4963-ad07-5d5f388f7012 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:46.490676 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 961/1915] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 17:38:46.491657 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02b26f-d37b-4963-ad07-5d5f388f7012 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:46.497753 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:46.501645 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02b26f-d37b-4963-ad07-5d5f388f7012 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:46.507558 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b886ea7-1779-4620-a318-a04f8e94b4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:46.508451 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b886ea7-1779-4620-a318-a04f8e94b4db admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:46.508761 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b886ea7-1779-4620-a318-a04f8e94b4db admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:46.509005 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b886ea7-1779-4620-a318-a04f8e94b4db admin admin] PATH_INFO: `/v3/projects/fe172c58ef694c5192e595349157e698/users/3d3a9c1eae60422daca92e0d7de7c4cb/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:46.512077 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5aa65d-5edc-40f0-983e-815dc8185632 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:46.515641 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47570510-e2d3-487b-947c-dc9a71ac201a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:46.516297 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47570510-e2d3-487b-947c-dc9a71ac201a service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:46.516580 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47570510-e2d3-487b-947c-dc9a71ac201a service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:46.516853 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47570510-e2d3-487b-947c-dc9a71ac201a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:46.524596 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b886ea7-1779-4620-a318-a04f8e94b4db admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe172c58ef694c5192e595349157e698, user_id=3d3a9c1eae60422daca92e0d7de7c4cb, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:46.527443 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b886ea7-1779-4620-a318-a04f8e94b4db admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:46.537234 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47570510-e2d3-487b-947c-dc9a71ac201a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:46.538757 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47570510-e2d3-487b-947c-dc9a71ac201a service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:46.543800 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 962/1916] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:38:46 2022] PUT /identity/v3/projects/fe172c58ef694c5192e595349157e698/users/3d3a9c1eae60422daca92e0d7de7c4cb/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:38:46.547507 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b886ea7-1779-4620-a318-a04f8e94b4db admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:46.549162 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-4b886ea7-1779-4620-a318-a04f8e94b4db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:46.550919 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 955/1917] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:38:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 17:38:46.551601 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47570510-e2d3-487b-947c-dc9a71ac201a service neutron] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:46.562127 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47570510-e2d3-487b-947c-dc9a71ac201a service neutron] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:46.621114 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:46.626593 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b886ea7-1779-4620-a318-a04f8e94b4db admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:46.632485 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca866f52-3c31-4ea6-9e9d-b80bcaa9bcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:46.633498 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca866f52-3c31-4ea6-9e9d-b80bcaa9bcb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:46.633846 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca866f52-3c31-4ea6-9e9d-b80bcaa9bcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:46.634264 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca866f52-3c31-4ea6-9e9d-b80bcaa9bcb9 admin admin] PATH_INFO: `/v3/users/8973f7162f6a47ec9c8b4c9783dd7316` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:46.635180 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a3bf7-1fc3-46a4-9591-74f65fbb770d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:46.635619 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca866f52-3c31-4ea6-9e9d-b80bcaa9bcb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8973f7162f6a47ec9c8b4c9783dd7316)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:46.636077 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a3bf7-1fc3-46a4-9591-74f65fbb770d admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:46.636423 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a3bf7-1fc3-46a4-9591-74f65fbb770d admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:46.636818 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a3bf7-1fc3-46a4-9591-74f65fbb770d admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:46.637663 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca866f52-3c31-4ea6-9e9d-b80bcaa9bcb9 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:46.638295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a3bf7-1fc3-46a4-9591-74f65fbb770d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:46.640859 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a3bf7-1fc3-46a4-9591-74f65fbb770d admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:46.657973 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 956/1918] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:38:46.662773 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a3bf7-1fc3-46a4-9591-74f65fbb770d admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:46.677290 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a3bf7-1fc3-46a4-9591-74f65fbb770d admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:46.688025 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8d2ca-3765-448d-8965-fdd12b03f5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:46.689373 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8d2ca-3765-448d-8965-fdd12b03f5cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:46.689712 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8d2ca-3765-448d-8965-fdd12b03f5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:46.690133 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8d2ca-3765-448d-8965-fdd12b03f5cf admin admin] PATH_INFO: `/v3/projects/fe172c58ef694c5192e595349157e698/users/3d3a9c1eae60422daca92e0d7de7c4cb/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:46.692666 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8d2ca-3765-448d-8965-fdd12b03f5cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe172c58ef694c5192e595349157e698, user_id=3d3a9c1eae60422daca92e0d7de7c4cb, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:46.696307 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8d2ca-3765-448d-8965-fdd12b03f5cf admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:46.711811 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-ca866f52-3c31-4ea6-9e9d-b80bcaa9bcb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8973f7162f6a47ec9c8b4c9783dd7316'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:46.712868 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-ca866f52-3c31-4ea6-9e9d-b80bcaa9bcb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8973f7162f6a47ec9c8b4c9783dd7316'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:46.717894 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 957/1919] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:38:46 2022] PUT /identity/v3/projects/fe172c58ef694c5192e595349157e698/users/3d3a9c1eae60422daca92e0d7de7c4cb/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:46.726296 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471c195-5987-461c-a3b6-d4b427f1ff94 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:46.727571 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471c195-5987-461c-a3b6-d4b427f1ff94 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:46.728027 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471c195-5987-461c-a3b6-d4b427f1ff94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:46.732043 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-ca866f52-3c31-4ea6-9e9d-b80bcaa9bcb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8973f7162f6a47ec9c8b4c9783dd7316'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:46.753284 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-ca866f52-3c31-4ea6-9e9d-b80bcaa9bcb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8973f7162f6a47ec9c8b4c9783dd7316'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:46.765188 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-ca866f52-3c31-4ea6-9e9d-b80bcaa9bcb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8973f7162f6a47ec9c8b4c9783dd7316'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:46.766283 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-8471c195-5987-461c-a3b6-d4b427f1ff94 None None] MFA Rules not processed for user `3d3a9c1eae60422daca92e0d7de7c4cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:46.769232 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-8471c195-5987-461c-a3b6-d4b427f1ff94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:46.773560 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 963/1920] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:38:46 2022] DELETE /identity/v3/users/8973f7162f6a47ec9c8b4c9783dd7316 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:46.778971 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca65dd-f575-4b65-ba4e-a243771c1bb8 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:46.779314 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca65dd-f575-4b65-ba4e-a243771c1bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:46.779645 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca65dd-f575-4b65-ba4e-a243771c1bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:46.814520 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-22ca65dd-f575-4b65-ba4e-a243771c1bb8 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:46.815781 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-22ca65dd-f575-4b65-ba4e-a243771c1bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:46.866313 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 958/1921] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:46 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:46.879523 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471c195-5987-461c-a3b6-d4b427f1ff94 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:46.881407 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-8471c195-5987-461c-a3b6-d4b427f1ff94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:46.896128 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:46.908238 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 964/1922] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:38:46.909247 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca65dd-f575-4b65-ba4e-a243771c1bb8 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:46.911276 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-22ca65dd-f575-4b65-ba4e-a243771c1bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:46.927029 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca65dd-f575-4b65-ba4e-a243771c1bb8 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:46.934287 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d87487-bef0-4fa1-8d2c-42c0a9db64d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:46.935133 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d87487-bef0-4fa1-8d2c-42c0a9db64d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:46.935412 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d87487-bef0-4fa1-8d2c-42c0a9db64d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:46.935698 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d87487-bef0-4fa1-8d2c-42c0a9db64d6 admin admin] PATH_INFO: `/v3/projects/dea0ada0e30147a0b95cf6915f518e62` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:46.936982 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d87487-bef0-4fa1-8d2c-42c0a9db64d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dea0ada0e30147a0b95cf6915f518e62)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:46.938936 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d87487-bef0-4fa1-8d2c-42c0a9db64d6 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:46.958336 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471c195-5987-461c-a3b6-d4b427f1ff94 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:46.962285 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe219e67-d7e4-4f42-96ef-afe3b25004bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:46.962727 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe219e67-d7e4-4f42-96ef-afe3b25004bd service cinder] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:46.963020 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe219e67-d7e4-4f42-96ef-afe3b25004bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:46.963268 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe219e67-d7e4-4f42-96ef-afe3b25004bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:46.965299 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-fe219e67-d7e4-4f42-96ef-afe3b25004bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:46.988872 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-b5d87487-bef0-4fa1-8d2c-42c0a9db64d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dea0ada0e30147a0b95cf6915f518e62', 'request_id': 'req-b5d87487-bef0-4fa1-8d2c-42c0a9db64d6'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:46.998737 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-b5d87487-bef0-4fa1-8d2c-42c0a9db64d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dea0ada0e30147a0b95cf6915f518e62', 'request_id': 'req-b5d87487-bef0-4fa1-8d2c-42c0a9db64d6'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:47.004668 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-b5d87487-bef0-4fa1-8d2c-42c0a9db64d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dea0ada0e30147a0b95cf6915f518e62', 'request_id': 'req-b5d87487-bef0-4fa1-8d2c-42c0a9db64d6'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:47.017291 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-b5d87487-bef0-4fa1-8d2c-42c0a9db64d6 admin admin] The token cache is being invalidate because project dea0ada0e30147a0b95cf6915f518e62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:38:47.017672 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-b5d87487-bef0-4fa1-8d2c-42c0a9db64d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:47.018426 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-b5d87487-bef0-4fa1-8d2c-42c0a9db64d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:47.020103 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 965/1923] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:38:46 2022] DELETE /identity/v3/projects/dea0ada0e30147a0b95cf6915f518e62 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:47.023123 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d87487-bef0-4fa1-8d2c-42c0a9db64d6 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:47.023123 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b5d87487-bef0-4fa1-8d2c-42c0a9db64d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:47.028554 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe219e67-d7e4-4f42-96ef-afe3b25004bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:47.030110 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe219e67-d7e4-4f42-96ef-afe3b25004bd service cinder] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:47.039575 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 959/1924] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:38:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 17:38:47.040173 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe219e67-d7e4-4f42-96ef-afe3b25004bd service cinder] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:47.051692 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe219e67-d7e4-4f42-96ef-afe3b25004bd service cinder] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:47.084554 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:47.100735 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d87487-bef0-4fa1-8d2c-42c0a9db64d6 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:47.112815 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff99201-cd3a-46b0-9dd5-451df9032227 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:47.114392 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff99201-cd3a-46b0-9dd5-451df9032227 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:47.114793 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff99201-cd3a-46b0-9dd5-451df9032227 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:47.115283 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff99201-cd3a-46b0-9dd5-451df9032227 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:47.118491 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-4ff99201-cd3a-46b0-9dd5-451df9032227 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:47.155802 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e88540-86fd-4591-a02a-2c9a2c07a923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:47.170340 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e88540-86fd-4591-a02a-2c9a2c07a923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:47.170340 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e88540-86fd-4591-a02a-2c9a2c07a923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:47.170340 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e88540-86fd-4591-a02a-2c9a2c07a923 admin admin] PATH_INFO: `/v3/users/0f894814efcb4e32af8076a28245ca81` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:47.170340 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e88540-86fd-4591-a02a-2c9a2c07a923 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f894814efcb4e32af8076a28245ca81)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:47.170340 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e88540-86fd-4591-a02a-2c9a2c07a923 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:47.243762 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-b9e88540-86fd-4591-a02a-2c9a2c07a923 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f894814efcb4e32af8076a28245ca81'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:47.244758 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-b9e88540-86fd-4591-a02a-2c9a2c07a923 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f894814efcb4e32af8076a28245ca81'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:47.252310 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-b9e88540-86fd-4591-a02a-2c9a2c07a923 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f894814efcb4e32af8076a28245ca81'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:47.253020 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-b9e88540-86fd-4591-a02a-2c9a2c07a923 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f894814efcb4e32af8076a28245ca81'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:47.262399 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff99201-cd3a-46b0-9dd5-451df9032227 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:47.263860 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff99201-cd3a-46b0-9dd5-451df9032227 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:47.266088 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-b9e88540-86fd-4591-a02a-2c9a2c07a923 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f894814efcb4e32af8076a28245ca81'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:47.277290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 966/1925] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:38:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:38:47.290614 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 960/1926] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:38:47 2022] DELETE /identity/v3/users/0f894814efcb4e32af8076a28245ca81 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:47.800149 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff99201-cd3a-46b0-9dd5-451df9032227 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:47.801719 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e88540-86fd-4591-a02a-2c9a2c07a923 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:47.802201 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-4ff99201-cd3a-46b0-9dd5-451df9032227 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:47.803294 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-b9e88540-86fd-4591-a02a-2c9a2c07a923 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:47.816133 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff99201-cd3a-46b0-9dd5-451df9032227 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:47.854043 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:47.886241 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e024fd7-c057-465e-995f-76d482f61676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:47.886808 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e024fd7-c057-465e-995f-76d482f61676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:47.887088 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e024fd7-c057-465e-995f-76d482f61676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:47.887364 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e024fd7-c057-465e-995f-76d482f61676 admin admin] PATH_INFO: `/v3/projects/3f2976dc821641e8a64015997ad31c3d` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:47.888569 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e024fd7-c057-465e-995f-76d482f61676 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f2976dc821641e8a64015997ad31c3d)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:47.890666 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e024fd7-c057-465e-995f-76d482f61676 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:47.912871 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e88540-86fd-4591-a02a-2c9a2c07a923 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:47.917737 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcefca5-e36f-4da5-94d5-4271a910b130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:47.918920 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcefca5-e36f-4da5-94d5-4271a910b130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:47.919413 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcefca5-e36f-4da5-94d5-4271a910b130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:47.919513 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcefca5-e36f-4da5-94d5-4271a910b130 admin admin] PATH_INFO: `/v3/projects/53b5bb8165324d4fa92867c3ada87424` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:47.920718 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcefca5-e36f-4da5-94d5-4271a910b130 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53b5bb8165324d4fa92867c3ada87424)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:47.922710 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcefca5-e36f-4da5-94d5-4271a910b130 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:47.947459 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5e024fd7-c057-465e-995f-76d482f61676 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f2976dc821641e8a64015997ad31c3d', 'request_id': 'req-5e024fd7-c057-465e-995f-76d482f61676'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:47.960088 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5e024fd7-c057-465e-995f-76d482f61676 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f2976dc821641e8a64015997ad31c3d', 'request_id': 'req-5e024fd7-c057-465e-995f-76d482f61676'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:47.967153 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5e024fd7-c057-465e-995f-76d482f61676 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f2976dc821641e8a64015997ad31c3d', 'request_id': 'req-5e024fd7-c057-465e-995f-76d482f61676'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:47.970056 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:47.980804 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-5bcefca5-e36f-4da5-94d5-4271a910b130 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53b5bb8165324d4fa92867c3ada87424', 'request_id': 'req-5bcefca5-e36f-4da5-94d5-4271a910b130'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:47.981435 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5e024fd7-c057-465e-995f-76d482f61676 admin admin] The token cache is being invalidate because project 3f2976dc821641e8a64015997ad31c3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:38:47.981686 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5e024fd7-c057-465e-995f-76d482f61676 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:47.982426 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5e024fd7-c057-465e-995f-76d482f61676 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:47.985160 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 967/1927] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:38:47 2022] DELETE /identity/v3/projects/3f2976dc821641e8a64015997ad31c3d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:47.990026 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e024fd7-c057-465e-995f-76d482f61676 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:47.991447 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5e024fd7-c057-465e-995f-76d482f61676 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:47.993030 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-5bcefca5-e36f-4da5-94d5-4271a910b130 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53b5bb8165324d4fa92867c3ada87424', 'request_id': 'req-5bcefca5-e36f-4da5-94d5-4271a910b130'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:48.000167 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-5bcefca5-e36f-4da5-94d5-4271a910b130 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53b5bb8165324d4fa92867c3ada87424', 'request_id': 'req-5bcefca5-e36f-4da5-94d5-4271a910b130'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:48.012772 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-5bcefca5-e36f-4da5-94d5-4271a910b130 admin admin] The token cache is being invalidate because project 53b5bb8165324d4fa92867c3ada87424 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80150) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:38:48.013126 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-5bcefca5-e36f-4da5-94d5-4271a910b130 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:48.013933 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-5bcefca5-e36f-4da5-94d5-4271a910b130 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:48.015624 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 961/1928] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:38:47 2022] DELETE /identity/v3/projects/53b5bb8165324d4fa92867c3ada87424 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:48.020913 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe50e77-2237-4fb4-a06d-40fae010edf6 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:48.021275 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe50e77-2237-4fb4-a06d-40fae010edf6 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:48.029834 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe50e77-2237-4fb4-a06d-40fae010edf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:48.048799 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-fbe50e77-2237-4fb4-a06d-40fae010edf6 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:48.050127 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-fbe50e77-2237-4fb4-a06d-40fae010edf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:48.056290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e024fd7-c057-465e-995f-76d482f61676 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:48.115405 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f5fae-531b-4f00-a94c-0c9a3907b7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:48.122495 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 962/1929] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:38:48.122624 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f5fae-531b-4f00-a94c-0c9a3907b7a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:48.122624 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f5fae-531b-4f00-a94c-0c9a3907b7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:48.122624 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f5fae-531b-4f00-a94c-0c9a3907b7a0 admin admin] PATH_INFO: `/v3/users/98376505d3604210aafbe2e778bdc106` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:48.122624 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f5fae-531b-4f00-a94c-0c9a3907b7a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98376505d3604210aafbe2e778bdc106)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:48.122624 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f5fae-531b-4f00-a94c-0c9a3907b7a0 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:48.131854 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0967a42-a3ce-4d27-96f6-dd56894adf14 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:48.132138 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0967a42-a3ce-4d27-96f6-dd56894adf14 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:48.132419 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0967a42-a3ce-4d27-96f6-dd56894adf14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:48.140356 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:48.162555 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-a0967a42-a3ce-4d27-96f6-dd56894adf14 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:48.164103 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-a0967a42-a3ce-4d27-96f6-dd56894adf14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:48.172931 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 963/1930] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:48.177240 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0967a42-a3ce-4d27-96f6-dd56894adf14 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:48.187040 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-261f5fae-531b-4f00-a94c-0c9a3907b7a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98376505d3604210aafbe2e778bdc106'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:48.187282 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0967a42-a3ce-4d27-96f6-dd56894adf14 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:48.187807 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-261f5fae-531b-4f00-a94c-0c9a3907b7a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98376505d3604210aafbe2e778bdc106'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:48.192180 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c76f367-e85f-4a23-b245-30e4cb195709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:48.192850 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76f367-e85f-4a23-b245-30e4cb195709 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:48.193150 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76f367-e85f-4a23-b245-30e4cb195709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:48.193569 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76f367-e85f-4a23-b245-30e4cb195709 admin admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:48.194392 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c76f367-e85f-4a23-b245-30e4cb195709 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:38:48.194694 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c76f367-e85f-4a23-b245-30e4cb195709 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:48.196408 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c76f367-e85f-4a23-b245-30e4cb195709 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:48.198429 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-261f5fae-531b-4f00-a94c-0c9a3907b7a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98376505d3604210aafbe2e778bdc106'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:48.214725 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 964/1931] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:38:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:38:48.222016 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-261f5fae-531b-4f00-a94c-0c9a3907b7a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98376505d3604210aafbe2e778bdc106'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:48.229398 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c76f367-e85f-4a23-b245-30e4cb195709 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:48.236741 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-261f5fae-531b-4f00-a94c-0c9a3907b7a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98376505d3604210aafbe2e778bdc106'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:48.248210 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 968/1932] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:38:47 2022] DELETE /identity/v3/users/98376505d3604210aafbe2e778bdc106 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:38:48.256904 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c76f367-e85f-4a23-b245-30e4cb195709 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:48.347410 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ffaf8-362a-4fa7-bf38-8959407a2c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:48.348363 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ffaf8-362a-4fa7-bf38-8959407a2c5e admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:48.348813 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ffaf8-362a-4fa7-bf38-8959407a2c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:48.349285 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ffaf8-362a-4fa7-bf38-8959407a2c5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:48.350273 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791ffaf8-362a-4fa7-bf38-8959407a2c5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:48.352399 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791ffaf8-362a-4fa7-bf38-8959407a2c5e admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:48.395579 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 965/1933] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:38:48 2022] POST /identity/v3/projects => generated 369 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:38:48.400092 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f5fae-531b-4f00-a94c-0c9a3907b7a0 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:48.402270 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-261f5fae-531b-4f00-a94c-0c9a3907b7a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:48.416768 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f5fae-531b-4f00-a94c-0c9a3907b7a0 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:48.490245 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996086e2-c6d8-425d-afbc-873e77bce7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:48.491180 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996086e2-c6d8-425d-afbc-873e77bce7c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:48.491544 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996086e2-c6d8-425d-afbc-873e77bce7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:48.491891 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996086e2-c6d8-425d-afbc-873e77bce7c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:48.492682 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996086e2-c6d8-425d-afbc-873e77bce7c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:48.495062 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996086e2-c6d8-425d-afbc-873e77bce7c7 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:48.525586 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 969/1934] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:38:48 2022] POST /identity/v3/users => generated 285 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:38:48.530744 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ffaf8-362a-4fa7-bf38-8959407a2c5e admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:48.545901 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ffaf8-362a-4fa7-bf38-8959407a2c5e admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:48.551013 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c962ce-b8a2-436a-8e68-da0876a748a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:48.552097 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c962ce-b8a2-436a-8e68-da0876a748a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:48.552404 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c962ce-b8a2-436a-8e68-da0876a748a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:48.552694 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c962ce-b8a2-436a-8e68-da0876a748a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:48.553710 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c962ce-b8a2-436a-8e68-da0876a748a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:48.555446 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c962ce-b8a2-436a-8e68-da0876a748a3 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:48.576962 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 966/1935] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:38:48.577062 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996086e2-c6d8-425d-afbc-873e77bce7c7 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:48.586845 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996086e2-c6d8-425d-afbc-873e77bce7c7 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:48.594351 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdaebdd-ed7f-4b95-b750-918ff7cd0139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:48.595113 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdaebdd-ed7f-4b95-b750-918ff7cd0139 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:48.595456 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdaebdd-ed7f-4b95-b750-918ff7cd0139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:48.595793 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdaebdd-ed7f-4b95-b750-918ff7cd0139 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:48.596590 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdaebdd-ed7f-4b95-b750-918ff7cd0139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:48.598283 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdaebdd-ed7f-4b95-b750-918ff7cd0139 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:48.611271 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 970/1936] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 17:38:48.615438 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c962ce-b8a2-436a-8e68-da0876a748a3 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:48.630949 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c962ce-b8a2-436a-8e68-da0876a748a3 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:48.640038 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6124bf8-ee2e-439f-9e95-423a2d00a108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:48.641265 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6124bf8-ee2e-439f-9e95-423a2d00a108 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:48.641622 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6124bf8-ee2e-439f-9e95-423a2d00a108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:48.641948 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6124bf8-ee2e-439f-9e95-423a2d00a108 admin admin] PATH_INFO: `/v3/projects/70594cd6864a4e698b2227e45ab33b65/users/afc6391173d04c2895bfef69225c29c1/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:48.656724 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdaebdd-ed7f-4b95-b750-918ff7cd0139 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:48.658636 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5fdaebdd-ed7f-4b95-b750-918ff7cd0139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:48.661527 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6124bf8-ee2e-439f-9e95-423a2d00a108 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70594cd6864a4e698b2227e45ab33b65, user_id=afc6391173d04c2895bfef69225c29c1, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:48.664642 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6124bf8-ee2e-439f-9e95-423a2d00a108 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:48.668709 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:48.677763 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdaebdd-ed7f-4b95-b750-918ff7cd0139 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:48.689664 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 967/1937] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:38:48 2022] PUT /identity/v3/projects/70594cd6864a4e698b2227e45ab33b65/users/afc6391173d04c2895bfef69225c29c1/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:48.695384 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f21a8c-d247-400c-b655-b4759593519e None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:48.707238 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f21a8c-d247-400c-b655-b4759593519e None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:48.707639 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f21a8c-d247-400c-b655-b4759593519e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:48.735853 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-b2f21a8c-d247-400c-b655-b4759593519e None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:48.737235 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-b2f21a8c-d247-400c-b655-b4759593519e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:48.760163 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d424a0a-f8b0-457c-934d-c272821bdf68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:48.760163 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d424a0a-f8b0-457c-934d-c272821bdf68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:48.760163 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d424a0a-f8b0-457c-934d-c272821bdf68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:48.760163 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d424a0a-f8b0-457c-934d-c272821bdf68 admin admin] PATH_INFO: `/v3/projects/d2a2f3ad990641bdb239850e86e95f4a` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:48.760549 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d424a0a-f8b0-457c-934d-c272821bdf68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2a2f3ad990641bdb239850e86e95f4a)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:48.761146 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d424a0a-f8b0-457c-934d-c272821bdf68 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:48.773477 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:48.823232 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-1d424a0a-f8b0-457c-934d-c272821bdf68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2a2f3ad990641bdb239850e86e95f4a', 'request_id': 'req-1d424a0a-f8b0-457c-934d-c272821bdf68'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:48.830760 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 968/1938] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:38:48.831746 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f21a8c-d247-400c-b655-b4759593519e None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:48.833101 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-b2f21a8c-d247-400c-b655-b4759593519e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:48.841967 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-1d424a0a-f8b0-457c-934d-c272821bdf68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2a2f3ad990641bdb239850e86e95f4a', 'request_id': 'req-1d424a0a-f8b0-457c-934d-c272821bdf68'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:48.848941 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-1d424a0a-f8b0-457c-934d-c272821bdf68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2a2f3ad990641bdb239850e86e95f4a', 'request_id': 'req-1d424a0a-f8b0-457c-934d-c272821bdf68'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:48.861472 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-1d424a0a-f8b0-457c-934d-c272821bdf68 admin admin] The token cache is being invalidate because project d2a2f3ad990641bdb239850e86e95f4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:38:48.861769 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-1d424a0a-f8b0-457c-934d-c272821bdf68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:48.862446 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-1d424a0a-f8b0-457c-934d-c272821bdf68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:48.864087 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 971/1939] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:38:48 2022] DELETE /identity/v3/projects/d2a2f3ad990641bdb239850e86e95f4a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:48.864990 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d424a0a-f8b0-457c-934d-c272821bdf68 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:48.866340 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1d424a0a-f8b0-457c-934d-c272821bdf68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:48.910997 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f21a8c-d247-400c-b655-b4759593519e None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:48.928215 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d424a0a-f8b0-457c-934d-c272821bdf68 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:48.944117 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a9ccb-44e9-4821-9e5e-1ca3d96f956d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:48.945950 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a9ccb-44e9-4821-9e5e-1ca3d96f956d service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:48.946285 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a9ccb-44e9-4821-9e5e-1ca3d96f956d service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:48.946862 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a9ccb-44e9-4821-9e5e-1ca3d96f956d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:48.950300 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e63a9ccb-44e9-4821-9e5e-1ca3d96f956d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:48.974463 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d887a4-551b-4565-b2f5-1f3278ef977a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:48.975576 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d887a4-551b-4565-b2f5-1f3278ef977a service cinder] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:48.976280 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d887a4-551b-4565-b2f5-1f3278ef977a service cinder] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:48.976937 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d887a4-551b-4565-b2f5-1f3278ef977a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:48.981082 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-62d887a4-551b-4565-b2f5-1f3278ef977a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:49.058543 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63a9ccb-44e9-4821-9e5e-1ca3d96f956d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:49.060022 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63a9ccb-44e9-4821-9e5e-1ca3d96f956d service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:49.087094 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 972/1940] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:38:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:38:49.090406 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b67fba-cbd3-408a-ad61-134c8646599b None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:49.090697 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b67fba-cbd3-408a-ad61-134c8646599b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:49.090976 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b67fba-cbd3-408a-ad61-134c8646599b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:49.125899 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d887a4-551b-4565-b2f5-1f3278ef977a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:49.129325 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-04b67fba-cbd3-408a-ad61-134c8646599b None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:49.130883 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-04b67fba-cbd3-408a-ad61-134c8646599b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:49.135283 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d887a4-551b-4565-b2f5-1f3278ef977a service cinder] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:49.164596 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 973/1941] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:49.173619 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8b23e-26c0-47b6-8600-6dd0a95871e1 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:49.174042 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8b23e-26c0-47b6-8600-6dd0a95871e1 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:49.174301 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8b23e-26c0-47b6-8600-6dd0a95871e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:49.176319 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 969/1942] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:38:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:38:49.217186 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-21e8b23e-26c0-47b6-8600-6dd0a95871e1 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:49.218474 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-21e8b23e-26c0-47b6-8600-6dd0a95871e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:49.244685 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 974/1943] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:49.246958 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d887a4-551b-4565-b2f5-1f3278ef977a service cinder] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:49.265344 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d887a4-551b-4565-b2f5-1f3278ef977a service cinder] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:49.273514 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df6ee5-c440-47bb-b040-9cffb615a9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:49.274310 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df6ee5-c440-47bb-b040-9cffb615a9b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:49.274593 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df6ee5-c440-47bb-b040-9cffb615a9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:49.274905 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df6ee5-c440-47bb-b040-9cffb615a9b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:49.276364 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25df6ee5-c440-47bb-b040-9cffb615a9b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:38:49.277178 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25df6ee5-c440-47bb-b040-9cffb615a9b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:49.279536 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25df6ee5-c440-47bb-b040-9cffb615a9b1 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:49.282032 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:49.299060 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 970/1944] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:38:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:38:49.303840 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e8b23e-26c0-47b6-8600-6dd0a95871e1 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:49.320216 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e8b23e-26c0-47b6-8600-6dd0a95871e1 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:49.327555 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db34b02-bb83-489d-b646-9e22f0241ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:49.328381 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db34b02-bb83-489d-b646-9e22f0241ac4 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:49.328665 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db34b02-bb83-489d-b646-9e22f0241ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:49.329130 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db34b02-bb83-489d-b646-9e22f0241ac4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:49.329940 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db34b02-bb83-489d-b646-9e22f0241ac4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:49.336218 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db34b02-bb83-489d-b646-9e22f0241ac4 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:49.390821 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 975/1945] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:38:49 2022] POST /identity/v3/projects => generated 409 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:38:49.395114 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df6ee5-c440-47bb-b040-9cffb615a9b1 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:49.412427 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df6ee5-c440-47bb-b040-9cffb615a9b1 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:49.542562 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99fc754-d07f-439b-97a4-c038219e1577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:49.543644 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fc754-d07f-439b-97a4-c038219e1577 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:49.544135 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fc754-d07f-439b-97a4-c038219e1577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:49.544658 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fc754-d07f-439b-97a4-c038219e1577 admin admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:49.545938 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99fc754-d07f-439b-97a4-c038219e1577 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:49.549389 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99fc754-d07f-439b-97a4-c038219e1577 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:49.583555 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 971/1946] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:38:49 2022] POST /identity/v3/users => generated 305 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:38:49.587435 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db34b02-bb83-489d-b646-9e22f0241ac4 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:49.598336 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db34b02-bb83-489d-b646-9e22f0241ac4 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:49.603309 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db4f5de-3892-486e-bc9f-30ce2325acff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:49.604231 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4f5de-3892-486e-bc9f-30ce2325acff admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:49.604563 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4f5de-3892-486e-bc9f-30ce2325acff admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:49.604845 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4f5de-3892-486e-bc9f-30ce2325acff admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:49.605691 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db4f5de-3892-486e-bc9f-30ce2325acff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:49.607422 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db4f5de-3892-486e-bc9f-30ce2325acff admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:49.624551 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99fc754-d07f-439b-97a4-c038219e1577 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:49.625634 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 976/1947] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:38:49.639449 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99fc754-d07f-439b-97a4-c038219e1577 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:49.646289 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4bbedc-ef7e-4c84-906b-11c4afc6b866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:49.646799 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bbedc-ef7e-4c84-906b-11c4afc6b866 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:49.647054 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bbedc-ef7e-4c84-906b-11c4afc6b866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:49.647340 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bbedc-ef7e-4c84-906b-11c4afc6b866 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:49.648154 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4bbedc-ef7e-4c84-906b-11c4afc6b866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:49.649712 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4bbedc-ef7e-4c84-906b-11c4afc6b866 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:49.664463 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 972/1948] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:38:49.668566 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db4f5de-3892-486e-bc9f-30ce2325acff admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:49.677076 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:49.685982 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db4f5de-3892-486e-bc9f-30ce2325acff admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:49.706054 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f32bc-2f4a-4bd1-8b5f-7da772662b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:49.708720 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f32bc-2f4a-4bd1-8b5f-7da772662b45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:49.709022 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f32bc-2f4a-4bd1-8b5f-7da772662b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:49.709227 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f32bc-2f4a-4bd1-8b5f-7da772662b45 admin admin] PATH_INFO: `/v3/projects/3da6eaf940d84d9c8986cbde91f6f7ca/users/3dc29ec5884e4a3ca11c4b676f6be760/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:49.729482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005f32bc-2f4a-4bd1-8b5f-7da772662b45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3da6eaf940d84d9c8986cbde91f6f7ca, user_id=3dc29ec5884e4a3ca11c4b676f6be760, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:49.733454 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005f32bc-2f4a-4bd1-8b5f-7da772662b45 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:49.790276 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61271ec9-0a58-4ca8-a578-9f2601355cf5 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:49.790706 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61271ec9-0a58-4ca8-a578-9f2601355cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:49.790988 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61271ec9-0a58-4ca8-a578-9f2601355cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:49.792469 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 977/1949] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:38:49 2022] PUT /identity/v3/projects/3da6eaf940d84d9c8986cbde91f6f7ca/users/3dc29ec5884e4a3ca11c4b676f6be760/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:49.837062 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-61271ec9-0a58-4ca8-a578-9f2601355cf5 None None] MFA Rules not processed for user `3dc29ec5884e4a3ca11c4b676f6be760`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:49.840558 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-61271ec9-0a58-4ca8-a578-9f2601355cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:49.953049 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 973/1950] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:49 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:49.958770 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f32bc-2f4a-4bd1-8b5f-7da772662b45 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:50.043222 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f32bc-2f4a-4bd1-8b5f-7da772662b45 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:50.050241 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebbf1a0-251a-449d-8e54-605c0ed47225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:50.051131 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbf1a0-251a-449d-8e54-605c0ed47225 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:50.051514 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbf1a0-251a-449d-8e54-605c0ed47225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:50.052012 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbf1a0-251a-449d-8e54-605c0ed47225 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:50.052895 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebbf1a0-251a-449d-8e54-605c0ed47225 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:50.055210 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebbf1a0-251a-449d-8e54-605c0ed47225 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:50.123376 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 978/1951] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:38:49 2022] POST /identity/v3/projects => generated 409 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:38:50.127098 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61271ec9-0a58-4ca8-a578-9f2601355cf5 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:50.143288 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61271ec9-0a58-4ca8-a578-9f2601355cf5 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:50.206825 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebbf1a0-251a-449d-8e54-605c0ed47225 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:50.208587 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-4ebbf1a0-251a-449d-8e54-605c0ed47225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:50.214195 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e8bc59-0105-4dbc-8e16-3cb2d4a6daa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:50.214815 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8bc59-0105-4dbc-8e16-3cb2d4a6daa8 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:50.215220 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8bc59-0105-4dbc-8e16-3cb2d4a6daa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:50.215508 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8bc59-0105-4dbc-8e16-3cb2d4a6daa8 admin admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:50.216094 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e8bc59-0105-4dbc-8e16-3cb2d4a6daa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:50.218076 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e8bc59-0105-4dbc-8e16-3cb2d4a6daa8 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:50.231455 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:50.258374 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 974/1952] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:38:50 2022] POST /identity/v3/users => generated 311 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:38:50.263281 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e8bc59-0105-4dbc-8e16-3cb2d4a6daa8 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:50.280576 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e8bc59-0105-4dbc-8e16-3cb2d4a6daa8 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:50.294300 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84cb15e-bbf2-45bb-bed6-366730f20de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:50.295166 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cb15e-bbf2-45bb-bed6-366730f20de2 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:50.295534 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cb15e-bbf2-45bb-bed6-366730f20de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:50.295877 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cb15e-bbf2-45bb-bed6-366730f20de2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:50.296686 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84cb15e-bbf2-45bb-bed6-366730f20de2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:50.299067 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84cb15e-bbf2-45bb-bed6-366730f20de2 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:50.311381 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebbf1a0-251a-449d-8e54-605c0ed47225 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:50.315615 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78541b-967d-4e95-a97c-a8b1fc9b22d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:50.316289 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78541b-967d-4e95-a97c-a8b1fc9b22d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:50.316569 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78541b-967d-4e95-a97c-a8b1fc9b22d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:50.316843 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78541b-967d-4e95-a97c-a8b1fc9b22d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:50.320550 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-2f78541b-967d-4e95-a97c-a8b1fc9b22d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:50.326689 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 975/1953] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 17:38:50.330368 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84cb15e-bbf2-45bb-bed6-366730f20de2 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:50.347607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84cb15e-bbf2-45bb-bed6-366730f20de2 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:50.358359 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e5529-23dd-4a5a-8fd9-3bcde56f5912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:50.359361 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e5529-23dd-4a5a-8fd9-3bcde56f5912 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:50.359646 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e5529-23dd-4a5a-8fd9-3bcde56f5912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:50.359972 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e5529-23dd-4a5a-8fd9-3bcde56f5912 admin admin] PATH_INFO: `/v3/projects/180af7e2a6bd4786918da2adb919629f/users/ee713c37f4f54368ba9d4557e4acb1bb/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:50.399378 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688e5529-23dd-4a5a-8fd9-3bcde56f5912 admin admin] RBAC: Authorizing `identity:create_grant(project_id=180af7e2a6bd4786918da2adb919629f, user_id=ee713c37f4f54368ba9d4557e4acb1bb, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:50.405464 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688e5529-23dd-4a5a-8fd9-3bcde56f5912 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:50.444733 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78541b-967d-4e95-a97c-a8b1fc9b22d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:50.446557 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78541b-967d-4e95-a97c-a8b1fc9b22d6 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:50.447997 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 976/1954] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:38:50 2022] PUT /identity/v3/projects/180af7e2a6bd4786918da2adb919629f/users/ee713c37f4f54368ba9d4557e4acb1bb/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:50.452754 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e5529-23dd-4a5a-8fd9-3bcde56f5912 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:50.465646 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 979/1955] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:38:50 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:38:50.602392 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e5529-23dd-4a5a-8fd9-3bcde56f5912 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:50.605385 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c898b-6ad6-4fbf-8fc9-0c93e81ea16e None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:50.605766 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c898b-6ad6-4fbf-8fc9-0c93e81ea16e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:50.606494 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c898b-6ad6-4fbf-8fc9-0c93e81ea16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:50.617705 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d099c57b-4ca8-4c42-b34d-7d69a80b7812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:50.620772 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099c57b-4ca8-4c42-b34d-7d69a80b7812 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:50.621234 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099c57b-4ca8-4c42-b34d-7d69a80b7812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:50.621824 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099c57b-4ca8-4c42-b34d-7d69a80b7812 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:50.623409 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d099c57b-4ca8-4c42-b34d-7d69a80b7812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:50.625647 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d099c57b-4ca8-4c42-b34d-7d69a80b7812 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:50.640776 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 977/1956] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 17:38:50.646594 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d099c57b-4ca8-4c42-b34d-7d69a80b7812 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:50.667396 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d099c57b-4ca8-4c42-b34d-7d69a80b7812 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:50.670917 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:50.684224 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-3c4c898b-6ad6-4fbf-8fc9-0c93e81ea16e None None] MFA Rules not processed for user `afc6391173d04c2895bfef69225c29c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:50.688049 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a466508c-90a4-4c50-9613-9efb86490295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:50.688640 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-3c4c898b-6ad6-4fbf-8fc9-0c93e81ea16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:50.690870 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466508c-90a4-4c50-9613-9efb86490295 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:50.691838 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466508c-90a4-4c50-9613-9efb86490295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:50.692845 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466508c-90a4-4c50-9613-9efb86490295 admin admin] PATH_INFO: `/v3/projects/180af7e2a6bd4786918da2adb919629f/users/ee713c37f4f54368ba9d4557e4acb1bb/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:50.699737 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a466508c-90a4-4c50-9613-9efb86490295 admin admin] RBAC: Authorizing `identity:create_grant(project_id=180af7e2a6bd4786918da2adb919629f, user_id=ee713c37f4f54368ba9d4557e4acb1bb, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:50.730093 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a466508c-90a4-4c50-9613-9efb86490295 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:50.750636 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 978/1957] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:38:50 2022] PUT /identity/v3/projects/180af7e2a6bd4786918da2adb919629f/users/ee713c37f4f54368ba9d4557e4acb1bb/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:50.764517 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952f572-0995-4226-9608-547d015b907a None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:50.766177 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952f572-0995-4226-9608-547d015b907a None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:50.766585 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952f572-0995-4226-9608-547d015b907a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:50.827685 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-0952f572-0995-4226-9608-547d015b907a None None] MFA Rules not processed for user `ee713c37f4f54368ba9d4557e4acb1bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:50.829090 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-0952f572-0995-4226-9608-547d015b907a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:50.850309 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 980/1958] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:50 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:50.862322 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c898b-6ad6-4fbf-8fc9-0c93e81ea16e None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:50.864549 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-3c4c898b-6ad6-4fbf-8fc9-0c93e81ea16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:50.953183 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 979/1959] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:50 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:50.966678 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952f572-0995-4226-9608-547d015b907a None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:50.995242 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c898b-6ad6-4fbf-8fc9-0c93e81ea16e None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:51.012927 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:51.049469 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952f572-0995-4226-9608-547d015b907a None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:51.063404 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64055911-1d7d-45c9-b3e8-48ee8f43a791 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:51.064312 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64055911-1d7d-45c9-b3e8-48ee8f43a791 service cinder] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:51.064684 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64055911-1d7d-45c9-b3e8-48ee8f43a791 service cinder] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:51.065105 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64055911-1d7d-45c9-b3e8-48ee8f43a791 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:51.078073 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64055911-1d7d-45c9-b3e8-48ee8f43a791 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:51.081298 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64055911-1d7d-45c9-b3e8-48ee8f43a791 service cinder] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:51.103434 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 980/1960] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:38:50 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 17:38:51.106611 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c829b-dd31-4171-b2db-1d112d88491d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:51.107465 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c829b-dd31-4171-b2db-1d112d88491d service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:51.107895 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c829b-dd31-4171-b2db-1d112d88491d service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:51.108332 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c829b-dd31-4171-b2db-1d112d88491d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:51.177525 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741c829b-dd31-4171-b2db-1d112d88491d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:51.178643 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741c829b-dd31-4171-b2db-1d112d88491d service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:51.189135 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 981/1961] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:38:50 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:38:51.284048 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64055911-1d7d-45c9-b3e8-48ee8f43a791 service cinder] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:51.294084 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64055911-1d7d-45c9-b3e8-48ee8f43a791 service cinder] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:51.297934 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f72331-3e9e-406f-a9e9-91867a05b9c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:51.298599 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f72331-3e9e-406f-a9e9-91867a05b9c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:51.298877 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f72331-3e9e-406f-a9e9-91867a05b9c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:51.299143 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f72331-3e9e-406f-a9e9-91867a05b9c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:51.376672 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f72331-3e9e-406f-a9e9-91867a05b9c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:51.380572 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f72331-3e9e-406f-a9e9-91867a05b9c0 service cinder] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:51.392283 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 981/1962] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:38:51 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:38:52.609115 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139416a-0163-44e9-a927-df2a57d3249b None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:52.609713 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139416a-0163-44e9-a927-df2a57d3249b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:52.609713 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139416a-0163-44e9-a927-df2a57d3249b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:52.629608 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-1139416a-0163-44e9-a927-df2a57d3249b None None] MFA Rules not processed for user `afc6391173d04c2895bfef69225c29c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:52.630956 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1139416a-0163-44e9-a927-df2a57d3249b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:52.639462 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 982/1963] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:52 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:54.793164 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f72331-3e9e-406f-a9e9-91867a05b9c0 service cinder] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:54.794788 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-27f72331-3e9e-406f-a9e9-91867a05b9c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:54.863876 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f72331-3e9e-406f-a9e9-91867a05b9c0 service cinder] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:54.868675 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402202d-c6e7-4c8e-898c-0196042b5f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:54.870163 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402202d-c6e7-4c8e-898c-0196042b5f2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:54.870450 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402202d-c6e7-4c8e-898c-0196042b5f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:54.870745 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402202d-c6e7-4c8e-898c-0196042b5f2f admin admin] PATH_INFO: `/v3/users/fbdb40c18ed24ab1916af7d136743090` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:54.871931 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1402202d-c6e7-4c8e-898c-0196042b5f2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbdb40c18ed24ab1916af7d136743090)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:54.873909 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1402202d-c6e7-4c8e-898c-0196042b5f2f admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:54.924158 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-1402202d-c6e7-4c8e-898c-0196042b5f2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbdb40c18ed24ab1916af7d136743090'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:54.924877 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-1402202d-c6e7-4c8e-898c-0196042b5f2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbdb40c18ed24ab1916af7d136743090'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:54.931822 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-1402202d-c6e7-4c8e-898c-0196042b5f2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbdb40c18ed24ab1916af7d136743090'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:54.932815 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-1402202d-c6e7-4c8e-898c-0196042b5f2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbdb40c18ed24ab1916af7d136743090'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:54.941287 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:54.946142 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-1402202d-c6e7-4c8e-898c-0196042b5f2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbdb40c18ed24ab1916af7d136743090'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:54.963387 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 982/1964] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:38:54 2022] DELETE /identity/v3/users/fbdb40c18ed24ab1916af7d136743090 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:54.968009 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76661c70-1abf-4e30-bf04-444f6b63f5b9 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:54.968513 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76661c70-1abf-4e30-bf04-444f6b63f5b9 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:54.968722 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76661c70-1abf-4e30-bf04-444f6b63f5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:54.985061 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:54.992503 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-76661c70-1abf-4e30-bf04-444f6b63f5b9 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:54.994254 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-76661c70-1abf-4e30-bf04-444f6b63f5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:55.059208 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 983/1965] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:55.071033 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402202d-c6e7-4c8e-898c-0196042b5f2f admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:55.072584 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-1402202d-c6e7-4c8e-898c-0196042b5f2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:55.138002 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402202d-c6e7-4c8e-898c-0196042b5f2f admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:55.142454 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0e0f7e-88cb-4328-b6dc-e8bc06b92901 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:55.143066 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e0f7e-88cb-4328-b6dc-e8bc06b92901 service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:55.143448 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e0f7e-88cb-4328-b6dc-e8bc06b92901 service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:55.143721 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e0f7e-88cb-4328-b6dc-e8bc06b92901 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:55.155737 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0e0f7e-88cb-4328-b6dc-e8bc06b92901 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:55.157267 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0e0f7e-88cb-4328-b6dc-e8bc06b92901 service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:55.167320 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 983/1966] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:38:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 17:38:55.614316 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76661c70-1abf-4e30-bf04-444f6b63f5b9 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:55.615906 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-76661c70-1abf-4e30-bf04-444f6b63f5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:55.629121 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76661c70-1abf-4e30-bf04-444f6b63f5b9 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:55.634524 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d4d70-3bfa-44ca-8023-560dc816acd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:55.636204 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d4d70-3bfa-44ca-8023-560dc816acd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:55.636491 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d4d70-3bfa-44ca-8023-560dc816acd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:55.636769 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d4d70-3bfa-44ca-8023-560dc816acd7 admin admin] PATH_INFO: `/v3/projects/2e40700337b44957981c2e0f25069237` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:55.638101 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d4d70-3bfa-44ca-8023-560dc816acd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e40700337b44957981c2e0f25069237)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:55.639970 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d4d70-3bfa-44ca-8023-560dc816acd7 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:55.695409 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-024d4d70-3bfa-44ca-8023-560dc816acd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e40700337b44957981c2e0f25069237', 'request_id': 'req-024d4d70-3bfa-44ca-8023-560dc816acd7'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:55.705345 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-024d4d70-3bfa-44ca-8023-560dc816acd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e40700337b44957981c2e0f25069237', 'request_id': 'req-024d4d70-3bfa-44ca-8023-560dc816acd7'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:55.712516 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-024d4d70-3bfa-44ca-8023-560dc816acd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e40700337b44957981c2e0f25069237', 'request_id': 'req-024d4d70-3bfa-44ca-8023-560dc816acd7'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:55.725122 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-024d4d70-3bfa-44ca-8023-560dc816acd7 admin admin] The token cache is being invalidate because project 2e40700337b44957981c2e0f25069237 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:38:55.725605 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-024d4d70-3bfa-44ca-8023-560dc816acd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:55.726548 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-024d4d70-3bfa-44ca-8023-560dc816acd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:55.732539 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0e0f7e-88cb-4328-b6dc-e8bc06b92901 service neutron] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:55.733102 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 984/1967] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:38:55 2022] DELETE /identity/v3/projects/2e40700337b44957981c2e0f25069237 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:55.742795 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0e0f7e-88cb-4328-b6dc-e8bc06b92901 service neutron] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:55.812880 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc5fec-d8d6-45c5-86cc-3a8976adfa0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:55.817541 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc5fec-d8d6-45c5-86cc-3a8976adfa0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:55.817541 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc5fec-d8d6-45c5-86cc-3a8976adfa0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:55.817541 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc5fec-d8d6-45c5-86cc-3a8976adfa0d admin admin] PATH_INFO: `/v3/users/70368036381b4064bfd42d6f1987d334` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:55.817541 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc5fec-d8d6-45c5-86cc-3a8976adfa0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=70368036381b4064bfd42d6f1987d334)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:55.817541 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc5fec-d8d6-45c5-86cc-3a8976adfa0d admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:55.881768 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-d5bc5fec-d8d6-45c5-86cc-3a8976adfa0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70368036381b4064bfd42d6f1987d334'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:55.882908 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-d5bc5fec-d8d6-45c5-86cc-3a8976adfa0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70368036381b4064bfd42d6f1987d334'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:55.895357 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-d5bc5fec-d8d6-45c5-86cc-3a8976adfa0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70368036381b4064bfd42d6f1987d334'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:55.895928 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-d5bc5fec-d8d6-45c5-86cc-3a8976adfa0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70368036381b4064bfd42d6f1987d334'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:55.908812 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-d5bc5fec-d8d6-45c5-86cc-3a8976adfa0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70368036381b4064bfd42d6f1987d334'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:55.923742 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 984/1968] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:38:55 2022] DELETE /identity/v3/users/70368036381b4064bfd42d6f1987d334 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:56.367576 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d4d70-3bfa-44ca-8023-560dc816acd7 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:56.369945 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-024d4d70-3bfa-44ca-8023-560dc816acd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:56.383517 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d4d70-3bfa-44ca-8023-560dc816acd7 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:56.451725 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba118d-d691-44e7-9ac9-abfdfb2b6de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:56.452613 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba118d-d691-44e7-9ac9-abfdfb2b6de7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:56.452891 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba118d-d691-44e7-9ac9-abfdfb2b6de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:56.453160 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba118d-d691-44e7-9ac9-abfdfb2b6de7 admin admin] PATH_INFO: `/v3/projects/e413f35310d54363aeb057d7d6d37b77` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:56.454466 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba118d-d691-44e7-9ac9-abfdfb2b6de7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e413f35310d54363aeb057d7d6d37b77)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:56.456429 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba118d-d691-44e7-9ac9-abfdfb2b6de7 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:56.505372 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:56.529368 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-cbba118d-d691-44e7-9ac9-abfdfb2b6de7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e413f35310d54363aeb057d7d6d37b77', 'request_id': 'req-cbba118d-d691-44e7-9ac9-abfdfb2b6de7'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:56.539606 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-cbba118d-d691-44e7-9ac9-abfdfb2b6de7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e413f35310d54363aeb057d7d6d37b77', 'request_id': 'req-cbba118d-d691-44e7-9ac9-abfdfb2b6de7'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:56.546428 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-cbba118d-d691-44e7-9ac9-abfdfb2b6de7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e413f35310d54363aeb057d7d6d37b77', 'request_id': 'req-cbba118d-d691-44e7-9ac9-abfdfb2b6de7'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:56.557747 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-cbba118d-d691-44e7-9ac9-abfdfb2b6de7 admin admin] The token cache is being invalidate because project e413f35310d54363aeb057d7d6d37b77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:38:56.558065 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-cbba118d-d691-44e7-9ac9-abfdfb2b6de7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:56.558725 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-cbba118d-d691-44e7-9ac9-abfdfb2b6de7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:56.560296 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 985/1969] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:38:56 2022] DELETE /identity/v3/projects/e413f35310d54363aeb057d7d6d37b77 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:56.564360 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc5fec-d8d6-45c5-86cc-3a8976adfa0d admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:56.565878 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-d5bc5fec-d8d6-45c5-86cc-3a8976adfa0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:56.579320 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc5fec-d8d6-45c5-86cc-3a8976adfa0d admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:56.583162 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:56.642139 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffc5fa-56f5-4fe0-877f-50f02a187b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:56.643038 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffc5fa-56f5-4fe0-877f-50f02a187b96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:56.643315 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffc5fa-56f5-4fe0-877f-50f02a187b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:56.643585 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffc5fa-56f5-4fe0-877f-50f02a187b96 admin admin] PATH_INFO: `/v3/users/3d3a9c1eae60422daca92e0d7de7c4cb` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:56.644761 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ffc5fa-56f5-4fe0-877f-50f02a187b96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d3a9c1eae60422daca92e0d7de7c4cb)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:56.646859 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ffc5fa-56f5-4fe0-877f-50f02a187b96 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:56.705109 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-72ffc5fa-56f5-4fe0-877f-50f02a187b96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d3a9c1eae60422daca92e0d7de7c4cb'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:56.705936 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-72ffc5fa-56f5-4fe0-877f-50f02a187b96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d3a9c1eae60422daca92e0d7de7c4cb'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:56.715468 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-72ffc5fa-56f5-4fe0-877f-50f02a187b96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d3a9c1eae60422daca92e0d7de7c4cb'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:56.716161 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-72ffc5fa-56f5-4fe0-877f-50f02a187b96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d3a9c1eae60422daca92e0d7de7c4cb'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:56.729075 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-72ffc5fa-56f5-4fe0-877f-50f02a187b96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d3a9c1eae60422daca92e0d7de7c4cb'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:56.744604 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 985/1970] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:38:56 2022] DELETE /identity/v3/users/3d3a9c1eae60422daca92e0d7de7c4cb => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:57.040498 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba118d-d691-44e7-9ac9-abfdfb2b6de7 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:57.042574 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-cbba118d-d691-44e7-9ac9-abfdfb2b6de7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:57.059372 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba118d-d691-44e7-9ac9-abfdfb2b6de7 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:57.140990 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffc5fa-56f5-4fe0-877f-50f02a187b96 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:57.142398 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8138c2f8-ae13-46ce-a2ac-3b3384f8ea57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:57.142957 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-72ffc5fa-56f5-4fe0-877f-50f02a187b96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:57.143462 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138c2f8-ae13-46ce-a2ac-3b3384f8ea57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:57.143810 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138c2f8-ae13-46ce-a2ac-3b3384f8ea57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:57.143976 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138c2f8-ae13-46ce-a2ac-3b3384f8ea57 admin admin] PATH_INFO: `/v3/projects/fe172c58ef694c5192e595349157e698` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:57.145234 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8138c2f8-ae13-46ce-a2ac-3b3384f8ea57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe172c58ef694c5192e595349157e698)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:57.147177 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8138c2f8-ae13-46ce-a2ac-3b3384f8ea57 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:57.160684 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffc5fa-56f5-4fe0-877f-50f02a187b96 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:57.167217 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c292990-3c6d-4372-82c7-ef532956dc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:57.168120 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c292990-3c6d-4372-82c7-ef532956dc88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:57.168394 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c292990-3c6d-4372-82c7-ef532956dc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:57.168719 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c292990-3c6d-4372-82c7-ef532956dc88 admin admin] PATH_INFO: `/v3/users/3dc29ec5884e4a3ca11c4b676f6be760` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:57.170984 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c292990-3c6d-4372-82c7-ef532956dc88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dc29ec5884e4a3ca11c4b676f6be760)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:57.172908 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c292990-3c6d-4372-82c7-ef532956dc88 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:57.229495 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-8138c2f8-ae13-46ce-a2ac-3b3384f8ea57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe172c58ef694c5192e595349157e698', 'request_id': 'req-8138c2f8-ae13-46ce-a2ac-3b3384f8ea57'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:57.240180 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-8138c2f8-ae13-46ce-a2ac-3b3384f8ea57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe172c58ef694c5192e595349157e698', 'request_id': 'req-8138c2f8-ae13-46ce-a2ac-3b3384f8ea57'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:57.260385 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-8138c2f8-ae13-46ce-a2ac-3b3384f8ea57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe172c58ef694c5192e595349157e698', 'request_id': 'req-8138c2f8-ae13-46ce-a2ac-3b3384f8ea57'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:57.301630 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-3c292990-3c6d-4372-82c7-ef532956dc88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dc29ec5884e4a3ca11c4b676f6be760'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:57.313551 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-3c292990-3c6d-4372-82c7-ef532956dc88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dc29ec5884e4a3ca11c4b676f6be760'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:57.318030 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-8138c2f8-ae13-46ce-a2ac-3b3384f8ea57 admin admin] The token cache is being invalidate because project fe172c58ef694c5192e595349157e698 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:38:57.320568 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-8138c2f8-ae13-46ce-a2ac-3b3384f8ea57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:57.322401 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-8138c2f8-ae13-46ce-a2ac-3b3384f8ea57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:57.330849 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 986/1971] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:38:57 2022] DELETE /identity/v3/projects/fe172c58ef694c5192e595349157e698 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:57.336124 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817247f-a0be-4915-bed0-9226ce7f2f7b None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:57.336437 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817247f-a0be-4915-bed0-9226ce7f2f7b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:57.337463 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817247f-a0be-4915-bed0-9226ce7f2f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:57.341859 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-3c292990-3c6d-4372-82c7-ef532956dc88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dc29ec5884e4a3ca11c4b676f6be760'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:57.343656 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-3c292990-3c6d-4372-82c7-ef532956dc88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dc29ec5884e4a3ca11c4b676f6be760'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:57.357604 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-2817247f-a0be-4915-bed0-9226ce7f2f7b None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:57.358752 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-3c292990-3c6d-4372-82c7-ef532956dc88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dc29ec5884e4a3ca11c4b676f6be760'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:57.358906 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-2817247f-a0be-4915-bed0-9226ce7f2f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:57.367791 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:57.373507 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 986/1972] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:38:57 2022] DELETE /identity/v3/users/3dc29ec5884e4a3ca11c4b676f6be760 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:57.378143 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc586444-bb74-41f3-a1dc-21b55ae72728 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:57.378688 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc586444-bb74-41f3-a1dc-21b55ae72728 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:57.379288 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc586444-bb74-41f3-a1dc-21b55ae72728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:57.396799 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-bc586444-bb74-41f3-a1dc-21b55ae72728 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:57.398048 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-bc586444-bb74-41f3-a1dc-21b55ae72728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:57.406132 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:57.455704 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 987/1973] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:38:57.463955 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e914a76-b0eb-4942-9e78-7c141f465bdd None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:57.465329 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e914a76-b0eb-4942-9e78-7c141f465bdd None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:57.465818 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e914a76-b0eb-4942-9e78-7c141f465bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:57.493736 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-1e914a76-b0eb-4942-9e78-7c141f465bdd None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:57.495560 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1e914a76-b0eb-4942-9e78-7c141f465bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:57.497917 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 987/1974] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:38:57.511843 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 988/1975] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:57.512106 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc586444-bb74-41f3-a1dc-21b55ae72728 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:57.513069 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e914a76-b0eb-4942-9e78-7c141f465bdd None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:57.514567 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1e914a76-b0eb-4942-9e78-7c141f465bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:57.525921 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc586444-bb74-41f3-a1dc-21b55ae72728 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:57.532897 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d51f2b-d89b-4298-a605-6a9cc096f7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:57.533732 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d51f2b-d89b-4298-a605-6a9cc096f7b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:57.534113 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d51f2b-d89b-4298-a605-6a9cc096f7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:57.534455 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d51f2b-d89b-4298-a605-6a9cc096f7b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:57.535447 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d51f2b-d89b-4298-a605-6a9cc096f7b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:38:57.535675 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d51f2b-d89b-4298-a605-6a9cc096f7b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:57.537577 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d51f2b-d89b-4298-a605-6a9cc096f7b6 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:57.555200 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 988/1976] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:38:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:38:57.558888 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d51f2b-d89b-4298-a605-6a9cc096f7b6 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:57.569016 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d51f2b-d89b-4298-a605-6a9cc096f7b6 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:57.575234 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c8973-1f3b-4879-8af2-6ae93f5fa8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:57.575907 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c8973-1f3b-4879-8af2-6ae93f5fa8ff admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:57.576181 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c8973-1f3b-4879-8af2-6ae93f5fa8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:57.576452 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c8973-1f3b-4879-8af2-6ae93f5fa8ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:57.577150 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1c8973-1f3b-4879-8af2-6ae93f5fa8ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:57.579571 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1c8973-1f3b-4879-8af2-6ae93f5fa8ff admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:57.615496 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e914a76-b0eb-4942-9e78-7c141f465bdd None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:57.621970 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 989/1977] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:38:57 2022] POST /identity/v3/projects => generated 369 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 17:38:57.622136 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb44c89-45a4-4785-8fd6-121ad0b755f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:57.622136 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb44c89-45a4-4785-8fd6-121ad0b755f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:57.622136 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb44c89-45a4-4785-8fd6-121ad0b755f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:57.622136 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb44c89-45a4-4785-8fd6-121ad0b755f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:57.623228 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c8973-1f3b-4879-8af2-6ae93f5fa8ff admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:57.633366 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb44c89-45a4-4785-8fd6-121ad0b755f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:57.635758 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb44c89-45a4-4785-8fd6-121ad0b755f8 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:57.649108 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 989/1978] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:38:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:38:57.697818 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c8973-1f3b-4879-8af2-6ae93f5fa8ff admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:57.705071 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d7494-7e5a-44f2-a818-f9d34567c76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:57.706099 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d7494-7e5a-44f2-a818-f9d34567c76a admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:57.706466 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d7494-7e5a-44f2-a818-f9d34567c76a admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:57.707448 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d7494-7e5a-44f2-a818-f9d34567c76a admin admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:57.708278 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d7494-7e5a-44f2-a818-f9d34567c76a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:57.710716 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d7494-7e5a-44f2-a818-f9d34567c76a admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:57.743638 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 990/1979] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:38:57 2022] POST /identity/v3/users => generated 285 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:38:57.748359 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb44c89-45a4-4785-8fd6-121ad0b755f8 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:57.764189 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb44c89-45a4-4785-8fd6-121ad0b755f8 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:57.770447 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35e9cf-0461-4aaf-80ef-ebff077bd3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:57.772480 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35e9cf-0461-4aaf-80ef-ebff077bd3a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:57.773056 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35e9cf-0461-4aaf-80ef-ebff077bd3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:57.773556 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35e9cf-0461-4aaf-80ef-ebff077bd3a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:57.785814 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f35e9cf-0461-4aaf-80ef-ebff077bd3a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:57.791874 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f35e9cf-0461-4aaf-80ef-ebff077bd3a8 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:57.816973 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 990/1980] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:38:57.820819 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d7494-7e5a-44f2-a818-f9d34567c76a admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:57.832917 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d7494-7e5a-44f2-a818-f9d34567c76a admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:57.838591 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b5577e-4d70-4853-a346-6962f7296eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:57.839701 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5577e-4d70-4853-a346-6962f7296eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:57.839989 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5577e-4d70-4853-a346-6962f7296eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:57.840348 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5577e-4d70-4853-a346-6962f7296eb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:57.841257 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b5577e-4d70-4853-a346-6962f7296eb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:57.843458 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b5577e-4d70-4853-a346-6962f7296eb2 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:57.856236 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 991/1981] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 17:38:57.860558 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35e9cf-0461-4aaf-80ef-ebff077bd3a8 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:57.873343 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35e9cf-0461-4aaf-80ef-ebff077bd3a8 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:57.881388 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c429191-16e2-40fd-b721-bd1e9c980146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:57.883635 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c429191-16e2-40fd-b721-bd1e9c980146 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:57.884117 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c429191-16e2-40fd-b721-bd1e9c980146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:57.884715 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c429191-16e2-40fd-b721-bd1e9c980146 admin admin] PATH_INFO: `/v3/projects/bcf7866e97464673bed0259d10430ded/users/d94efa1cd4a64ca59ac1934920c2a9bf/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:57.907582 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c429191-16e2-40fd-b721-bd1e9c980146 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcf7866e97464673bed0259d10430ded, user_id=d94efa1cd4a64ca59ac1934920c2a9bf, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:57.911486 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c429191-16e2-40fd-b721-bd1e9c980146 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:57.955154 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 991/1982] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:38:57 2022] PUT /identity/v3/projects/bcf7866e97464673bed0259d10430ded/users/d94efa1cd4a64ca59ac1934920c2a9bf/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:57.957374 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb579bfb-57c0-4ffe-8d73-bfac0cda9695 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:57.958754 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb579bfb-57c0-4ffe-8d73-bfac0cda9695 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:57.959236 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb579bfb-57c0-4ffe-8d73-bfac0cda9695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:58.035761 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-fb579bfb-57c0-4ffe-8d73-bfac0cda9695 None None] MFA Rules not processed for user `d94efa1cd4a64ca59ac1934920c2a9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:38:58.042904 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-fb579bfb-57c0-4ffe-8d73-bfac0cda9695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:58.128798 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:58.179813 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 992/1983] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:38:57 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:38:58.194703 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c429191-16e2-40fd-b721-bd1e9c980146 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:58.198357 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-6c429191-16e2-40fd-b721-bd1e9c980146 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:58.347441 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c429191-16e2-40fd-b721-bd1e9c980146 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:58.351993 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6f6e5-a9fd-4d3b-bfa0-08c7fed08ca8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14775984c9d4463a8e8848dcf189714b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:58.352972 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6f6e5-a9fd-4d3b-bfa0-08c7fed08ca8 service glance] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:58.353318 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6f6e5-a9fd-4d3b-bfa0-08c7fed08ca8 service glance] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:58.353656 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6f6e5-a9fd-4d3b-bfa0-08c7fed08ca8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:58.362893 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a6f6e5-a9fd-4d3b-bfa0-08c7fed08ca8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:58.364405 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a6f6e5-a9fd-4d3b-bfa0-08c7fed08ca8 service glance] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:58.375661 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 992/1984] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:38:58 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:38:58.816275 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb579bfb-57c0-4ffe-8d73-bfac0cda9695 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:58.819622 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-fb579bfb-57c0-4ffe-8d73-bfac0cda9695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:38:58.973367 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb579bfb-57c0-4ffe-8d73-bfac0cda9695 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:58.988111 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777000f-a890-41f7-8b5c-1d19e94c921e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:58.989031 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777000f-a890-41f7-8b5c-1d19e94c921e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:58.989316 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777000f-a890-41f7-8b5c-1d19e94c921e admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:58.989597 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777000f-a890-41f7-8b5c-1d19e94c921e admin admin] PATH_INFO: `/v3/projects/3da6eaf940d84d9c8986cbde91f6f7ca` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:58.991706 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777000f-a890-41f7-8b5c-1d19e94c921e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3da6eaf940d84d9c8986cbde91f6f7ca)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:58.993958 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777000f-a890-41f7-8b5c-1d19e94c921e admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:59.111612 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-3777000f-a890-41f7-8b5c-1d19e94c921e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3da6eaf940d84d9c8986cbde91f6f7ca', 'request_id': 'req-3777000f-a890-41f7-8b5c-1d19e94c921e'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:59.137322 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-3777000f-a890-41f7-8b5c-1d19e94c921e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3da6eaf940d84d9c8986cbde91f6f7ca', 'request_id': 'req-3777000f-a890-41f7-8b5c-1d19e94c921e'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:59.147262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-3777000f-a890-41f7-8b5c-1d19e94c921e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3da6eaf940d84d9c8986cbde91f6f7ca', 'request_id': 'req-3777000f-a890-41f7-8b5c-1d19e94c921e'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:59.168194 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-3777000f-a890-41f7-8b5c-1d19e94c921e admin admin] The token cache is being invalidate because project 3da6eaf940d84d9c8986cbde91f6f7ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80150) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:38:59.168535 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-3777000f-a890-41f7-8b5c-1d19e94c921e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:59.176459 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-3777000f-a890-41f7-8b5c-1d19e94c921e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:59.181423 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 993/1985] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:38:58 2022] DELETE /identity/v3/projects/3da6eaf940d84d9c8986cbde91f6f7ca => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:38:59.183046 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6f6e5-a9fd-4d3b-bfa0-08c7fed08ca8 service glance] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:38:59.229371 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6f6e5-a9fd-4d3b-bfa0-08c7fed08ca8 service glance] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:38:59.273832 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:38:59.308199 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96a646-4d33-4abf-8b72-46ec865daf70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:38:59.309191 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96a646-4d33-4abf-8b72-46ec865daf70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:38:59.309543 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96a646-4d33-4abf-8b72-46ec865daf70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:38:59.309919 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96a646-4d33-4abf-8b72-46ec865daf70 admin admin] PATH_INFO: `/v3/users/ee713c37f4f54368ba9d4557e4acb1bb` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:38:59.311843 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe96a646-4d33-4abf-8b72-46ec865daf70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee713c37f4f54368ba9d4557e4acb1bb)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:38:59.314218 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe96a646-4d33-4abf-8b72-46ec865daf70 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:38:59.374813 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-fe96a646-4d33-4abf-8b72-46ec865daf70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee713c37f4f54368ba9d4557e4acb1bb'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:59.375490 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-fe96a646-4d33-4abf-8b72-46ec865daf70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee713c37f4f54368ba9d4557e4acb1bb'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:59.383107 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-fe96a646-4d33-4abf-8b72-46ec865daf70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee713c37f4f54368ba9d4557e4acb1bb'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:59.413629 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-fe96a646-4d33-4abf-8b72-46ec865daf70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee713c37f4f54368ba9d4557e4acb1bb'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:59.431228 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-fe96a646-4d33-4abf-8b72-46ec865daf70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee713c37f4f54368ba9d4557e4acb1bb'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:38:59.445391 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 993/1986] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:38:59 2022] DELETE /identity/v3/users/ee713c37f4f54368ba9d4557e4acb1bb => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:39:00.688603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777000f-a890-41f7-8b5c-1d19e94c921e admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:00.690404 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-3777000f-a890-41f7-8b5c-1d19e94c921e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:00.716269 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777000f-a890-41f7-8b5c-1d19e94c921e admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:00.806703 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729868b5-b0ff-4241-b3bd-a827e19619d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:00.807751 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729868b5-b0ff-4241-b3bd-a827e19619d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:00.808099 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729868b5-b0ff-4241-b3bd-a827e19619d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:00.808442 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729868b5-b0ff-4241-b3bd-a827e19619d7 admin admin] PATH_INFO: `/v3/projects/180af7e2a6bd4786918da2adb919629f` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:00.809800 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729868b5-b0ff-4241-b3bd-a827e19619d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=180af7e2a6bd4786918da2adb919629f)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:00.812090 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729868b5-b0ff-4241-b3bd-a827e19619d7 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:00.815105 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:00.905832 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-729868b5-b0ff-4241-b3bd-a827e19619d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '180af7e2a6bd4786918da2adb919629f', 'request_id': 'req-729868b5-b0ff-4241-b3bd-a827e19619d7'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:00.929407 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-729868b5-b0ff-4241-b3bd-a827e19619d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '180af7e2a6bd4786918da2adb919629f', 'request_id': 'req-729868b5-b0ff-4241-b3bd-a827e19619d7'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:00.935833 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-729868b5-b0ff-4241-b3bd-a827e19619d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '180af7e2a6bd4786918da2adb919629f', 'request_id': 'req-729868b5-b0ff-4241-b3bd-a827e19619d7'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:00.953053 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-729868b5-b0ff-4241-b3bd-a827e19619d7 admin admin] The token cache is being invalidate because project 180af7e2a6bd4786918da2adb919629f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80150) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:39:00.953566 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-729868b5-b0ff-4241-b3bd-a827e19619d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:00.954431 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-729868b5-b0ff-4241-b3bd-a827e19619d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:00.956176 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 994/1987] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:39:00 2022] DELETE /identity/v3/projects/180af7e2a6bd4786918da2adb919629f => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:39:00.961279 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d17a98-2397-4cc0-8c67-8b0d65ecce99 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:00.961904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d17a98-2397-4cc0-8c67-8b0d65ecce99 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:00.962205 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d17a98-2397-4cc0-8c67-8b0d65ecce99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:00.982101 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-c9d17a98-2397-4cc0-8c67-8b0d65ecce99 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:00.983348 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c9d17a98-2397-4cc0-8c67-8b0d65ecce99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:01.068606 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 994/1988] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:39:01.078187 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b50513-2c69-458b-abdc-15f2e315eaae None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:01.078476 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b50513-2c69-458b-abdc-15f2e315eaae None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:01.078754 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b50513-2c69-458b-abdc-15f2e315eaae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:01.099631 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-87b50513-2c69-458b-abdc-15f2e315eaae None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:01.100954 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-87b50513-2c69-458b-abdc-15f2e315eaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:01.114943 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 995/1989] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:39:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:39:01.115838 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d17a98-2397-4cc0-8c67-8b0d65ecce99 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:01.126790 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d17a98-2397-4cc0-8c67-8b0d65ecce99 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:01.139875 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b214b3-5594-46a8-83af-3bdd4cb9dfd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:01.140941 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b214b3-5594-46a8-83af-3bdd4cb9dfd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:01.141221 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b214b3-5594-46a8-83af-3bdd4cb9dfd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:01.141588 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b214b3-5594-46a8-83af-3bdd4cb9dfd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:01.142403 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b214b3-5594-46a8-83af-3bdd4cb9dfd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:39:01.142692 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b214b3-5594-46a8-83af-3bdd4cb9dfd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:01.145316 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b214b3-5594-46a8-83af-3bdd4cb9dfd3 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:01.165703 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 995/1990] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:39:01.166357 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b50513-2c69-458b-abdc-15f2e315eaae None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:01.176331 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b50513-2c69-458b-abdc-15f2e315eaae None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:01.182600 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b76163-35e9-48aa-96ee-90fbeaa9e980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:01.183233 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b76163-35e9-48aa-96ee-90fbeaa9e980 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:01.183520 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b76163-35e9-48aa-96ee-90fbeaa9e980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:01.183799 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b76163-35e9-48aa-96ee-90fbeaa9e980 admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:01.184512 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b76163-35e9-48aa-96ee-90fbeaa9e980 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:01.186530 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b76163-35e9-48aa-96ee-90fbeaa9e980 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:01.225853 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 996/1991] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:39:01 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 17:39:01.229114 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b214b3-5594-46a8-83af-3bdd4cb9dfd3 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:01.240478 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b214b3-5594-46a8-83af-3bdd4cb9dfd3 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:01.291477 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:01.324362 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa92b1e-4cd2-4479-8c98-13633f97a5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:01.325301 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa92b1e-4cd2-4479-8c98-13633f97a5be admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:01.325669 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa92b1e-4cd2-4479-8c98-13633f97a5be admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:01.326198 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa92b1e-4cd2-4479-8c98-13633f97a5be admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:01.327022 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa92b1e-4cd2-4479-8c98-13633f97a5be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:01.329821 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa92b1e-4cd2-4479-8c98-13633f97a5be admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:01.361527 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 996/1992] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:39:01 2022] POST /identity/v3/users => generated 290 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:39:01.366527 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b76163-35e9-48aa-96ee-90fbeaa9e980 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:01.378925 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b76163-35e9-48aa-96ee-90fbeaa9e980 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:01.386438 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b145d76-1a2d-4d6f-9687-cbf6981a5ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:01.387590 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b145d76-1a2d-4d6f-9687-cbf6981a5ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:01.387952 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b145d76-1a2d-4d6f-9687-cbf6981a5ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:01.388156 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b145d76-1a2d-4d6f-9687-cbf6981a5ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:01.388945 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b145d76-1a2d-4d6f-9687-cbf6981a5ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:01.391478 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b145d76-1a2d-4d6f-9687-cbf6981a5ba6 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:01.410719 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 997/1993] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:39:01.414851 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa92b1e-4cd2-4479-8c98-13633f97a5be admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:01.428200 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa92b1e-4cd2-4479-8c98-13633f97a5be admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:01.433502 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae0ec6-9c80-4b3f-b658-b4330a684247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:01.434449 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae0ec6-9c80-4b3f-b658-b4330a684247 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:01.434736 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae0ec6-9c80-4b3f-b658-b4330a684247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:01.435071 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae0ec6-9c80-4b3f-b658-b4330a684247 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:01.435833 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aae0ec6-9c80-4b3f-b658-b4330a684247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:01.437878 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aae0ec6-9c80-4b3f-b658-b4330a684247 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:01.452483 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 997/1994] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:39:01.453925 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b145d76-1a2d-4d6f-9687-cbf6981a5ba6 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:01.474654 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b145d76-1a2d-4d6f-9687-cbf6981a5ba6 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:01.479866 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c798dc7-16c3-45f6-88db-b3be4c81e5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:01.481478 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c798dc7-16c3-45f6-88db-b3be4c81e5ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:01.481478 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c798dc7-16c3-45f6-88db-b3be4c81e5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:01.481478 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c798dc7-16c3-45f6-88db-b3be4c81e5ca admin admin] PATH_INFO: `/v3/projects/83668b789f82421b9c84a9a93da61c38/users/94573a635bb34f75bb93b169aa061d28/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:01.500666 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c798dc7-16c3-45f6-88db-b3be4c81e5ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=83668b789f82421b9c84a9a93da61c38, user_id=94573a635bb34f75bb93b169aa061d28, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:01.503393 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c798dc7-16c3-45f6-88db-b3be4c81e5ca admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:01.518792 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 998/1995] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:39:01 2022] PUT /identity/v3/projects/83668b789f82421b9c84a9a93da61c38/users/94573a635bb34f75bb93b169aa061d28/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:39:01.529616 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b2d17-f4e8-4770-ae53-4b934261ca5c None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:01.529999 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b2d17-f4e8-4770-ae53-4b934261ca5c None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:01.530283 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b2d17-f4e8-4770-ae53-4b934261ca5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:01.561144 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-b27b2d17-f4e8-4770-ae53-4b934261ca5c None None] MFA Rules not processed for user `94573a635bb34f75bb93b169aa061d28`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:01.562563 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b27b2d17-f4e8-4770-ae53-4b934261ca5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:01.632970 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 998/1996] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:39:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:39:01.637248 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c798dc7-16c3-45f6-88db-b3be4c81e5ca admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:01.698746 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c798dc7-16c3-45f6-88db-b3be4c81e5ca admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:01.703736 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6eaba8-f3e7-4238-91d9-89799e9fe91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:01.704430 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6eaba8-f3e7-4238-91d9-89799e9fe91b admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:01.704710 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6eaba8-f3e7-4238-91d9-89799e9fe91b admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:01.705256 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6eaba8-f3e7-4238-91d9-89799e9fe91b admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:01.705997 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6eaba8-f3e7-4238-91d9-89799e9fe91b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:01.707910 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6eaba8-f3e7-4238-91d9-89799e9fe91b admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:01.739519 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 999/1997] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:39:01 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:39:01.743789 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b2d17-f4e8-4770-ae53-4b934261ca5c None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:01.755919 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b2d17-f4e8-4770-ae53-4b934261ca5c None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:01.817254 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e278e-77cc-440b-9744-5dfae08837f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:01.817980 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e278e-77cc-440b-9744-5dfae08837f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:01.818265 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e278e-77cc-440b-9744-5dfae08837f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:01.818544 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e278e-77cc-440b-9744-5dfae08837f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:01.819261 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8e278e-77cc-440b-9744-5dfae08837f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:01.821419 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8e278e-77cc-440b-9744-5dfae08837f4 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:01.845316 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 999/1998] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:39:01 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:39:01.849456 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6eaba8-f3e7-4238-91d9-89799e9fe91b admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:01.861456 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6eaba8-f3e7-4238-91d9-89799e9fe91b admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:01.866378 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b162bb-0e9e-4512-b529-d1dc9e7b44ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:01.867068 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b162bb-0e9e-4512-b529-d1dc9e7b44ff admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:01.867351 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b162bb-0e9e-4512-b529-d1dc9e7b44ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:01.867626 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b162bb-0e9e-4512-b529-d1dc9e7b44ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:01.868432 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b162bb-0e9e-4512-b529-d1dc9e7b44ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:01.870245 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b162bb-0e9e-4512-b529-d1dc9e7b44ff admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:01.881697 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1000/1999] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:39:01.886218 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e278e-77cc-440b-9744-5dfae08837f4 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:01.896576 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e278e-77cc-440b-9744-5dfae08837f4 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:01.901431 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a3f54-a8f0-4d87-9b62-b74c6e4c4977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:01.902139 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a3f54-a8f0-4d87-9b62-b74c6e4c4977 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:01.902426 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a3f54-a8f0-4d87-9b62-b74c6e4c4977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:01.902698 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a3f54-a8f0-4d87-9b62-b74c6e4c4977 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:01.903450 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168a3f54-a8f0-4d87-9b62-b74c6e4c4977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:01.905076 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168a3f54-a8f0-4d87-9b62-b74c6e4c4977 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:01.916128 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1000/2000] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 17:39:01.920427 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b162bb-0e9e-4512-b529-d1dc9e7b44ff admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:01.926034 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:01.933662 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b162bb-0e9e-4512-b529-d1dc9e7b44ff admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:01.940861 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd18d1-6928-4e13-86af-eb26cbe32a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:01.941917 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd18d1-6928-4e13-86af-eb26cbe32a87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:01.942376 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd18d1-6928-4e13-86af-eb26cbe32a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:01.942803 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd18d1-6928-4e13-86af-eb26cbe32a87 admin admin] PATH_INFO: `/v3/projects/96194de4429a4220bf7f84953784632c/users/d4a8557797344d8a9ecde00d53c7b4e9/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:01.960226 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdd18d1-6928-4e13-86af-eb26cbe32a87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96194de4429a4220bf7f84953784632c, user_id=d4a8557797344d8a9ecde00d53c7b4e9, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:01.963091 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdd18d1-6928-4e13-86af-eb26cbe32a87 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:01.979074 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1001/2001] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:39:01 2022] PUT /identity/v3/projects/96194de4429a4220bf7f84953784632c/users/d4a8557797344d8a9ecde00d53c7b4e9/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:39:01.990223 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ead21-481f-4b4f-a4dd-2be9862640ce None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:01.990765 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ead21-481f-4b4f-a4dd-2be9862640ce None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:01.990947 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ead21-481f-4b4f-a4dd-2be9862640ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:02.022107 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-0e8ead21-481f-4b4f-a4dd-2be9862640ce None None] MFA Rules not processed for user `d4a8557797344d8a9ecde00d53c7b4e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:02.023588 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-0e8ead21-481f-4b4f-a4dd-2be9862640ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:02.043067 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:02.105656 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1001/2002] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:39:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:39:02.110084 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd18d1-6928-4e13-86af-eb26cbe32a87 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:02.178901 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd18d1-6928-4e13-86af-eb26cbe32a87 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:02.183759 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680ee3c-c4ba-4b6f-83d7-3365f8bd0963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:02.184435 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680ee3c-c4ba-4b6f-83d7-3365f8bd0963 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:02.184718 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680ee3c-c4ba-4b6f-83d7-3365f8bd0963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:02.184995 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680ee3c-c4ba-4b6f-83d7-3365f8bd0963 admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:02.185698 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5680ee3c-c4ba-4b6f-83d7-3365f8bd0963 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:02.187709 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5680ee3c-c4ba-4b6f-83d7-3365f8bd0963 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:02.225870 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1002/2003] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:39:02 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:39:02.230220 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ead21-481f-4b4f-a4dd-2be9862640ce None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:02.252666 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ead21-481f-4b4f-a4dd-2be9862640ce None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:02.364840 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ebeab-fa5d-46eb-941c-f4b489ae6197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:02.365540 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ebeab-fa5d-46eb-941c-f4b489ae6197 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:02.365853 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ebeab-fa5d-46eb-941c-f4b489ae6197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:02.366135 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ebeab-fa5d-46eb-941c-f4b489ae6197 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:02.366901 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509ebeab-fa5d-46eb-941c-f4b489ae6197 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:02.369826 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509ebeab-fa5d-46eb-941c-f4b489ae6197 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:02.401262 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1002/2004] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:39:02 2022] POST /identity/v3/users => generated 296 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:39:02.402577 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680ee3c-c4ba-4b6f-83d7-3365f8bd0963 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:02.414665 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680ee3c-c4ba-4b6f-83d7-3365f8bd0963 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:02.419846 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6789d0-2e56-4c8e-ad9b-1b2112c6f591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:02.420558 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6789d0-2e56-4c8e-ad9b-1b2112c6f591 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:02.421310 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6789d0-2e56-4c8e-ad9b-1b2112c6f591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:02.421310 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6789d0-2e56-4c8e-ad9b-1b2112c6f591 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:02.422039 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6789d0-2e56-4c8e-ad9b-1b2112c6f591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:02.423795 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6789d0-2e56-4c8e-ad9b-1b2112c6f591 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:02.436781 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1003/2005] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 17:39:02.440890 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ebeab-fa5d-46eb-941c-f4b489ae6197 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:02.453950 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ebeab-fa5d-46eb-941c-f4b489ae6197 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:02.458825 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c0ffac-e63a-488a-a692-7922bc1acfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:02.459745 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0ffac-e63a-488a-a692-7922bc1acfd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:02.460032 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0ffac-e63a-488a-a692-7922bc1acfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:02.460312 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0ffac-e63a-488a-a692-7922bc1acfd4 admin admin] PATH_INFO: `/v3/projects/ae3b9852595c4082bc578ed72914c577/users/7d75bad9fdf444a1893916efeb319b78/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:02.477559 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c0ffac-e63a-488a-a692-7922bc1acfd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae3b9852595c4082bc578ed72914c577, user_id=7d75bad9fdf444a1893916efeb319b78, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:02.480443 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c0ffac-e63a-488a-a692-7922bc1acfd4 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:02.497365 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1003/2006] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:39:02 2022] PUT /identity/v3/projects/ae3b9852595c4082bc578ed72914c577/users/7d75bad9fdf444a1893916efeb319b78/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:39:02.501151 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6789d0-2e56-4c8e-ad9b-1b2112c6f591 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:02.521015 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6789d0-2e56-4c8e-ad9b-1b2112c6f591 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:02.594272 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf4e2bf-81a1-45e4-a012-db1216925e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:02.595259 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4e2bf-81a1-45e4-a012-db1216925e3c admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:02.595701 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4e2bf-81a1-45e4-a012-db1216925e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:02.596286 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4e2bf-81a1-45e4-a012-db1216925e3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:02.598896 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf4e2bf-81a1-45e4-a012-db1216925e3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:02.600915 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf4e2bf-81a1-45e4-a012-db1216925e3c admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:02.613961 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1004/2007] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 17:39:02.619686 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c0ffac-e63a-488a-a692-7922bc1acfd4 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:02.631536 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c0ffac-e63a-488a-a692-7922bc1acfd4 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:02.639461 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd99f1f-5a4d-45d3-a409-c7357132d7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:02.640405 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd99f1f-5a4d-45d3-a409-c7357132d7d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:02.641289 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd99f1f-5a4d-45d3-a409-c7357132d7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:02.641289 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd99f1f-5a4d-45d3-a409-c7357132d7d8 admin admin] PATH_INFO: `/v3/projects/ae3b9852595c4082bc578ed72914c577/users/7d75bad9fdf444a1893916efeb319b78/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:02.644610 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd99f1f-5a4d-45d3-a409-c7357132d7d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae3b9852595c4082bc578ed72914c577, user_id=7d75bad9fdf444a1893916efeb319b78, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:02.648094 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd99f1f-5a4d-45d3-a409-c7357132d7d8 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:02.670783 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1004/2008] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:39:02 2022] PUT /identity/v3/projects/ae3b9852595c4082bc578ed72914c577/users/7d75bad9fdf444a1893916efeb319b78/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:39:02.682068 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d64ea1-5b0f-4966-99fe-3ab11681f639 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:02.682388 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d64ea1-5b0f-4966-99fe-3ab11681f639 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:02.682636 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d64ea1-5b0f-4966-99fe-3ab11681f639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:02.711250 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-c4d64ea1-5b0f-4966-99fe-3ab11681f639 None None] MFA Rules not processed for user `7d75bad9fdf444a1893916efeb319b78`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:02.712544 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-c4d64ea1-5b0f-4966-99fe-3ab11681f639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:02.755385 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:02.788697 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1005/2009] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:39:02 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:39:02.803048 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd99f1f-5a4d-45d3-a409-c7357132d7d8 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:02.805135 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-dbd99f1f-5a4d-45d3-a409-c7357132d7d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:02.868916 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd99f1f-5a4d-45d3-a409-c7357132d7d8 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:02.872551 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a83a5-5038-4081-a33f-17828c167ea1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:02.873200 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a83a5-5038-4081-a33f-17828c167ea1 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:02.873478 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a83a5-5038-4081-a33f-17828c167ea1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:02.873746 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a83a5-5038-4081-a33f-17828c167ea1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:02.883898 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7a83a5-5038-4081-a33f-17828c167ea1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:02.885314 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7a83a5-5038-4081-a33f-17828c167ea1 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:02.895997 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1005/2010] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:39:02 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:39:02.938731 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d64ea1-5b0f-4966-99fe-3ab11681f639 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:02.940131 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-c4d64ea1-5b0f-4966-99fe-3ab11681f639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:02.954777 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d64ea1-5b0f-4966-99fe-3ab11681f639 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:02.958717 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7dfa50-e331-4fb3-99c1-38464d7b8c95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:02.959401 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7dfa50-e331-4fb3-99c1-38464d7b8c95 service cinder] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:02.959713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7dfa50-e331-4fb3-99c1-38464d7b8c95 service cinder] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:02.959986 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7dfa50-e331-4fb3-99c1-38464d7b8c95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:03.022813 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7dfa50-e331-4fb3-99c1-38464d7b8c95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:03.024259 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7dfa50-e331-4fb3-99c1-38464d7b8c95 service cinder] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:03.034707 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1006/2011] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:39:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:39:06.307813 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a83a5-5038-4081-a33f-17828c167ea1 service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:06.337637 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:06.406254 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a83a5-5038-4081-a33f-17828c167ea1 service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:06.410965 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb48d1-eaa8-447e-b269-2ed2f36caabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:06.411989 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb48d1-eaa8-447e-b269-2ed2f36caabc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:06.412428 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb48d1-eaa8-447e-b269-2ed2f36caabc admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:06.412693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb48d1-eaa8-447e-b269-2ed2f36caabc admin admin] PATH_INFO: `/v3/users/94573a635bb34f75bb93b169aa061d28` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:06.413977 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb48d1-eaa8-447e-b269-2ed2f36caabc admin admin] RBAC: Authorizing `identity:delete_user(user_id=94573a635bb34f75bb93b169aa061d28)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:06.416304 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb48d1-eaa8-447e-b269-2ed2f36caabc admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:06.522122 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-aefb48d1-eaa8-447e-b269-2ed2f36caabc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94573a635bb34f75bb93b169aa061d28'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:06.522916 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-aefb48d1-eaa8-447e-b269-2ed2f36caabc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94573a635bb34f75bb93b169aa061d28'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:06.533048 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-aefb48d1-eaa8-447e-b269-2ed2f36caabc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94573a635bb34f75bb93b169aa061d28'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:06.550190 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-aefb48d1-eaa8-447e-b269-2ed2f36caabc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94573a635bb34f75bb93b169aa061d28'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:06.565135 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-aefb48d1-eaa8-447e-b269-2ed2f36caabc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94573a635bb34f75bb93b169aa061d28'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:06.578682 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1006/2012] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:39:06 2022] DELETE /identity/v3/users/94573a635bb34f75bb93b169aa061d28 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:39:06.583016 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bd256-c435-4db8-b28d-029b380c6982 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:06.583540 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bd256-c435-4db8-b28d-029b380c6982 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:06.583747 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bd256-c435-4db8-b28d-029b380c6982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:06.616815 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-f14bd256-c435-4db8-b28d-029b380c6982 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:06.618500 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-f14bd256-c435-4db8-b28d-029b380c6982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:06.659677 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb48d1-eaa8-447e-b269-2ed2f36caabc admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:06.661537 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-aefb48d1-eaa8-447e-b269-2ed2f36caabc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:06.701653 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1007/2013] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:39:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:39:06.709936 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14bd256-c435-4db8-b28d-029b380c6982 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:06.712324 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-f14bd256-c435-4db8-b28d-029b380c6982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:06.779899 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb48d1-eaa8-447e-b269-2ed2f36caabc admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:06.785138 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3d81f-a21c-45d6-be79-9700d3b3b61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:06.786701 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3d81f-a21c-45d6-be79-9700d3b3b61d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:06.786991 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3d81f-a21c-45d6-be79-9700d3b3b61d admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:06.787269 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3d81f-a21c-45d6-be79-9700d3b3b61d admin admin] PATH_INFO: `/v3/users/c74dd7359f33431baa46ef7e2a84024a` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:06.788535 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b3d81f-a21c-45d6-be79-9700d3b3b61d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c74dd7359f33431baa46ef7e2a84024a)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:06.790621 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b3d81f-a21c-45d6-be79-9700d3b3b61d admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:06.803768 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14bd256-c435-4db8-b28d-029b380c6982 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:06.808285 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df3dee-da78-4859-ae51-69fe5432aa1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:06.809488 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df3dee-da78-4859-ae51-69fe5432aa1e service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:06.809621 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df3dee-da78-4859-ae51-69fe5432aa1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:06.809933 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df3dee-da78-4859-ae51-69fe5432aa1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:06.827947 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df3dee-da78-4859-ae51-69fe5432aa1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:06.830042 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df3dee-da78-4859-ae51-69fe5432aa1e service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:06.844301 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:06.847850 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1008/2014] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:39:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 17:39:06.861985 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-12b3d81f-a21c-45d6-be79-9700d3b3b61d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c74dd7359f33431baa46ef7e2a84024a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:06.863167 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-12b3d81f-a21c-45d6-be79-9700d3b3b61d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c74dd7359f33431baa46ef7e2a84024a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:06.875708 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-12b3d81f-a21c-45d6-be79-9700d3b3b61d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c74dd7359f33431baa46ef7e2a84024a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:06.900468 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-12b3d81f-a21c-45d6-be79-9700d3b3b61d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c74dd7359f33431baa46ef7e2a84024a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:06.910618 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-12b3d81f-a21c-45d6-be79-9700d3b3b61d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c74dd7359f33431baa46ef7e2a84024a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:06.919176 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1007/2015] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:39:06 2022] DELETE /identity/v3/users/c74dd7359f33431baa46ef7e2a84024a => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:39:07.197935 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df3dee-da78-4859-ae51-69fe5432aa1e service neutron] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:07.211423 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df3dee-da78-4859-ae51-69fe5432aa1e service neutron] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:07.230171 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:07.294002 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d7c31-1ebb-4f7c-a6f2-5b0223f3410a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:07.294965 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d7c31-1ebb-4f7c-a6f2-5b0223f3410a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:07.295244 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d7c31-1ebb-4f7c-a6f2-5b0223f3410a admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:07.295517 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d7c31-1ebb-4f7c-a6f2-5b0223f3410a admin admin] PATH_INFO: `/v3/projects/e878db375d0d433f8371b02f9b4a0d4e` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:07.296921 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832d7c31-1ebb-4f7c-a6f2-5b0223f3410a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e878db375d0d433f8371b02f9b4a0d4e)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:07.298928 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832d7c31-1ebb-4f7c-a6f2-5b0223f3410a admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:07.307650 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3d81f-a21c-45d6-be79-9700d3b3b61d admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:07.309117 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-12b3d81f-a21c-45d6-be79-9700d3b3b61d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:07.325980 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3d81f-a21c-45d6-be79-9700d3b3b61d admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:07.334495 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861674cd-a008-4ecc-8739-dc128af25793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:07.335541 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861674cd-a008-4ecc-8739-dc128af25793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:07.335859 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861674cd-a008-4ecc-8739-dc128af25793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:07.336155 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861674cd-a008-4ecc-8739-dc128af25793 admin admin] PATH_INFO: `/v3/projects/83668b789f82421b9c84a9a93da61c38` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:07.337836 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861674cd-a008-4ecc-8739-dc128af25793 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83668b789f82421b9c84a9a93da61c38)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:07.339931 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861674cd-a008-4ecc-8739-dc128af25793 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:07.358134 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-832d7c31-1ebb-4f7c-a6f2-5b0223f3410a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e878db375d0d433f8371b02f9b4a0d4e', 'request_id': 'req-832d7c31-1ebb-4f7c-a6f2-5b0223f3410a'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:07.371076 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-832d7c31-1ebb-4f7c-a6f2-5b0223f3410a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e878db375d0d433f8371b02f9b4a0d4e', 'request_id': 'req-832d7c31-1ebb-4f7c-a6f2-5b0223f3410a'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:07.378197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-832d7c31-1ebb-4f7c-a6f2-5b0223f3410a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e878db375d0d433f8371b02f9b4a0d4e', 'request_id': 'req-832d7c31-1ebb-4f7c-a6f2-5b0223f3410a'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:07.390493 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-832d7c31-1ebb-4f7c-a6f2-5b0223f3410a admin admin] The token cache is being invalidate because project e878db375d0d433f8371b02f9b4a0d4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80150) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:39:07.390892 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-832d7c31-1ebb-4f7c-a6f2-5b0223f3410a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:07.391541 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-832d7c31-1ebb-4f7c-a6f2-5b0223f3410a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:07.393114 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1009/2016] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:39:07 2022] DELETE /identity/v3/projects/e878db375d0d433f8371b02f9b4a0d4e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:39:07.394785 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-861674cd-a008-4ecc-8739-dc128af25793 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83668b789f82421b9c84a9a93da61c38', 'request_id': 'req-861674cd-a008-4ecc-8739-dc128af25793'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:07.398041 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1efeab-c89b-4cf8-9911-f3cc9bc5b7e6 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:07.398331 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1efeab-c89b-4cf8-9911-f3cc9bc5b7e6 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:07.398610 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1efeab-c89b-4cf8-9911-f3cc9bc5b7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:07.404481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-861674cd-a008-4ecc-8739-dc128af25793 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83668b789f82421b9c84a9a93da61c38', 'request_id': 'req-861674cd-a008-4ecc-8739-dc128af25793'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:07.410221 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-861674cd-a008-4ecc-8739-dc128af25793 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83668b789f82421b9c84a9a93da61c38', 'request_id': 'req-861674cd-a008-4ecc-8739-dc128af25793'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:07.417647 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-ce1efeab-c89b-4cf8-9911-f3cc9bc5b7e6 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:07.418929 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-ce1efeab-c89b-4cf8-9911-f3cc9bc5b7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:07.421636 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-861674cd-a008-4ecc-8739-dc128af25793 admin admin] The token cache is being invalidate because project 83668b789f82421b9c84a9a93da61c38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:39:07.421964 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-861674cd-a008-4ecc-8739-dc128af25793 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:07.422628 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-861674cd-a008-4ecc-8739-dc128af25793 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:07.424521 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1008/2017] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:39:07 2022] DELETE /identity/v3/projects/83668b789f82421b9c84a9a93da61c38 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:39:07.428089 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861674cd-a008-4ecc-8739-dc128af25793 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:07.429405 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-861674cd-a008-4ecc-8739-dc128af25793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:07.487821 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1010/2018] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:39:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:39:07.491111 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39847a-6799-4976-87b8-df9ec967dd3f None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:07.491407 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39847a-6799-4976-87b8-df9ec967dd3f None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:07.491690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39847a-6799-4976-87b8-df9ec967dd3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:07.501565 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861674cd-a008-4ecc-8739-dc128af25793 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:07.506420 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb1a1f-6c01-4381-8d6a-190a7fc77521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:07.508273 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb1a1f-6c01-4381-8d6a-190a7fc77521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:07.508576 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb1a1f-6c01-4381-8d6a-190a7fc77521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:07.508952 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb1a1f-6c01-4381-8d6a-190a7fc77521 admin admin] PATH_INFO: `/v3/users/d4a8557797344d8a9ecde00d53c7b4e9` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:07.510425 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb1a1f-6c01-4381-8d6a-190a7fc77521 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4a8557797344d8a9ecde00d53c7b4e9)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:07.512353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb1a1f-6c01-4381-8d6a-190a7fc77521 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:07.515016 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-4a39847a-6799-4976-87b8-df9ec967dd3f None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:07.515945 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-4a39847a-6799-4976-87b8-df9ec967dd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:07.525165 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1011/2019] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:39:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:39:07.529375 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39847a-6799-4976-87b8-df9ec967dd3f None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:07.538341 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39847a-6799-4976-87b8-df9ec967dd3f None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:07.543348 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6402b79-f465-4f74-bb36-79f6af90c513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:07.544007 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6402b79-f465-4f74-bb36-79f6af90c513 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:07.544300 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6402b79-f465-4f74-bb36-79f6af90c513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:07.544565 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6402b79-f465-4f74-bb36-79f6af90c513 admin admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:07.545300 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6402b79-f465-4f74-bb36-79f6af90c513 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:39:07.545603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6402b79-f465-4f74-bb36-79f6af90c513 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:07.547280 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6402b79-f465-4f74-bb36-79f6af90c513 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:07.554621 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:07.560295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1012/2020] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:39:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:39:07.565605 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6402b79-f465-4f74-bb36-79f6af90c513 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:07.566715 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-67bb1a1f-6c01-4381-8d6a-190a7fc77521 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4a8557797344d8a9ecde00d53c7b4e9'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:07.567441 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-67bb1a1f-6c01-4381-8d6a-190a7fc77521 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4a8557797344d8a9ecde00d53c7b4e9'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:07.577188 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6402b79-f465-4f74-bb36-79f6af90c513 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:07.577358 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-67bb1a1f-6c01-4381-8d6a-190a7fc77521 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4a8557797344d8a9ecde00d53c7b4e9'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:07.586377 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c759dbe-d220-4b9f-8223-524bcd931d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:07.587652 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c759dbe-d220-4b9f-8223-524bcd931d41 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:07.587652 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c759dbe-d220-4b9f-8223-524bcd931d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:07.587942 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c759dbe-d220-4b9f-8223-524bcd931d41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:07.588851 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c759dbe-d220-4b9f-8223-524bcd931d41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:07.590892 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c759dbe-d220-4b9f-8223-524bcd931d41 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:07.593325 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-67bb1a1f-6c01-4381-8d6a-190a7fc77521 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4a8557797344d8a9ecde00d53c7b4e9'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:07.605703 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-67bb1a1f-6c01-4381-8d6a-190a7fc77521 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4a8557797344d8a9ecde00d53c7b4e9'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:07.612716 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1009/2021] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:39:07 2022] DELETE /identity/v3/users/d4a8557797344d8a9ecde00d53c7b4e9 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:39:07.624319 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1013/2022] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:39:07 2022] POST /identity/v3/projects => generated 369 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:39:07.626024 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb1a1f-6c01-4381-8d6a-190a7fc77521 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:07.627445 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-67bb1a1f-6c01-4381-8d6a-190a7fc77521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:07.701228 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb1a1f-6c01-4381-8d6a-190a7fc77521 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:07.762074 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5277d6-f6c2-487e-b16c-afbf9d411194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:07.762762 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5277d6-f6c2-487e-b16c-afbf9d411194 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:07.763043 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5277d6-f6c2-487e-b16c-afbf9d411194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:07.763316 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5277d6-f6c2-487e-b16c-afbf9d411194 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:07.764009 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5277d6-f6c2-487e-b16c-afbf9d411194 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:07.765976 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5277d6-f6c2-487e-b16c-afbf9d411194 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:07.792766 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1010/2023] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:39:07 2022] POST /identity/v3/users => generated 285 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:39:07.794314 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c759dbe-d220-4b9f-8223-524bcd931d41 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:07.801703 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:07.807177 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c759dbe-d220-4b9f-8223-524bcd931d41 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:07.819462 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ac326-9213-4d16-9500-02215f6d8956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:07.820353 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ac326-9213-4d16-9500-02215f6d8956 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:07.821051 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ac326-9213-4d16-9500-02215f6d8956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:07.821527 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ac326-9213-4d16-9500-02215f6d8956 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:07.823181 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243ac326-9213-4d16-9500-02215f6d8956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:07.825344 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243ac326-9213-4d16-9500-02215f6d8956 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:07.838911 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1014/2024] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:39:07.843783 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5277d6-f6c2-487e-b16c-afbf9d411194 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:07.862318 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5277d6-f6c2-487e-b16c-afbf9d411194 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:07.872393 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bbae3b-032f-464a-9128-aae81e9c35e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:07.873081 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbae3b-032f-464a-9128-aae81e9c35e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:07.873606 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbae3b-032f-464a-9128-aae81e9c35e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:07.875073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbae3b-032f-464a-9128-aae81e9c35e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:07.876306 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bbae3b-032f-464a-9128-aae81e9c35e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:07.885927 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bbae3b-032f-464a-9128-aae81e9c35e9 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:07.896067 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1011/2025] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 17:39:07.900072 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ac326-9213-4d16-9500-02215f6d8956 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:07.911106 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ac326-9213-4d16-9500-02215f6d8956 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:07.918725 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8859a8-0aac-4eda-911a-ad17ca2a5893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:07.919663 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8859a8-0aac-4eda-911a-ad17ca2a5893 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:07.919948 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8859a8-0aac-4eda-911a-ad17ca2a5893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:07.920226 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8859a8-0aac-4eda-911a-ad17ca2a5893 admin admin] PATH_INFO: `/v3/projects/fd6611c177d243cf8fbb76b613c529ad/users/bed81a5a6ca44801ab65044320e49df6/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:07.936716 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8859a8-0aac-4eda-911a-ad17ca2a5893 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd6611c177d243cf8fbb76b613c529ad, user_id=bed81a5a6ca44801ab65044320e49df6, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:07.939623 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8859a8-0aac-4eda-911a-ad17ca2a5893 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:07.954365 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1015/2026] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:39:07 2022] PUT /identity/v3/projects/fd6611c177d243cf8fbb76b613c529ad/users/bed81a5a6ca44801ab65044320e49df6/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:39:07.965061 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad163502-e536-4da7-b5f6-cecde7af2127 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:07.965379 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad163502-e536-4da7-b5f6-cecde7af2127 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:07.965649 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad163502-e536-4da7-b5f6-cecde7af2127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:07.995915 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-ad163502-e536-4da7-b5f6-cecde7af2127 None None] MFA Rules not processed for user `bed81a5a6ca44801ab65044320e49df6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:07.996129 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8859a8-0aac-4eda-911a-ad17ca2a5893 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:07.997502 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ad163502-e536-4da7-b5f6-cecde7af2127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:07.998165 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-7b8859a8-0aac-4eda-911a-ad17ca2a5893 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:08.040975 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:08.077759 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8859a8-0aac-4eda-911a-ad17ca2a5893 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:08.082598 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b2599-4ac7-49b7-969a-023e4605549f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:08.083497 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b2599-4ac7-49b7-969a-023e4605549f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:08.083849 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b2599-4ac7-49b7-969a-023e4605549f admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:08.084142 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1012/2027] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:39:07 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:39:08.088157 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b2599-4ac7-49b7-969a-023e4605549f admin admin] PATH_INFO: `/v3/projects/96194de4429a4220bf7f84953784632c` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:08.088157 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562b2599-4ac7-49b7-969a-023e4605549f admin admin] RBAC: Authorizing `identity:delete_project(project_id=96194de4429a4220bf7f84953784632c)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:08.088157 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562b2599-4ac7-49b7-969a-023e4605549f admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:08.088986 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad163502-e536-4da7-b5f6-cecde7af2127 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:08.111329 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad163502-e536-4da7-b5f6-cecde7af2127 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:08.118104 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b18ff6-e5fa-4433-92da-bb3b09103d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:08.118990 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b18ff6-e5fa-4433-92da-bb3b09103d48 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:08.119237 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b18ff6-e5fa-4433-92da-bb3b09103d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:08.119614 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b18ff6-e5fa-4433-92da-bb3b09103d48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:08.120423 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b18ff6-e5fa-4433-92da-bb3b09103d48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:08.122801 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b18ff6-e5fa-4433-92da-bb3b09103d48 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:08.150261 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-562b2599-4ac7-49b7-969a-023e4605549f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96194de4429a4220bf7f84953784632c', 'request_id': 'req-562b2599-4ac7-49b7-969a-023e4605549f'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:08.156204 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1013/2028] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:39:08 2022] POST /identity/v3/projects => generated 369 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 17:39:08.160022 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b18ff6-e5fa-4433-92da-bb3b09103d48 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:08.164195 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-562b2599-4ac7-49b7-969a-023e4605549f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96194de4429a4220bf7f84953784632c', 'request_id': 'req-562b2599-4ac7-49b7-969a-023e4605549f'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:08.171206 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-562b2599-4ac7-49b7-969a-023e4605549f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96194de4429a4220bf7f84953784632c', 'request_id': 'req-562b2599-4ac7-49b7-969a-023e4605549f'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:08.186129 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-562b2599-4ac7-49b7-969a-023e4605549f admin admin] The token cache is being invalidate because project 96194de4429a4220bf7f84953784632c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80150) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:39:08.186422 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-562b2599-4ac7-49b7-969a-023e4605549f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:08.187281 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-562b2599-4ac7-49b7-969a-023e4605549f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:08.189302 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1016/2029] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:39:07 2022] DELETE /identity/v3/projects/96194de4429a4220bf7f84953784632c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:39:08.193415 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b2599-4ac7-49b7-969a-023e4605549f admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:08.195124 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-562b2599-4ac7-49b7-969a-023e4605549f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:08.243510 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b18ff6-e5fa-4433-92da-bb3b09103d48 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:08.248547 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf19e6e-c69a-40d7-93e8-c8d026a7a67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:08.249243 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf19e6e-c69a-40d7-93e8-c8d026a7a67f admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:08.249527 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf19e6e-c69a-40d7-93e8-c8d026a7a67f admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:08.249850 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf19e6e-c69a-40d7-93e8-c8d026a7a67f admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:08.250570 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf19e6e-c69a-40d7-93e8-c8d026a7a67f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:08.252570 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf19e6e-c69a-40d7-93e8-c8d026a7a67f admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:08.276070 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1014/2030] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:39:08 2022] POST /identity/v3/users => generated 291 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 17:39:08.279999 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf19e6e-c69a-40d7-93e8-c8d026a7a67f admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:08.281737 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1bf19e6e-c69a-40d7-93e8-c8d026a7a67f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:08.281926 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b2599-4ac7-49b7-969a-023e4605549f admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:08.288050 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3419f0d-5fbd-4252-b768-f94d648a85ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:08.288944 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3419f0d-5fbd-4252-b768-f94d648a85ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:08.289223 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3419f0d-5fbd-4252-b768-f94d648a85ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:08.289491 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3419f0d-5fbd-4252-b768-f94d648a85ad admin admin] PATH_INFO: `/v3/users/7d75bad9fdf444a1893916efeb319b78` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:08.290892 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3419f0d-5fbd-4252-b768-f94d648a85ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d75bad9fdf444a1893916efeb319b78)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:08.293238 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3419f0d-5fbd-4252-b768-f94d648a85ad admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:08.295210 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf19e6e-c69a-40d7-93e8-c8d026a7a67f admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:08.295352 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:08.300078 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be8658-98ef-4c42-b139-c7507a4df7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:08.300760 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be8658-98ef-4c42-b139-c7507a4df7db admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:08.301040 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be8658-98ef-4c42-b139-c7507a4df7db admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:08.301318 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be8658-98ef-4c42-b139-c7507a4df7db admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:08.302084 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be8658-98ef-4c42-b139-c7507a4df7db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:08.304092 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be8658-98ef-4c42-b139-c7507a4df7db admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:08.316782 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1015/2031] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:39:08.321043 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be8658-98ef-4c42-b139-c7507a4df7db admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:08.334229 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be8658-98ef-4c42-b139-c7507a4df7db admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:08.339344 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7c41c-567d-4ff1-8358-d64344552015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:08.340736 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7c41c-567d-4ff1-8358-d64344552015 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:08.341088 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7c41c-567d-4ff1-8358-d64344552015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:08.341347 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7c41c-567d-4ff1-8358-d64344552015 admin admin] PATH_INFO: `/v3/projects/ed92c55a74df4f669460bc986d64463c/users/f49fbeb2c696477999eb3180bbe135ad/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:08.357747 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-a3419f0d-5fbd-4252-b768-f94d648a85ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d75bad9fdf444a1893916efeb319b78'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:08.358296 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7c41c-567d-4ff1-8358-d64344552015 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed92c55a74df4f669460bc986d64463c, user_id=f49fbeb2c696477999eb3180bbe135ad, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:08.358457 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-a3419f0d-5fbd-4252-b768-f94d648a85ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d75bad9fdf444a1893916efeb319b78'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:08.360956 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7c41c-567d-4ff1-8358-d64344552015 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:08.366187 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-a3419f0d-5fbd-4252-b768-f94d648a85ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d75bad9fdf444a1893916efeb319b78'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:08.366945 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-a3419f0d-5fbd-4252-b768-f94d648a85ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d75bad9fdf444a1893916efeb319b78'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:08.375861 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1016/2032] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:39:08 2022] PUT /identity/v3/projects/ed92c55a74df4f669460bc986d64463c/users/f49fbeb2c696477999eb3180bbe135ad/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:39:08.379355 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-a3419f0d-5fbd-4252-b768-f94d648a85ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d75bad9fdf444a1893916efeb319b78'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:08.379798 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7c41c-567d-4ff1-8358-d64344552015 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:08.381386 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-41a7c41c-567d-4ff1-8358-d64344552015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:08.397100 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1017/2033] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:39:08 2022] DELETE /identity/v3/users/7d75bad9fdf444a1893916efeb319b78 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:39:08.446678 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7c41c-567d-4ff1-8358-d64344552015 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:08.451730 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:08.508409 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f1749-5cfa-4241-ab67-7d823fdf3821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:08.509131 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f1749-5cfa-4241-ab67-7d823fdf3821 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:08.509518 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f1749-5cfa-4241-ab67-7d823fdf3821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:08.509814 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f1749-5cfa-4241-ab67-7d823fdf3821 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:08.510558 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f1749-5cfa-4241-ab67-7d823fdf3821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:08.512164 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f1749-5cfa-4241-ab67-7d823fdf3821 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:08.526245 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1017/2034] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:39:08.527398 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3419f0d-5fbd-4252-b768-f94d648a85ad admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:08.537680 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3419f0d-5fbd-4252-b768-f94d648a85ad admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:08.542897 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caafbdae-9132-42ca-8fc5-1c60f0e5a9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:08.543801 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafbdae-9132-42ca-8fc5-1c60f0e5a9d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:08.544078 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafbdae-9132-42ca-8fc5-1c60f0e5a9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:08.544346 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafbdae-9132-42ca-8fc5-1c60f0e5a9d0 admin admin] PATH_INFO: `/v3/projects/ed92c55a74df4f669460bc986d64463c/users/f49fbeb2c696477999eb3180bbe135ad/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:08.546339 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caafbdae-9132-42ca-8fc5-1c60f0e5a9d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed92c55a74df4f669460bc986d64463c, user_id=f49fbeb2c696477999eb3180bbe135ad, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:08.548995 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caafbdae-9132-42ca-8fc5-1c60f0e5a9d0 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:08.579724 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1018/2035] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:39:08 2022] PUT /identity/v3/projects/ed92c55a74df4f669460bc986d64463c/users/f49fbeb2c696477999eb3180bbe135ad/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:39:08.590750 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a931e-94ee-4805-a07d-98f7d60fa505 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:08.590938 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a931e-94ee-4805-a07d-98f7d60fa505 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:08.591219 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a931e-94ee-4805-a07d-98f7d60fa505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:08.624038 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-765a931e-94ee-4805-a07d-98f7d60fa505 None None] MFA Rules not processed for user `f49fbeb2c696477999eb3180bbe135ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:08.625303 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-765a931e-94ee-4805-a07d-98f7d60fa505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:08.690498 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caafbdae-9132-42ca-8fc5-1c60f0e5a9d0 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:08.692465 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-caafbdae-9132-42ca-8fc5-1c60f0e5a9d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:08.703127 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1018/2036] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:39:08 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:39:08.714442 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a931e-94ee-4805-a07d-98f7d60fa505 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:08.716132 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-765a931e-94ee-4805-a07d-98f7d60fa505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:08.764093 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caafbdae-9132-42ca-8fc5-1c60f0e5a9d0 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:08.769002 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c3dab-7986-4223-ac23-8c02169cb9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:08.770074 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c3dab-7986-4223-ac23-8c02169cb9a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:08.770381 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c3dab-7986-4223-ac23-8c02169cb9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:08.770657 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c3dab-7986-4223-ac23-8c02169cb9a4 admin admin] PATH_INFO: `/v3/projects/ae3b9852595c4082bc578ed72914c577` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:08.771881 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c3dab-7986-4223-ac23-8c02169cb9a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae3b9852595c4082bc578ed72914c577)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:08.773933 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c3dab-7986-4223-ac23-8c02169cb9a4 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:08.781573 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a931e-94ee-4805-a07d-98f7d60fa505 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:08.785456 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7caa41-deda-4a83-8be8-02c59efde959 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:08.786247 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7caa41-deda-4a83-8be8-02c59efde959 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:08.786533 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7caa41-deda-4a83-8be8-02c59efde959 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:08.786810 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7caa41-deda-4a83-8be8-02c59efde959 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:08.798800 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7caa41-deda-4a83-8be8-02c59efde959 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:08.800235 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7caa41-deda-4a83-8be8-02c59efde959 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:08.811001 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1019/2037] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:39:08 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 17:39:08.827105 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-0f5c3dab-7986-4223-ac23-8c02169cb9a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae3b9852595c4082bc578ed72914c577', 'request_id': 'req-0f5c3dab-7986-4223-ac23-8c02169cb9a4'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:08.839348 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-0f5c3dab-7986-4223-ac23-8c02169cb9a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae3b9852595c4082bc578ed72914c577', 'request_id': 'req-0f5c3dab-7986-4223-ac23-8c02169cb9a4'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:08.851932 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-0f5c3dab-7986-4223-ac23-8c02169cb9a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae3b9852595c4082bc578ed72914c577', 'request_id': 'req-0f5c3dab-7986-4223-ac23-8c02169cb9a4'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:08.854463 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:08.872176 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-0f5c3dab-7986-4223-ac23-8c02169cb9a4 admin admin] The token cache is being invalidate because project ae3b9852595c4082bc578ed72914c577 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80150) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:39:08.872470 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-0f5c3dab-7986-4223-ac23-8c02169cb9a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:08.873244 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-0f5c3dab-7986-4223-ac23-8c02169cb9a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:08.877843 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1019/2038] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:39:08 2022] DELETE /identity/v3/projects/ae3b9852595c4082bc578ed72914c577 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:39:08.886023 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c356a-79d6-4ad0-94ae-4bf78c5d1ca4 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:08.886023 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c356a-79d6-4ad0-94ae-4bf78c5d1ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:08.886023 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c356a-79d6-4ad0-94ae-4bf78c5d1ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:08.907147 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-5a5c356a-79d6-4ad0-94ae-4bf78c5d1ca4 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:08.908521 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5a5c356a-79d6-4ad0-94ae-4bf78c5d1ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:08.949194 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:08.998533 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1020/2039] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:39:09.007222 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95212dfe-3ac5-4c34-a7a8-fe12ee37e508 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:09.007506 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95212dfe-3ac5-4c34-a7a8-fe12ee37e508 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:09.007778 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95212dfe-3ac5-4c34-a7a8-fe12ee37e508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:09.028362 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-95212dfe-3ac5-4c34-a7a8-fe12ee37e508 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:09.029826 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-95212dfe-3ac5-4c34-a7a8-fe12ee37e508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:09.043675 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1020/2040] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:39:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:39:09.050282 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c356a-79d6-4ad0-94ae-4bf78c5d1ca4 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:09.075985 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c356a-79d6-4ad0-94ae-4bf78c5d1ca4 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:09.087725 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfeaa1f-6c65-4c60-9745-3fb6768b3109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:09.087725 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfeaa1f-6c65-4c60-9745-3fb6768b3109 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:09.087725 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfeaa1f-6c65-4c60-9745-3fb6768b3109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:09.087725 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfeaa1f-6c65-4c60-9745-3fb6768b3109 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:09.088165 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfeaa1f-6c65-4c60-9745-3fb6768b3109 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:39:09.088165 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfeaa1f-6c65-4c60-9745-3fb6768b3109 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:09.088165 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfeaa1f-6c65-4c60-9745-3fb6768b3109 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:09.100376 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1021/2041] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:39:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:39:09.106196 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95212dfe-3ac5-4c34-a7a8-fe12ee37e508 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:09.124040 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95212dfe-3ac5-4c34-a7a8-fe12ee37e508 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:09.129365 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265cad30-6f61-4638-93a4-28e36c3ada46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:09.130228 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265cad30-6f61-4638-93a4-28e36c3ada46 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:09.130511 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265cad30-6f61-4638-93a4-28e36c3ada46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:09.130776 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265cad30-6f61-4638-93a4-28e36c3ada46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:09.131499 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265cad30-6f61-4638-93a4-28e36c3ada46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:09.133420 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265cad30-6f61-4638-93a4-28e36c3ada46 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:09.160666 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1021/2042] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:39:09 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 17:39:09.164765 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfeaa1f-6c65-4c60-9745-3fb6768b3109 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:09.176113 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfeaa1f-6c65-4c60-9745-3fb6768b3109 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:09.235599 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd70d0-3515-404e-8d3b-980a87863d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:09.236380 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd70d0-3515-404e-8d3b-980a87863d46 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:09.236670 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd70d0-3515-404e-8d3b-980a87863d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:09.236943 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd70d0-3515-404e-8d3b-980a87863d46 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:09.237637 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bd70d0-3515-404e-8d3b-980a87863d46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:09.239620 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bd70d0-3515-404e-8d3b-980a87863d46 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:09.264140 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1022/2043] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:39:09 2022] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:39:09.265308 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265cad30-6f61-4638-93a4-28e36c3ada46 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:09.276275 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265cad30-6f61-4638-93a4-28e36c3ada46 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:09.293933 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b2f9f-8950-4daf-a6c6-f37799e288c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:09.293933 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b2f9f-8950-4daf-a6c6-f37799e288c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:09.294494 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b2f9f-8950-4daf-a6c6-f37799e288c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:09.294795 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b2f9f-8950-4daf-a6c6-f37799e288c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:09.295714 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b2f9f-8950-4daf-a6c6-f37799e288c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:09.297680 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b2f9f-8950-4daf-a6c6-f37799e288c5 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:09.311580 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1022/2044] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:39:09.315956 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd70d0-3515-404e-8d3b-980a87863d46 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:09.326908 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd70d0-3515-404e-8d3b-980a87863d46 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:09.332702 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474bacc8-ef85-49ac-a0a2-8a86834f68cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:09.333382 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474bacc8-ef85-49ac-a0a2-8a86834f68cb admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:09.333662 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474bacc8-ef85-49ac-a0a2-8a86834f68cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:09.333968 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474bacc8-ef85-49ac-a0a2-8a86834f68cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:09.334698 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474bacc8-ef85-49ac-a0a2-8a86834f68cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:09.338181 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474bacc8-ef85-49ac-a0a2-8a86834f68cb admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:09.353805 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1023/2045] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:39:09.354674 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b2f9f-8950-4daf-a6c6-f37799e288c5 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:09.366913 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b2f9f-8950-4daf-a6c6-f37799e288c5 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:09.378877 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3c8ed-7ee5-48e0-9c48-1b70630fb146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:09.379809 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3c8ed-7ee5-48e0-9c48-1b70630fb146 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:09.380145 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3c8ed-7ee5-48e0-9c48-1b70630fb146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:09.380430 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3c8ed-7ee5-48e0-9c48-1b70630fb146 admin admin] PATH_INFO: `/v3/projects/4bd7fa0c1b0949bdb2a69038299df39c/users/515dc0eed4bb4ef584a6e09e6ef697a4/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:09.405221 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd3c8ed-7ee5-48e0-9c48-1b70630fb146 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bd7fa0c1b0949bdb2a69038299df39c, user_id=515dc0eed4bb4ef584a6e09e6ef697a4, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:09.407928 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd3c8ed-7ee5-48e0-9c48-1b70630fb146 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:09.426750 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1023/2046] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:39:09 2022] PUT /identity/v3/projects/4bd7fa0c1b0949bdb2a69038299df39c/users/515dc0eed4bb4ef584a6e09e6ef697a4/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:39:09.446294 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887da0be-5629-4fd8-a72b-3da3ef1f21d7 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:09.446615 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887da0be-5629-4fd8-a72b-3da3ef1f21d7 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:09.446839 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887da0be-5629-4fd8-a72b-3da3ef1f21d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:09.482348 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-887da0be-5629-4fd8-a72b-3da3ef1f21d7 None None] MFA Rules not processed for user `515dc0eed4bb4ef584a6e09e6ef697a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:09.483851 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-887da0be-5629-4fd8-a72b-3da3ef1f21d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:09.551698 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1024/2047] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:39:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:39:09.566014 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3c8ed-7ee5-48e0-9c48-1b70630fb146 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:09.567866 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-9dd3c8ed-7ee5-48e0-9c48-1b70630fb146 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:09.638870 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3c8ed-7ee5-48e0-9c48-1b70630fb146 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:09.642556 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2b6f7-59bb-487c-8eee-e5e8d8443827 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14775984c9d4463a8e8848dcf189714b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:09.643223 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2b6f7-59bb-487c-8eee-e5e8d8443827 service glance] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:09.643504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2b6f7-59bb-487c-8eee-e5e8d8443827 service glance] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:09.643809 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2b6f7-59bb-487c-8eee-e5e8d8443827 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:09.652907 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b2b6f7-59bb-487c-8eee-e5e8d8443827 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:09.654384 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b2b6f7-59bb-487c-8eee-e5e8d8443827 service glance] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:09.663388 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1024/2048] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:39:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:39:10.394512 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887da0be-5629-4fd8-a72b-3da3ef1f21d7 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:10.395937 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-887da0be-5629-4fd8-a72b-3da3ef1f21d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:10.429547 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:10.473227 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887da0be-5629-4fd8-a72b-3da3ef1f21d7 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:10.479389 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6d654-e2a0-4619-918f-36f4e749787a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:10.480286 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6d654-e2a0-4619-918f-36f4e749787a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:10.480733 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6d654-e2a0-4619-918f-36f4e749787a admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:10.481013 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6d654-e2a0-4619-918f-36f4e749787a admin admin] PATH_INFO: `/v3/users/bed81a5a6ca44801ab65044320e49df6` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:10.482669 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6d654-e2a0-4619-918f-36f4e749787a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bed81a5a6ca44801ab65044320e49df6)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:10.484432 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6d654-e2a0-4619-918f-36f4e749787a admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:10.545531 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-23f6d654-e2a0-4619-918f-36f4e749787a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bed81a5a6ca44801ab65044320e49df6'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:10.546457 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-23f6d654-e2a0-4619-918f-36f4e749787a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bed81a5a6ca44801ab65044320e49df6'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:10.554089 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-23f6d654-e2a0-4619-918f-36f4e749787a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bed81a5a6ca44801ab65044320e49df6'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:10.567573 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-23f6d654-e2a0-4619-918f-36f4e749787a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bed81a5a6ca44801ab65044320e49df6'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:10.577524 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-23f6d654-e2a0-4619-918f-36f4e749787a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bed81a5a6ca44801ab65044320e49df6'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:10.584960 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1025/2049] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:39:10 2022] DELETE /identity/v3/users/bed81a5a6ca44801ab65044320e49df6 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:39:10.589574 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76971485-1f28-4793-a227-0b49e9414d72 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:10.590137 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76971485-1f28-4793-a227-0b49e9414d72 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:10.590427 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76971485-1f28-4793-a227-0b49e9414d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:10.609075 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-76971485-1f28-4793-a227-0b49e9414d72 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:10.611281 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-76971485-1f28-4793-a227-0b49e9414d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:10.694891 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1025/2050] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:39:10.704742 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6d654-e2a0-4619-918f-36f4e749787a admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:10.707093 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-23f6d654-e2a0-4619-918f-36f4e749787a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:10.767401 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6d654-e2a0-4619-918f-36f4e749787a admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:10.771123 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16731e6-f82e-48da-aaa6-d5700ae39151 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:10.771787 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16731e6-f82e-48da-aaa6-d5700ae39151 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:10.772056 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16731e6-f82e-48da-aaa6-d5700ae39151 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:10.772333 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16731e6-f82e-48da-aaa6-d5700ae39151 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:10.781598 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16731e6-f82e-48da-aaa6-d5700ae39151 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:10.783059 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16731e6-f82e-48da-aaa6-d5700ae39151 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:10.792628 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1026/2051] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:39:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:39:11.084762 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76971485-1f28-4793-a227-0b49e9414d72 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:11.086401 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-76971485-1f28-4793-a227-0b49e9414d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:11.098707 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76971485-1f28-4793-a227-0b49e9414d72 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:11.110403 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e791e15-e71f-41bc-95e0-61ce619e31e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:11.112197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e791e15-e71f-41bc-95e0-61ce619e31e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:11.112553 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e791e15-e71f-41bc-95e0-61ce619e31e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:11.113394 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e791e15-e71f-41bc-95e0-61ce619e31e6 admin admin] PATH_INFO: `/v3/projects/fd6611c177d243cf8fbb76b613c529ad` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:11.114763 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e791e15-e71f-41bc-95e0-61ce619e31e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd6611c177d243cf8fbb76b613c529ad)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:11.117101 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e791e15-e71f-41bc-95e0-61ce619e31e6 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:11.167657 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:11.183385 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-1e791e15-e71f-41bc-95e0-61ce619e31e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd6611c177d243cf8fbb76b613c529ad', 'request_id': 'req-1e791e15-e71f-41bc-95e0-61ce619e31e6'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:11.193293 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-1e791e15-e71f-41bc-95e0-61ce619e31e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd6611c177d243cf8fbb76b613c529ad', 'request_id': 'req-1e791e15-e71f-41bc-95e0-61ce619e31e6'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:11.202173 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-1e791e15-e71f-41bc-95e0-61ce619e31e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd6611c177d243cf8fbb76b613c529ad', 'request_id': 'req-1e791e15-e71f-41bc-95e0-61ce619e31e6'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:11.213988 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-1e791e15-e71f-41bc-95e0-61ce619e31e6 admin admin] The token cache is being invalidate because project fd6611c177d243cf8fbb76b613c529ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80150) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:39:11.214279 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-1e791e15-e71f-41bc-95e0-61ce619e31e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:11.215301 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-1e791e15-e71f-41bc-95e0-61ce619e31e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:11.219012 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1026/2052] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:39:11 2022] DELETE /identity/v3/projects/fd6611c177d243cf8fbb76b613c529ad => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:39:11.223087 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16731e6-f82e-48da-aaa6-d5700ae39151 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:11.235127 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16731e6-f82e-48da-aaa6-d5700ae39151 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:11.284719 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:11.298543 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02629dc1-87b6-4fe8-bf14-4477d117a715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:11.299462 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02629dc1-87b6-4fe8-bf14-4477d117a715 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:11.299757 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02629dc1-87b6-4fe8-bf14-4477d117a715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:11.300023 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02629dc1-87b6-4fe8-bf14-4477d117a715 admin admin] PATH_INFO: `/v3/users/f49fbeb2c696477999eb3180bbe135ad` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:11.301388 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02629dc1-87b6-4fe8-bf14-4477d117a715 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f49fbeb2c696477999eb3180bbe135ad)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:11.303415 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02629dc1-87b6-4fe8-bf14-4477d117a715 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:11.368740 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-02629dc1-87b6-4fe8-bf14-4477d117a715 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f49fbeb2c696477999eb3180bbe135ad'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:11.369458 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-02629dc1-87b6-4fe8-bf14-4477d117a715 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f49fbeb2c696477999eb3180bbe135ad'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:11.376372 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-02629dc1-87b6-4fe8-bf14-4477d117a715 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f49fbeb2c696477999eb3180bbe135ad'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:11.390979 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-02629dc1-87b6-4fe8-bf14-4477d117a715 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f49fbeb2c696477999eb3180bbe135ad'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:11.400364 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-02629dc1-87b6-4fe8-bf14-4477d117a715 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f49fbeb2c696477999eb3180bbe135ad'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:11.406637 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1027/2053] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:39:11 2022] DELETE /identity/v3/users/f49fbeb2c696477999eb3180bbe135ad => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:39:11.708518 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e791e15-e71f-41bc-95e0-61ce619e31e6 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:11.712925 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-1e791e15-e71f-41bc-95e0-61ce619e31e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:11.735733 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e791e15-e71f-41bc-95e0-61ce619e31e6 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:11.803219 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291b711-2c0c-49b0-b447-f2bb9c741e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:11.804112 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291b711-2c0c-49b0-b447-f2bb9c741e43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:11.804393 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291b711-2c0c-49b0-b447-f2bb9c741e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:11.804668 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291b711-2c0c-49b0-b447-f2bb9c741e43 admin admin] PATH_INFO: `/v3/projects/ed92c55a74df4f669460bc986d64463c` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:11.805906 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e291b711-2c0c-49b0-b447-f2bb9c741e43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed92c55a74df4f669460bc986d64463c)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:11.807915 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e291b711-2c0c-49b0-b447-f2bb9c741e43 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:11.859583 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-e291b711-2c0c-49b0-b447-f2bb9c741e43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed92c55a74df4f669460bc986d64463c', 'request_id': 'req-e291b711-2c0c-49b0-b447-f2bb9c741e43'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:11.869443 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-e291b711-2c0c-49b0-b447-f2bb9c741e43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed92c55a74df4f669460bc986d64463c', 'request_id': 'req-e291b711-2c0c-49b0-b447-f2bb9c741e43'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:11.876560 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-e291b711-2c0c-49b0-b447-f2bb9c741e43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed92c55a74df4f669460bc986d64463c', 'request_id': 'req-e291b711-2c0c-49b0-b447-f2bb9c741e43'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:11.889548 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-e291b711-2c0c-49b0-b447-f2bb9c741e43 admin admin] The token cache is being invalidate because project ed92c55a74df4f669460bc986d64463c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80150) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:39:11.890064 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-e291b711-2c0c-49b0-b447-f2bb9c741e43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:11.890728 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-e291b711-2c0c-49b0-b447-f2bb9c741e43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:11.892342 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1027/2054] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:39:11 2022] DELETE /identity/v3/projects/ed92c55a74df4f669460bc986d64463c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:39:11.897376 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4dd962-0730-4bf4-acc1-ff0f041c41fa None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:11.897664 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4dd962-0730-4bf4-acc1-ff0f041c41fa None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:11.897981 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4dd962-0730-4bf4-acc1-ff0f041c41fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:11.917748 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-8d4dd962-0730-4bf4-acc1-ff0f041c41fa None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:11.919056 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8d4dd962-0730-4bf4-acc1-ff0f041c41fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:11.993340 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1028/2055] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:39:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:39:12.001556 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0f8db-543a-402d-a538-15d23b651711 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:12.001901 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0f8db-543a-402d-a538-15d23b651711 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:12.002186 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0f8db-543a-402d-a538-15d23b651711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:12.022118 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-4cd0f8db-543a-402d-a538-15d23b651711 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:12.024400 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-4cd0f8db-543a-402d-a538-15d23b651711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:12.034605 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1028/2056] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:39:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:39:12.039023 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4dd962-0730-4bf4-acc1-ff0f041c41fa None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:12.049255 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4dd962-0730-4bf4-acc1-ff0f041c41fa None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:12.054535 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a094ea5-a2cd-40ce-a24f-873c080598c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:12.055289 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a094ea5-a2cd-40ce-a24f-873c080598c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:12.055819 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a094ea5-a2cd-40ce-a24f-873c080598c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:12.056596 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a094ea5-a2cd-40ce-a24f-873c080598c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:12.057371 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a094ea5-a2cd-40ce-a24f-873c080598c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:39:12.057681 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a094ea5-a2cd-40ce-a24f-873c080598c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:12.059365 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a094ea5-a2cd-40ce-a24f-873c080598c7 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:12.074019 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1029/2057] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:39:12.077441 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0f8db-543a-402d-a538-15d23b651711 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:12.088106 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0f8db-543a-402d-a538-15d23b651711 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:12.093120 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22661a83-1f0b-425b-ad5b-22ea249f8874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:12.093833 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22661a83-1f0b-425b-ad5b-22ea249f8874 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:12.094120 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22661a83-1f0b-425b-ad5b-22ea249f8874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:12.094395 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22661a83-1f0b-425b-ad5b-22ea249f8874 admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:12.095075 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22661a83-1f0b-425b-ad5b-22ea249f8874 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:12.097002 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22661a83-1f0b-425b-ad5b-22ea249f8874 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:12.125351 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1029/2058] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:39:12 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:39:12.129365 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a094ea5-a2cd-40ce-a24f-873c080598c7 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:12.139449 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a094ea5-a2cd-40ce-a24f-873c080598c7 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:12.194481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:12.202464 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc213722-7d3d-47f2-9207-e7e52b67471c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:12.203160 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc213722-7d3d-47f2-9207-e7e52b67471c admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:12.203456 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc213722-7d3d-47f2-9207-e7e52b67471c admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:12.203735 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc213722-7d3d-47f2-9207-e7e52b67471c admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:12.204466 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc213722-7d3d-47f2-9207-e7e52b67471c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:12.206612 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc213722-7d3d-47f2-9207-e7e52b67471c admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:12.228693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1030/2059] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:39:12 2022] POST /identity/v3/users => generated 296 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:39:12.234182 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22661a83-1f0b-425b-ad5b-22ea249f8874 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:12.245446 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22661a83-1f0b-425b-ad5b-22ea249f8874 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:12.253996 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0f45e-1197-440a-b19a-66d61c91aca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:12.254926 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0f45e-1197-440a-b19a-66d61c91aca0 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:12.255507 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0f45e-1197-440a-b19a-66d61c91aca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:12.255752 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0f45e-1197-440a-b19a-66d61c91aca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:12.256618 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f0f45e-1197-440a-b19a-66d61c91aca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:12.258157 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f0f45e-1197-440a-b19a-66d61c91aca0 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:12.270620 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1030/2060] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:39:12.275164 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc213722-7d3d-47f2-9207-e7e52b67471c admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:12.285150 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc213722-7d3d-47f2-9207-e7e52b67471c admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:12.298304 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee58b881-6312-40a7-9b98-2681b2f70131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:12.298983 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58b881-6312-40a7-9b98-2681b2f70131 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:12.299319 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58b881-6312-40a7-9b98-2681b2f70131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:12.299505 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58b881-6312-40a7-9b98-2681b2f70131 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:12.300243 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee58b881-6312-40a7-9b98-2681b2f70131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:12.302152 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee58b881-6312-40a7-9b98-2681b2f70131 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:12.315463 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1031/2061] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:39:12.320030 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0f45e-1197-440a-b19a-66d61c91aca0 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:12.331060 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0f45e-1197-440a-b19a-66d61c91aca0 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:12.336822 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d7d8a-907c-451c-afc8-7e3565c16ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:12.337873 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d7d8a-907c-451c-afc8-7e3565c16ba0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:12.338155 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d7d8a-907c-451c-afc8-7e3565c16ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:12.338426 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d7d8a-907c-451c-afc8-7e3565c16ba0 admin admin] PATH_INFO: `/v3/projects/c513c316c2344e1a929c60b00ec55038/users/8f917eea0f6f4e62a31d0432c8ffbc4f/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:12.341710 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:12.357426 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01d7d8a-907c-451c-afc8-7e3565c16ba0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c513c316c2344e1a929c60b00ec55038, user_id=8f917eea0f6f4e62a31d0432c8ffbc4f, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:12.360605 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01d7d8a-907c-451c-afc8-7e3565c16ba0 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:12.380607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1031/2062] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:39:12 2022] PUT /identity/v3/projects/c513c316c2344e1a929c60b00ec55038/users/8f917eea0f6f4e62a31d0432c8ffbc4f/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:39:12.391685 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89734c2c-8b9e-493a-bf0d-685493e04911 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:12.391970 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89734c2c-8b9e-493a-bf0d-685493e04911 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:12.392244 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89734c2c-8b9e-493a-bf0d-685493e04911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:12.424804 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-89734c2c-8b9e-493a-bf0d-685493e04911 None None] MFA Rules not processed for user `8f917eea0f6f4e62a31d0432c8ffbc4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:12.426324 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-89734c2c-8b9e-493a-bf0d-685493e04911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:12.498572 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1032/2063] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:39:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:39:12.503196 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d7d8a-907c-451c-afc8-7e3565c16ba0 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:12.568459 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d7d8a-907c-451c-afc8-7e3565c16ba0 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:12.575473 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c88eba-5494-40c0-85b7-f0cfb9a27af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:12.576143 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c88eba-5494-40c0-85b7-f0cfb9a27af4 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:12.576418 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c88eba-5494-40c0-85b7-f0cfb9a27af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:12.576690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c88eba-5494-40c0-85b7-f0cfb9a27af4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:12.577398 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c88eba-5494-40c0-85b7-f0cfb9a27af4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:12.579336 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c88eba-5494-40c0-85b7-f0cfb9a27af4 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:12.610023 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1032/2064] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:39:12 2022] POST /identity/v3/projects => generated 393 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 17:39:12.614367 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89734c2c-8b9e-493a-bf0d-685493e04911 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:12.626741 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89734c2c-8b9e-493a-bf0d-685493e04911 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:12.691929 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a20b1-9564-4d80-bcd9-b8479213f4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:12.692612 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a20b1-9564-4d80-bcd9-b8479213f4ee admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:12.692895 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a20b1-9564-4d80-bcd9-b8479213f4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:12.693173 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a20b1-9564-4d80-bcd9-b8479213f4ee admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:12.693969 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1a20b1-9564-4d80-bcd9-b8479213f4ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:12.695873 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1a20b1-9564-4d80-bcd9-b8479213f4ee admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:12.720376 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1033/2065] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:39:12 2022] POST /identity/v3/users => generated 303 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:39:12.724649 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c88eba-5494-40c0-85b7-f0cfb9a27af4 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:12.741515 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c88eba-5494-40c0-85b7-f0cfb9a27af4 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:12.749549 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf14ab0-96dd-4b3e-b8ca-9da36903ac03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:12.750499 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf14ab0-96dd-4b3e-b8ca-9da36903ac03 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:12.750831 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf14ab0-96dd-4b3e-b8ca-9da36903ac03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:12.751175 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf14ab0-96dd-4b3e-b8ca-9da36903ac03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:12.752340 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf14ab0-96dd-4b3e-b8ca-9da36903ac03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:12.754894 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf14ab0-96dd-4b3e-b8ca-9da36903ac03 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:12.767672 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1033/2066] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:39:12.772040 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a20b1-9564-4d80-bcd9-b8479213f4ee admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:12.783451 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a20b1-9564-4d80-bcd9-b8479213f4ee admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:12.789248 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce85deab-27c7-4169-90fb-0dc94f0e5d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:12.790405 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85deab-27c7-4169-90fb-0dc94f0e5d80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:12.790686 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85deab-27c7-4169-90fb-0dc94f0e5d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:12.790960 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85deab-27c7-4169-90fb-0dc94f0e5d80 admin admin] PATH_INFO: `/v3/projects/ce77f50a80824191942e820d648ac1e2/users/d2c0cf2f824d42809c7959c43682122c/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:12.806138 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce85deab-27c7-4169-90fb-0dc94f0e5d80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce77f50a80824191942e820d648ac1e2, user_id=d2c0cf2f824d42809c7959c43682122c, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:12.808797 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce85deab-27c7-4169-90fb-0dc94f0e5d80 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:12.828441 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1034/2067] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:39:12 2022] PUT /identity/v3/projects/ce77f50a80824191942e820d648ac1e2/users/d2c0cf2f824d42809c7959c43682122c/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:39:12.832427 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf14ab0-96dd-4b3e-b8ca-9da36903ac03 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:12.843313 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf14ab0-96dd-4b3e-b8ca-9da36903ac03 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:12.910559 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb1d05-5e48-4bfe-b25c-cc19934a8d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:12.911253 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb1d05-5e48-4bfe-b25c-cc19934a8d35 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:12.911537 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb1d05-5e48-4bfe-b25c-cc19934a8d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:12.911809 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb1d05-5e48-4bfe-b25c-cc19934a8d35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:12.912582 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb1d05-5e48-4bfe-b25c-cc19934a8d35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:12.914369 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb1d05-5e48-4bfe-b25c-cc19934a8d35 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:12.924907 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1034/2068] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:39:12.929718 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce85deab-27c7-4169-90fb-0dc94f0e5d80 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:12.941152 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce85deab-27c7-4169-90fb-0dc94f0e5d80 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:12.947713 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1169198-b47b-4996-82ba-c5113896591f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:12.948984 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1169198-b47b-4996-82ba-c5113896591f admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:12.949262 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1169198-b47b-4996-82ba-c5113896591f admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:12.949532 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1169198-b47b-4996-82ba-c5113896591f admin admin] PATH_INFO: `/v3/projects/ce77f50a80824191942e820d648ac1e2/users/d2c0cf2f824d42809c7959c43682122c/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:12.951788 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1169198-b47b-4996-82ba-c5113896591f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce77f50a80824191942e820d648ac1e2, user_id=d2c0cf2f824d42809c7959c43682122c, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:12.954470 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1169198-b47b-4996-82ba-c5113896591f admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:12.966756 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1035/2069] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:39:12 2022] PUT /identity/v3/projects/ce77f50a80824191942e820d648ac1e2/users/d2c0cf2f824d42809c7959c43682122c/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:39:12.981736 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74714874-6457-433d-9500-ba39a982d325 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:12.981989 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74714874-6457-433d-9500-ba39a982d325 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:12.982426 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74714874-6457-433d-9500-ba39a982d325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:13.015595 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-74714874-6457-433d-9500-ba39a982d325 None None] MFA Rules not processed for user `d2c0cf2f824d42809c7959c43682122c`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:13.016825 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-74714874-6457-433d-9500-ba39a982d325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:13.066252 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:13.094446 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1035/2070] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:39:12 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:39:13.105711 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1169198-b47b-4996-82ba-c5113896591f admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:13.107592 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f1169198-b47b-4996-82ba-c5113896591f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:13.130206 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:13.167516 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1169198-b47b-4996-82ba-c5113896591f admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:13.171153 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b5aff-205a-4543-bf6e-75992d940214 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:13.171802 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b5aff-205a-4543-bf6e-75992d940214 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:13.172080 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b5aff-205a-4543-bf6e-75992d940214 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:13.172352 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b5aff-205a-4543-bf6e-75992d940214 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:13.181966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236b5aff-205a-4543-bf6e-75992d940214 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:13.183396 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236b5aff-205a-4543-bf6e-75992d940214 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:13.192677 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1036/2071] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:39:13 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:39:13.258516 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74714874-6457-433d-9500-ba39a982d325 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:13.260903 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-74714874-6457-433d-9500-ba39a982d325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:13.274698 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74714874-6457-433d-9500-ba39a982d325 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:13.279810 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1666de-7453-416a-879d-df1a84be6a44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:13.280461 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1666de-7453-416a-879d-df1a84be6a44 service cinder] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:13.280753 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1666de-7453-416a-879d-df1a84be6a44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:13.281279 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1666de-7453-416a-879d-df1a84be6a44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:13.352085 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1666de-7453-416a-879d-df1a84be6a44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:13.353562 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1666de-7453-416a-879d-df1a84be6a44 service cinder] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:13.362853 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1036/2072] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:39:13 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:39:15.905704 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70715a8-6114-4d00-9804-f88572e009f0 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:15.906267 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70715a8-6114-4d00-9804-f88572e009f0 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:15.906267 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70715a8-6114-4d00-9804-f88572e009f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:15.925273 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-c70715a8-6114-4d00-9804-f88572e009f0 None None] MFA Rules not processed for user `afc6391173d04c2895bfef69225c29c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:15.926793 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c70715a8-6114-4d00-9804-f88572e009f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:15.985588 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1037/2073] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:39:15 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:39:16.780180 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1666de-7453-416a-879d-df1a84be6a44 service cinder] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:16.843952 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1666de-7453-416a-879d-df1a84be6a44 service cinder] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:16.848961 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86429b3-375a-4202-ac46-b952534be4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:16.849887 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86429b3-375a-4202-ac46-b952534be4aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:16.850165 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86429b3-375a-4202-ac46-b952534be4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:16.850432 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86429b3-375a-4202-ac46-b952534be4aa admin admin] PATH_INFO: `/v3/users/8f917eea0f6f4e62a31d0432c8ffbc4f` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:16.851605 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86429b3-375a-4202-ac46-b952534be4aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f917eea0f6f4e62a31d0432c8ffbc4f)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:16.853536 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86429b3-375a-4202-ac46-b952534be4aa admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:16.908231 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-d86429b3-375a-4202-ac46-b952534be4aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f917eea0f6f4e62a31d0432c8ffbc4f'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:16.908881 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-d86429b3-375a-4202-ac46-b952534be4aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f917eea0f6f4e62a31d0432c8ffbc4f'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:16.916128 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-d86429b3-375a-4202-ac46-b952534be4aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f917eea0f6f4e62a31d0432c8ffbc4f'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:16.916688 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-d86429b3-375a-4202-ac46-b952534be4aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f917eea0f6f4e62a31d0432c8ffbc4f'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:16.930480 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-d86429b3-375a-4202-ac46-b952534be4aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f917eea0f6f4e62a31d0432c8ffbc4f'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:16.940285 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:16.946757 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1037/2074] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:39:16 2022] DELETE /identity/v3/users/8f917eea0f6f4e62a31d0432c8ffbc4f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:39:16.951975 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6d524-b5ca-4226-a632-ee8d27d9e201 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:16.952427 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6d524-b5ca-4226-a632-ee8d27d9e201 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:16.952543 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6d524-b5ca-4226-a632-ee8d27d9e201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:16.970523 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-e8e6d524-b5ca-4226-a632-ee8d27d9e201 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:16.971733 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e8e6d524-b5ca-4226-a632-ee8d27d9e201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:17.036677 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1038/2075] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:39:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:39:17.046612 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86429b3-375a-4202-ac46-b952534be4aa admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:17.048124 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-d86429b3-375a-4202-ac46-b952534be4aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:17.113013 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86429b3-375a-4202-ac46-b952534be4aa admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:17.116904 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd67af73-7796-4d4a-91a2-58502eceaef1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:17.117586 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67af73-7796-4d4a-91a2-58502eceaef1 service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:17.117877 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67af73-7796-4d4a-91a2-58502eceaef1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:17.118156 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67af73-7796-4d4a-91a2-58502eceaef1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:17.127923 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd67af73-7796-4d4a-91a2-58502eceaef1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:17.129412 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd67af73-7796-4d4a-91a2-58502eceaef1 service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:17.140786 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1038/2076] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:39:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:39:17.432512 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6d524-b5ca-4226-a632-ee8d27d9e201 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:17.433976 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e8e6d524-b5ca-4226-a632-ee8d27d9e201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:17.452307 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6d524-b5ca-4226-a632-ee8d27d9e201 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:17.457526 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c55c8f-4b4f-46db-8ea3-a577a32340c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:17.458485 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c55c8f-4b4f-46db-8ea3-a577a32340c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:17.458793 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c55c8f-4b4f-46db-8ea3-a577a32340c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:17.458992 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c55c8f-4b4f-46db-8ea3-a577a32340c8 admin admin] PATH_INFO: `/v3/projects/c513c316c2344e1a929c60b00ec55038` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:17.460448 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c55c8f-4b4f-46db-8ea3-a577a32340c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c513c316c2344e1a929c60b00ec55038)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:17.462399 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c55c8f-4b4f-46db-8ea3-a577a32340c8 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:17.512266 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-10c55c8f-4b4f-46db-8ea3-a577a32340c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c513c316c2344e1a929c60b00ec55038', 'request_id': 'req-10c55c8f-4b4f-46db-8ea3-a577a32340c8'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:17.522137 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-10c55c8f-4b4f-46db-8ea3-a577a32340c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c513c316c2344e1a929c60b00ec55038', 'request_id': 'req-10c55c8f-4b4f-46db-8ea3-a577a32340c8'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:17.526053 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:17.528218 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-10c55c8f-4b4f-46db-8ea3-a577a32340c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c513c316c2344e1a929c60b00ec55038', 'request_id': 'req-10c55c8f-4b4f-46db-8ea3-a577a32340c8'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:17.541849 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-10c55c8f-4b4f-46db-8ea3-a577a32340c8 admin admin] The token cache is being invalidate because project c513c316c2344e1a929c60b00ec55038 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:39:17.542133 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-10c55c8f-4b4f-46db-8ea3-a577a32340c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:17.542901 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-10c55c8f-4b4f-46db-8ea3-a577a32340c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:17.544572 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1039/2077] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:39:17 2022] DELETE /identity/v3/projects/c513c316c2344e1a929c60b00ec55038 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:39:17.548783 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd67af73-7796-4d4a-91a2-58502eceaef1 service neutron] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:17.558859 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd67af73-7796-4d4a-91a2-58502eceaef1 service neutron] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:17.620639 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c372f-e376-484c-baa1-e9f957a01710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:17.621426 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c372f-e376-484c-baa1-e9f957a01710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:17.621704 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c372f-e376-484c-baa1-e9f957a01710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:17.624304 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c372f-e376-484c-baa1-e9f957a01710 admin admin] PATH_INFO: `/v3/users/d2c0cf2f824d42809c7959c43682122c` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:17.625768 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c372f-e376-484c-baa1-e9f957a01710 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2c0cf2f824d42809c7959c43682122c)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:17.627754 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c372f-e376-484c-baa1-e9f957a01710 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:17.687350 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-027c372f-e376-484c-baa1-e9f957a01710 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2c0cf2f824d42809c7959c43682122c'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:17.687937 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-027c372f-e376-484c-baa1-e9f957a01710 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2c0cf2f824d42809c7959c43682122c'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:17.703097 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-027c372f-e376-484c-baa1-e9f957a01710 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2c0cf2f824d42809c7959c43682122c'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:17.703983 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-027c372f-e376-484c-baa1-e9f957a01710 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2c0cf2f824d42809c7959c43682122c'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:17.719969 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-027c372f-e376-484c-baa1-e9f957a01710 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2c0cf2f824d42809c7959c43682122c'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:17.735680 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1039/2078] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:39:17 2022] DELETE /identity/v3/users/d2c0cf2f824d42809c7959c43682122c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:39:18.062381 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c55c8f-4b4f-46db-8ea3-a577a32340c8 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:18.064541 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-10c55c8f-4b4f-46db-8ea3-a577a32340c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:18.091041 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c55c8f-4b4f-46db-8ea3-a577a32340c8 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:18.155662 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227d3e1-2052-483b-a036-344874557e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:18.156572 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227d3e1-2052-483b-a036-344874557e0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:18.156834 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227d3e1-2052-483b-a036-344874557e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:18.157115 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227d3e1-2052-483b-a036-344874557e0f admin admin] PATH_INFO: `/v3/projects/ce77f50a80824191942e820d648ac1e2` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:18.158326 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6227d3e1-2052-483b-a036-344874557e0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce77f50a80824191942e820d648ac1e2)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:18.160228 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6227d3e1-2052-483b-a036-344874557e0f admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:18.222044 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6227d3e1-2052-483b-a036-344874557e0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce77f50a80824191942e820d648ac1e2', 'request_id': 'req-6227d3e1-2052-483b-a036-344874557e0f'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:18.231884 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6227d3e1-2052-483b-a036-344874557e0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce77f50a80824191942e820d648ac1e2', 'request_id': 'req-6227d3e1-2052-483b-a036-344874557e0f'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:18.238829 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6227d3e1-2052-483b-a036-344874557e0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce77f50a80824191942e820d648ac1e2', 'request_id': 'req-6227d3e1-2052-483b-a036-344874557e0f'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:18.250265 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6227d3e1-2052-483b-a036-344874557e0f admin admin] The token cache is being invalidate because project ce77f50a80824191942e820d648ac1e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:39:18.250554 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6227d3e1-2052-483b-a036-344874557e0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:18.251207 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6227d3e1-2052-483b-a036-344874557e0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:18.252862 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1040/2079] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:39:18 2022] DELETE /identity/v3/projects/ce77f50a80824191942e820d648ac1e2 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:39:18.258059 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49381d8b-84f3-4629-8add-a47e41265d77 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:18.258563 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49381d8b-84f3-4629-8add-a47e41265d77 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:18.258654 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49381d8b-84f3-4629-8add-a47e41265d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:18.276711 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-49381d8b-84f3-4629-8add-a47e41265d77 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:18.278000 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-49381d8b-84f3-4629-8add-a47e41265d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:18.292713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:18.370665 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1040/2080] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:39:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:39:18.372656 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee70cc-26c9-44a6-b439-9435b280db62 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:18.373289 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee70cc-26c9-44a6-b439-9435b280db62 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:18.373382 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee70cc-26c9-44a6-b439-9435b280db62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:18.396436 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-a2ee70cc-26c9-44a6-b439-9435b280db62 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:18.397698 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a2ee70cc-26c9-44a6-b439-9435b280db62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:18.409302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1041/2081] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:39:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:39:18.411126 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49381d8b-84f3-4629-8add-a47e41265d77 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:18.422764 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49381d8b-84f3-4629-8add-a47e41265d77 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:18.433278 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed93986-5972-49c1-969c-6c85fc0c21d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:18.434060 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed93986-5972-49c1-969c-6c85fc0c21d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:18.434363 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed93986-5972-49c1-969c-6c85fc0c21d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:18.434639 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed93986-5972-49c1-969c-6c85fc0c21d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:18.435382 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed93986-5972-49c1-969c-6c85fc0c21d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:39:18.435686 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed93986-5972-49c1-969c-6c85fc0c21d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:18.437313 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed93986-5972-49c1-969c-6c85fc0c21d9 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:18.450518 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1041/2082] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:39:18.455049 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee70cc-26c9-44a6-b439-9435b280db62 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:18.464431 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee70cc-26c9-44a6-b439-9435b280db62 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:18.469123 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380dbd37-8100-44c3-aa10-7ec462d87495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:18.469803 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380dbd37-8100-44c3-aa10-7ec462d87495 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:18.470102 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380dbd37-8100-44c3-aa10-7ec462d87495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:18.470382 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380dbd37-8100-44c3-aa10-7ec462d87495 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:18.471123 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380dbd37-8100-44c3-aa10-7ec462d87495 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:18.473028 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380dbd37-8100-44c3-aa10-7ec462d87495 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:18.503865 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1042/2083] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:39:18 2022] POST /identity/v3/projects => generated 401 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:39:18.508263 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed93986-5972-49c1-969c-6c85fc0c21d9 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:18.518461 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed93986-5972-49c1-969c-6c85fc0c21d9 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:18.589618 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d44841-243d-464b-b1ac-3d952b1071c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:18.590342 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d44841-243d-464b-b1ac-3d952b1071c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:18.590625 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d44841-243d-464b-b1ac-3d952b1071c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:18.590898 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d44841-243d-464b-b1ac-3d952b1071c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:18.591594 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d44841-243d-464b-b1ac-3d952b1071c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:18.594153 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d44841-243d-464b-b1ac-3d952b1071c7 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:18.629923 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1042/2084] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:39:18 2022] POST /identity/v3/users => generated 301 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:39:18.634349 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380dbd37-8100-44c3-aa10-7ec462d87495 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:18.648031 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380dbd37-8100-44c3-aa10-7ec462d87495 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:18.652651 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c02463-6fb2-4b9a-8a79-3216b5489dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:18.653322 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c02463-6fb2-4b9a-8a79-3216b5489dce admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:18.653600 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c02463-6fb2-4b9a-8a79-3216b5489dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:18.653911 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c02463-6fb2-4b9a-8a79-3216b5489dce admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:18.654643 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c02463-6fb2-4b9a-8a79-3216b5489dce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:18.656366 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c02463-6fb2-4b9a-8a79-3216b5489dce admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:18.670475 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1043/2085] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:39:18.671563 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d44841-243d-464b-b1ac-3d952b1071c7 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:18.681713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d44841-243d-464b-b1ac-3d952b1071c7 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:18.686642 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae490f00-35f1-44b0-b806-066911370866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:18.687307 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae490f00-35f1-44b0-b806-066911370866 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:18.687583 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae490f00-35f1-44b0-b806-066911370866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:18.687852 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae490f00-35f1-44b0-b806-066911370866 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:18.688590 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae490f00-35f1-44b0-b806-066911370866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:18.690222 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae490f00-35f1-44b0-b806-066911370866 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:18.701235 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1043/2086] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:39:18.705500 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c02463-6fb2-4b9a-8a79-3216b5489dce admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:18.715760 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c02463-6fb2-4b9a-8a79-3216b5489dce admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:18.720612 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055b082-5128-454c-bbd6-77a559285847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:18.721545 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055b082-5128-454c-bbd6-77a559285847 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:18.721855 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055b082-5128-454c-bbd6-77a559285847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:18.722138 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055b082-5128-454c-bbd6-77a559285847 admin admin] PATH_INFO: `/v3/projects/daef73bd0e034264a26ba36f1e74603f/users/1ea9e60f01d74b2487a2661c7d60ff6c/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:18.737352 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4055b082-5128-454c-bbd6-77a559285847 admin admin] RBAC: Authorizing `identity:create_grant(project_id=daef73bd0e034264a26ba36f1e74603f, user_id=1ea9e60f01d74b2487a2661c7d60ff6c, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:18.740080 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4055b082-5128-454c-bbd6-77a559285847 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:18.755981 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1044/2087] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:39:18 2022] PUT /identity/v3/projects/daef73bd0e034264a26ba36f1e74603f/users/1ea9e60f01d74b2487a2661c7d60ff6c/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:39:18.766554 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17735dcf-8bd3-414d-82bf-e0a36f26a492 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:18.766845 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17735dcf-8bd3-414d-82bf-e0a36f26a492 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:18.767117 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17735dcf-8bd3-414d-82bf-e0a36f26a492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:18.795170 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-17735dcf-8bd3-414d-82bf-e0a36f26a492 None None] MFA Rules not processed for user `1ea9e60f01d74b2487a2661c7d60ff6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:18.796807 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-17735dcf-8bd3-414d-82bf-e0a36f26a492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:18.873923 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1044/2088] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:39:18 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:39:18.875039 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055b082-5128-454c-bbd6-77a559285847 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:18.910848 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:18.979012 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055b082-5128-454c-bbd6-77a559285847 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:18.985821 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534af0d8-c805-4f1a-a538-e3a222a8329d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:18.986592 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534af0d8-c805-4f1a-a538-e3a222a8329d admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:18.986971 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534af0d8-c805-4f1a-a538-e3a222a8329d admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:18.987310 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534af0d8-c805-4f1a-a538-e3a222a8329d admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:18.988096 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534af0d8-c805-4f1a-a538-e3a222a8329d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:18.990211 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534af0d8-c805-4f1a-a538-e3a222a8329d admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:19.028620 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1045/2089] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:39:18 2022] POST /identity/v3/projects => generated 401 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 17:39:19.033066 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17735dcf-8bd3-414d-82bf-e0a36f26a492 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:19.044548 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17735dcf-8bd3-414d-82bf-e0a36f26a492 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:19.062562 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:19.117676 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ec0d9-ac65-437e-9195-b7e0f6815f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:19.118396 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ec0d9-ac65-437e-9195-b7e0f6815f36 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:19.118712 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ec0d9-ac65-437e-9195-b7e0f6815f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:19.118911 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ec0d9-ac65-437e-9195-b7e0f6815f36 admin admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:19.119738 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72ec0d9-ac65-437e-9195-b7e0f6815f36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:19.121714 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72ec0d9-ac65-437e-9195-b7e0f6815f36 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:19.146166 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1045/2090] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:39:19 2022] POST /identity/v3/users => generated 307 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:39:19.147450 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534af0d8-c805-4f1a-a538-e3a222a8329d admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:19.158669 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534af0d8-c805-4f1a-a538-e3a222a8329d admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:19.163641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b505736-f0d0-4770-939b-3d6dd6aa6028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:19.164383 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b505736-f0d0-4770-939b-3d6dd6aa6028 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:19.164671 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b505736-f0d0-4770-939b-3d6dd6aa6028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:19.164986 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b505736-f0d0-4770-939b-3d6dd6aa6028 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:19.165768 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b505736-f0d0-4770-939b-3d6dd6aa6028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:19.167682 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b505736-f0d0-4770-939b-3d6dd6aa6028 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:19.184711 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1046/2091] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:39:19.185937 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ec0d9-ac65-437e-9195-b7e0f6815f36 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:19.196138 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ec0d9-ac65-437e-9195-b7e0f6815f36 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:19.201510 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b02d73-08fc-4eeb-a10c-7248a29b64b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:19.202449 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b02d73-08fc-4eeb-a10c-7248a29b64b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:19.202760 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b02d73-08fc-4eeb-a10c-7248a29b64b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:19.203040 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b02d73-08fc-4eeb-a10c-7248a29b64b2 admin admin] PATH_INFO: `/v3/projects/8c46cc8eae7b48ecbe2b5e59155052b4/users/b3e5e8e653f24f5ba969aa5d99ef61c0/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:19.218945 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b02d73-08fc-4eeb-a10c-7248a29b64b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c46cc8eae7b48ecbe2b5e59155052b4, user_id=b3e5e8e653f24f5ba969aa5d99ef61c0, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:19.221627 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b02d73-08fc-4eeb-a10c-7248a29b64b2 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:19.236661 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1046/2092] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:39:19 2022] PUT /identity/v3/projects/8c46cc8eae7b48ecbe2b5e59155052b4/users/b3e5e8e653f24f5ba969aa5d99ef61c0/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:39:19.240767 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b505736-f0d0-4770-939b-3d6dd6aa6028 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:19.251002 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b505736-f0d0-4770-939b-3d6dd6aa6028 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:19.338833 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577f44a-3a76-4d17-96c7-c75bd0f0e50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:19.339973 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577f44a-3a76-4d17-96c7-c75bd0f0e50f admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:19.340409 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577f44a-3a76-4d17-96c7-c75bd0f0e50f admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:19.341167 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577f44a-3a76-4d17-96c7-c75bd0f0e50f admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:19.342153 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577f44a-3a76-4d17-96c7-c75bd0f0e50f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:19.343965 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577f44a-3a76-4d17-96c7-c75bd0f0e50f admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:19.361424 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1047/2093] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 17:39:19.362395 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b02d73-08fc-4eeb-a10c-7248a29b64b2 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:19.373297 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b02d73-08fc-4eeb-a10c-7248a29b64b2 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:19.377884 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67e2b4-f983-4139-b1ce-4dbcab690606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:19.378781 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67e2b4-f983-4139-b1ce-4dbcab690606 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:19.379059 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67e2b4-f983-4139-b1ce-4dbcab690606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:19.379332 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67e2b4-f983-4139-b1ce-4dbcab690606 admin admin] PATH_INFO: `/v3/projects/8c46cc8eae7b48ecbe2b5e59155052b4/users/b3e5e8e653f24f5ba969aa5d99ef61c0/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:19.381393 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d67e2b4-f983-4139-b1ce-4dbcab690606 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c46cc8eae7b48ecbe2b5e59155052b4, user_id=b3e5e8e653f24f5ba969aa5d99ef61c0, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:19.384047 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d67e2b4-f983-4139-b1ce-4dbcab690606 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:19.395082 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1047/2094] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:39:19 2022] PUT /identity/v3/projects/8c46cc8eae7b48ecbe2b5e59155052b4/users/b3e5e8e653f24f5ba969aa5d99ef61c0/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:39:19.406621 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db7b26-a6bf-495e-b897-476d9ac8c36d None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:19.406919 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db7b26-a6bf-495e-b897-476d9ac8c36d None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:19.407198 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db7b26-a6bf-495e-b897-476d9ac8c36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:19.435600 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-21db7b26-a6bf-495e-b897-476d9ac8c36d None None] MFA Rules not processed for user `b3e5e8e653f24f5ba969aa5d99ef61c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:19.436814 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-21db7b26-a6bf-495e-b897-476d9ac8c36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:19.516856 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1048/2095] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:39:19 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:39:19.527850 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67e2b4-f983-4139-b1ce-4dbcab690606 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:19.529568 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-4d67e2b4-f983-4139-b1ce-4dbcab690606 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:19.597193 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67e2b4-f983-4139-b1ce-4dbcab690606 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:19.600911 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c64712-13a7-43f1-8f9a-0c6e640c4ace service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:19.601556 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c64712-13a7-43f1-8f9a-0c6e640c4ace service cinder] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:19.601840 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c64712-13a7-43f1-8f9a-0c6e640c4ace service cinder] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:19.602129 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c64712-13a7-43f1-8f9a-0c6e640c4ace service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:19.612013 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c64712-13a7-43f1-8f9a-0c6e640c4ace service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:19.613433 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c64712-13a7-43f1-8f9a-0c6e640c4ace service cinder] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:19.623366 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1048/2096] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:39:19 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:39:19.706291 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db7b26-a6bf-495e-b897-476d9ac8c36d None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:19.707736 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-21db7b26-a6bf-495e-b897-476d9ac8c36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:19.719834 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db7b26-a6bf-495e-b897-476d9ac8c36d None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:19.723499 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64857903-1b12-42e2-8e99-6535f2057503 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:19.724167 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64857903-1b12-42e2-8e99-6535f2057503 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:19.724450 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64857903-1b12-42e2-8e99-6535f2057503 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:19.725897 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64857903-1b12-42e2-8e99-6535f2057503 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:19.735505 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:19.785723 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64857903-1b12-42e2-8e99-6535f2057503 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:19.787215 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64857903-1b12-42e2-8e99-6535f2057503 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:19.796169 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1049/2097] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:39:19 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:39:24.983508 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c64712-13a7-43f1-8f9a-0c6e640c4ace service cinder] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:25.060418 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c64712-13a7-43f1-8f9a-0c6e640c4ace service cinder] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:25.065030 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a701e-69e3-4786-948d-f76a9fa224e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:25.065943 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a701e-69e3-4786-948d-f76a9fa224e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:25.066291 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a701e-69e3-4786-948d-f76a9fa224e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:25.066490 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a701e-69e3-4786-948d-f76a9fa224e1 admin admin] PATH_INFO: `/v3/users/1ea9e60f01d74b2487a2661c7d60ff6c` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:25.067669 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a701e-69e3-4786-948d-f76a9fa224e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ea9e60f01d74b2487a2661c7d60ff6c)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:25.069566 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a701e-69e3-4786-948d-f76a9fa224e1 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:25.083139 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:25.120024 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-bd4a701e-69e3-4786-948d-f76a9fa224e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ea9e60f01d74b2487a2661c7d60ff6c'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:25.121092 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-bd4a701e-69e3-4786-948d-f76a9fa224e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ea9e60f01d74b2487a2661c7d60ff6c'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:25.135211 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-bd4a701e-69e3-4786-948d-f76a9fa224e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ea9e60f01d74b2487a2661c7d60ff6c'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:25.135974 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-bd4a701e-69e3-4786-948d-f76a9fa224e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ea9e60f01d74b2487a2661c7d60ff6c'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:25.150387 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-bd4a701e-69e3-4786-948d-f76a9fa224e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ea9e60f01d74b2487a2661c7d60ff6c'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:25.172527 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1049/2098] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:39:24 2022] DELETE /identity/v3/users/1ea9e60f01d74b2487a2661c7d60ff6c => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:39:25.178671 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478725d-2941-41f4-b694-f84879906575 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:25.178671 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478725d-2941-41f4-b694-f84879906575 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:25.178671 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478725d-2941-41f4-b694-f84879906575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:25.210437 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-d478725d-2941-41f4-b694-f84879906575 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:25.211569 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d478725d-2941-41f4-b694-f84879906575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:25.280670 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1050/2099] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:39:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:39:25.291479 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a701e-69e3-4786-948d-f76a9fa224e1 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:25.293121 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-bd4a701e-69e3-4786-948d-f76a9fa224e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:25.351210 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a701e-69e3-4786-948d-f76a9fa224e1 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:25.354920 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd1f4a-5c67-4785-aaa9-13a2e5c64f76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:25.355569 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd1f4a-5c67-4785-aaa9-13a2e5c64f76 service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:25.355854 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd1f4a-5c67-4785-aaa9-13a2e5c64f76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:25.356129 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd1f4a-5c67-4785-aaa9-13a2e5c64f76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:25.365998 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd1f4a-5c67-4785-aaa9-13a2e5c64f76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:25.367432 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd1f4a-5c67-4785-aaa9-13a2e5c64f76 service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:25.377065 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1050/2100] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:39:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:39:25.900608 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478725d-2941-41f4-b694-f84879906575 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:25.902079 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d478725d-2941-41f4-b694-f84879906575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:25.916489 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478725d-2941-41f4-b694-f84879906575 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:25.922567 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18137bdd-96f2-45de-b2a4-142ee7f23476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:25.923468 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18137bdd-96f2-45de-b2a4-142ee7f23476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:25.923749 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18137bdd-96f2-45de-b2a4-142ee7f23476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:25.924022 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18137bdd-96f2-45de-b2a4-142ee7f23476 admin admin] PATH_INFO: `/v3/projects/daef73bd0e034264a26ba36f1e74603f` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:25.925301 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18137bdd-96f2-45de-b2a4-142ee7f23476 admin admin] RBAC: Authorizing `identity:delete_project(project_id=daef73bd0e034264a26ba36f1e74603f)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:25.928073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18137bdd-96f2-45de-b2a4-142ee7f23476 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:25.981146 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-18137bdd-96f2-45de-b2a4-142ee7f23476 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daef73bd0e034264a26ba36f1e74603f', 'request_id': 'req-18137bdd-96f2-45de-b2a4-142ee7f23476'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:25.993069 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-18137bdd-96f2-45de-b2a4-142ee7f23476 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daef73bd0e034264a26ba36f1e74603f', 'request_id': 'req-18137bdd-96f2-45de-b2a4-142ee7f23476'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:25.999689 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-18137bdd-96f2-45de-b2a4-142ee7f23476 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daef73bd0e034264a26ba36f1e74603f', 'request_id': 'req-18137bdd-96f2-45de-b2a4-142ee7f23476'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:26.011995 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-18137bdd-96f2-45de-b2a4-142ee7f23476 admin admin] The token cache is being invalidate because project daef73bd0e034264a26ba36f1e74603f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:39:26.012293 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-18137bdd-96f2-45de-b2a4-142ee7f23476 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:26.013068 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-18137bdd-96f2-45de-b2a4-142ee7f23476 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:26.014748 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1051/2101] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:39:25 2022] DELETE /identity/v3/projects/daef73bd0e034264a26ba36f1e74603f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:39:26.018988 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd1f4a-5c67-4785-aaa9-13a2e5c64f76 service neutron] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:26.029842 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd1f4a-5c67-4785-aaa9-13a2e5c64f76 service neutron] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:26.089480 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2bdc1-b25f-441b-bbf9-7c50ed6af2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:26.090407 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2bdc1-b25f-441b-bbf9-7c50ed6af2fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:26.090690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2bdc1-b25f-441b-bbf9-7c50ed6af2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:26.090968 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2bdc1-b25f-441b-bbf9-7c50ed6af2fa admin admin] PATH_INFO: `/v3/users/b3e5e8e653f24f5ba969aa5d99ef61c0` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:26.092203 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd2bdc1-b25f-441b-bbf9-7c50ed6af2fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3e5e8e653f24f5ba969aa5d99ef61c0)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:26.094244 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd2bdc1-b25f-441b-bbf9-7c50ed6af2fa admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:26.135839 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:26.147391 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-0fd2bdc1-b25f-441b-bbf9-7c50ed6af2fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3e5e8e653f24f5ba969aa5d99ef61c0'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:26.148182 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-0fd2bdc1-b25f-441b-bbf9-7c50ed6af2fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3e5e8e653f24f5ba969aa5d99ef61c0'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:26.155432 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-0fd2bdc1-b25f-441b-bbf9-7c50ed6af2fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3e5e8e653f24f5ba969aa5d99ef61c0'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:26.156629 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-0fd2bdc1-b25f-441b-bbf9-7c50ed6af2fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3e5e8e653f24f5ba969aa5d99ef61c0'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:26.169248 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-0fd2bdc1-b25f-441b-bbf9-7c50ed6af2fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3e5e8e653f24f5ba969aa5d99ef61c0'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:26.184398 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1051/2102] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:39:26 2022] DELETE /identity/v3/users/b3e5e8e653f24f5ba969aa5d99ef61c0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:39:26.521579 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18137bdd-96f2-45de-b2a4-142ee7f23476 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:26.530129 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-18137bdd-96f2-45de-b2a4-142ee7f23476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:26.552105 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18137bdd-96f2-45de-b2a4-142ee7f23476 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:26.585903 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:26.613515 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e629346-29e9-476a-99c4-3b4182fbe949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:26.614418 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e629346-29e9-476a-99c4-3b4182fbe949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:26.614694 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e629346-29e9-476a-99c4-3b4182fbe949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:26.614962 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e629346-29e9-476a-99c4-3b4182fbe949 admin admin] PATH_INFO: `/v3/projects/8c46cc8eae7b48ecbe2b5e59155052b4` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:26.616183 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e629346-29e9-476a-99c4-3b4182fbe949 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c46cc8eae7b48ecbe2b5e59155052b4)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:26.618105 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e629346-29e9-476a-99c4-3b4182fbe949 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:26.676935 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5e629346-29e9-476a-99c4-3b4182fbe949 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c46cc8eae7b48ecbe2b5e59155052b4', 'request_id': 'req-5e629346-29e9-476a-99c4-3b4182fbe949'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:26.686840 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5e629346-29e9-476a-99c4-3b4182fbe949 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c46cc8eae7b48ecbe2b5e59155052b4', 'request_id': 'req-5e629346-29e9-476a-99c4-3b4182fbe949'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:26.693014 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5e629346-29e9-476a-99c4-3b4182fbe949 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c46cc8eae7b48ecbe2b5e59155052b4', 'request_id': 'req-5e629346-29e9-476a-99c4-3b4182fbe949'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:26.705199 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5e629346-29e9-476a-99c4-3b4182fbe949 admin admin] The token cache is being invalidate because project 8c46cc8eae7b48ecbe2b5e59155052b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:39:26.705503 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5e629346-29e9-476a-99c4-3b4182fbe949 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:26.706175 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5e629346-29e9-476a-99c4-3b4182fbe949 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:26.707778 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1052/2103] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:39:26 2022] DELETE /identity/v3/projects/8c46cc8eae7b48ecbe2b5e59155052b4 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:39:26.713055 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b3a4b-552b-461a-af72-d249575203e8 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:26.713406 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b3a4b-552b-461a-af72-d249575203e8 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:26.713770 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b3a4b-552b-461a-af72-d249575203e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:26.733140 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-e28b3a4b-552b-461a-af72-d249575203e8 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:26.734580 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-e28b3a4b-552b-461a-af72-d249575203e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:26.812283 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1052/2104] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:39:26.821021 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4bbe0a-1527-4c70-b38f-c3fdb1c0c179 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:26.821314 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4bbe0a-1527-4c70-b38f-c3fdb1c0c179 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:26.821595 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4bbe0a-1527-4c70-b38f-c3fdb1c0c179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:26.841046 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-6e4bbe0a-1527-4c70-b38f-c3fdb1c0c179 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:26.842352 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-6e4bbe0a-1527-4c70-b38f-c3fdb1c0c179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:26.854262 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1053/2105] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:39:26.857480 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b3a4b-552b-461a-af72-d249575203e8 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:26.867778 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b3a4b-552b-461a-af72-d249575203e8 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:26.872656 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f0e8e-c574-4c9f-8b26-52731962bd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:26.873271 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f0e8e-c574-4c9f-8b26-52731962bd81 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:26.873552 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f0e8e-c574-4c9f-8b26-52731962bd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:26.873873 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f0e8e-c574-4c9f-8b26-52731962bd81 admin admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:26.874776 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f0e8e-c574-4c9f-8b26-52731962bd81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:39:26.875083 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f0e8e-c574-4c9f-8b26-52731962bd81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:26.876703 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f0e8e-c574-4c9f-8b26-52731962bd81 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:26.889925 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1053/2106] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:39:26.894785 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4bbe0a-1527-4c70-b38f-c3fdb1c0c179 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:26.905808 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4bbe0a-1527-4c70-b38f-c3fdb1c0c179 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:26.912029 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fabf56-b9a7-4195-bcfb-afa90c159d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:26.912713 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fabf56-b9a7-4195-bcfb-afa90c159d46 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:26.912993 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fabf56-b9a7-4195-bcfb-afa90c159d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:26.913268 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fabf56-b9a7-4195-bcfb-afa90c159d46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:26.914007 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fabf56-b9a7-4195-bcfb-afa90c159d46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:26.915916 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fabf56-b9a7-4195-bcfb-afa90c159d46 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:26.949594 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1054/2107] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:39:26 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:39:26.950882 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f0e8e-c574-4c9f-8b26-52731962bd81 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:26.961712 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f0e8e-c574-4c9f-8b26-52731962bd81 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:27.023871 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1bb283-a289-43ac-993b-f69e8aa8b64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:27.024587 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1bb283-a289-43ac-993b-f69e8aa8b64b admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:27.025033 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1bb283-a289-43ac-993b-f69e8aa8b64b admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:27.026260 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1bb283-a289-43ac-993b-f69e8aa8b64b admin admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:27.027065 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1bb283-a289-43ac-993b-f69e8aa8b64b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:27.029492 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1bb283-a289-43ac-993b-f69e8aa8b64b admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:27.057615 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1054/2108] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:39:26 2022] POST /identity/v3/users => generated 291 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:39:27.061893 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fabf56-b9a7-4195-bcfb-afa90c159d46 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:27.080533 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fabf56-b9a7-4195-bcfb-afa90c159d46 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:27.085362 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f40ab-e660-43e3-b0fe-fc37ffb6455c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:27.086169 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f40ab-e660-43e3-b0fe-fc37ffb6455c admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:27.086450 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f40ab-e660-43e3-b0fe-fc37ffb6455c admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:27.086754 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f40ab-e660-43e3-b0fe-fc37ffb6455c admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:27.087463 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f40ab-e660-43e3-b0fe-fc37ffb6455c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:27.089077 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f40ab-e660-43e3-b0fe-fc37ffb6455c admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:27.101058 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1055/2109] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:39:27.105112 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1bb283-a289-43ac-993b-f69e8aa8b64b admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:27.115199 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1bb283-a289-43ac-993b-f69e8aa8b64b admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:27.120008 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c2a38-358d-4345-9e22-30c04114c44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:27.120741 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c2a38-358d-4345-9e22-30c04114c44a admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:27.121019 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c2a38-358d-4345-9e22-30c04114c44a admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:27.121287 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c2a38-358d-4345-9e22-30c04114c44a admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:27.122061 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c2a38-358d-4345-9e22-30c04114c44a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:27.123646 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c2a38-358d-4345-9e22-30c04114c44a admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:27.134024 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1055/2110] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:39:27.144851 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f40ab-e660-43e3-b0fe-fc37ffb6455c admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:27.155342 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f40ab-e660-43e3-b0fe-fc37ffb6455c admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:27.160735 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa1e002-5264-4231-87b0-b82b6ecd2513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:27.161670 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1e002-5264-4231-87b0-b82b6ecd2513 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:27.161996 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1e002-5264-4231-87b0-b82b6ecd2513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:27.162263 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1e002-5264-4231-87b0-b82b6ecd2513 admin admin] PATH_INFO: `/v3/projects/8dc67dcdf6af4e4d90a238f8f7867eba/users/48b5628a2146487b84e45ee036f81968/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:27.179184 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa1e002-5264-4231-87b0-b82b6ecd2513 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dc67dcdf6af4e4d90a238f8f7867eba, user_id=48b5628a2146487b84e45ee036f81968, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:27.181757 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa1e002-5264-4231-87b0-b82b6ecd2513 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:27.199592 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1056/2111] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:39:27 2022] PUT /identity/v3/projects/8dc67dcdf6af4e4d90a238f8f7867eba/users/48b5628a2146487b84e45ee036f81968/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:39:27.211285 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151084a4-bd04-46e8-a6da-a1af1388bdcc None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:27.211573 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151084a4-bd04-46e8-a6da-a1af1388bdcc None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:27.211848 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151084a4-bd04-46e8-a6da-a1af1388bdcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:27.239839 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-151084a4-bd04-46e8-a6da-a1af1388bdcc None None] MFA Rules not processed for user `48b5628a2146487b84e45ee036f81968`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:27.241061 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-151084a4-bd04-46e8-a6da-a1af1388bdcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:27.246203 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:27.323167 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1056/2112] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:39:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:39:27.328666 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa1e002-5264-4231-87b0-b82b6ecd2513 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:27.402839 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa1e002-5264-4231-87b0-b82b6ecd2513 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:27.408408 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70174e-1333-47fc-8bc0-836b59e7d7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:27.409066 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70174e-1333-47fc-8bc0-836b59e7d7ab admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:27.409346 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70174e-1333-47fc-8bc0-836b59e7d7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:27.409614 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70174e-1333-47fc-8bc0-836b59e7d7ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:27.410340 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70174e-1333-47fc-8bc0-836b59e7d7ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:27.412354 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70174e-1333-47fc-8bc0-836b59e7d7ab admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:27.415758 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:27.440942 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1057/2113] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:39:27 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:39:27.446862 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151084a4-bd04-46e8-a6da-a1af1388bdcc None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:27.459759 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151084a4-bd04-46e8-a6da-a1af1388bdcc None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:27.521618 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9bbbfb-ebcd-42fc-a6ba-72fac1aca1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:27.522591 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9bbbfb-ebcd-42fc-a6ba-72fac1aca1f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:27.522877 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9bbbfb-ebcd-42fc-a6ba-72fac1aca1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:27.523154 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9bbbfb-ebcd-42fc-a6ba-72fac1aca1f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:27.523851 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9bbbfb-ebcd-42fc-a6ba-72fac1aca1f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:27.526157 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9bbbfb-ebcd-42fc-a6ba-72fac1aca1f4 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:27.553579 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1057/2114] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:39:27 2022] POST /identity/v3/users => generated 298 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:39:27.555275 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70174e-1333-47fc-8bc0-836b59e7d7ab admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:27.575562 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70174e-1333-47fc-8bc0-836b59e7d7ab admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:27.581195 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b15bc-20e1-48ef-82ee-7b6ed5cdb5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:27.582063 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b15bc-20e1-48ef-82ee-7b6ed5cdb5a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:27.582456 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b15bc-20e1-48ef-82ee-7b6ed5cdb5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:27.582829 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b15bc-20e1-48ef-82ee-7b6ed5cdb5a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:27.583772 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52b15bc-20e1-48ef-82ee-7b6ed5cdb5a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:27.585507 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52b15bc-20e1-48ef-82ee-7b6ed5cdb5a5 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:27.609175 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1058/2115] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:39:27.613574 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9bbbfb-ebcd-42fc-a6ba-72fac1aca1f4 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:27.627276 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9bbbfb-ebcd-42fc-a6ba-72fac1aca1f4 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:27.636016 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb972b0-5d0b-49b7-94aa-5581507f1a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:27.637140 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb972b0-5d0b-49b7-94aa-5581507f1a49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:27.637444 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb972b0-5d0b-49b7-94aa-5581507f1a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:27.637712 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb972b0-5d0b-49b7-94aa-5581507f1a49 admin admin] PATH_INFO: `/v3/projects/3fbfdc7e2915409dac8967519b928591/users/f8992b66faab4574a478c740b88cf7d8/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:27.663311 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb972b0-5d0b-49b7-94aa-5581507f1a49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fbfdc7e2915409dac8967519b928591, user_id=f8992b66faab4574a478c740b88cf7d8, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:27.666350 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb972b0-5d0b-49b7-94aa-5581507f1a49 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:27.683291 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1058/2116] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:39:27 2022] PUT /identity/v3/projects/3fbfdc7e2915409dac8967519b928591/users/f8992b66faab4574a478c740b88cf7d8/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:39:27.687237 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b15bc-20e1-48ef-82ee-7b6ed5cdb5a5 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:27.699027 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b15bc-20e1-48ef-82ee-7b6ed5cdb5a5 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:27.757387 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48258f7a-f5de-41dc-ba3c-14c459529f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:27.758114 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48258f7a-f5de-41dc-ba3c-14c459529f8a admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:27.758377 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48258f7a-f5de-41dc-ba3c-14c459529f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:27.758649 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48258f7a-f5de-41dc-ba3c-14c459529f8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:27.759379 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48258f7a-f5de-41dc-ba3c-14c459529f8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:27.761022 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48258f7a-f5de-41dc-ba3c-14c459529f8a admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:27.776654 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1059/2117] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 17:39:27.777807 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb972b0-5d0b-49b7-94aa-5581507f1a49 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:27.790132 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb972b0-5d0b-49b7-94aa-5581507f1a49 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:27.795125 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc020b-4588-45a3-aff0-6d994a5803fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:27.796023 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc020b-4588-45a3-aff0-6d994a5803fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:27.796343 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc020b-4588-45a3-aff0-6d994a5803fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:27.796650 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc020b-4588-45a3-aff0-6d994a5803fe admin admin] PATH_INFO: `/v3/projects/3fbfdc7e2915409dac8967519b928591/users/f8992b66faab4574a478c740b88cf7d8/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:27.798883 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc020b-4588-45a3-aff0-6d994a5803fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fbfdc7e2915409dac8967519b928591, user_id=f8992b66faab4574a478c740b88cf7d8, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:27.801549 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc020b-4588-45a3-aff0-6d994a5803fe admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:27.812668 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1059/2118] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:39:27 2022] PUT /identity/v3/projects/3fbfdc7e2915409dac8967519b928591/users/f8992b66faab4574a478c740b88cf7d8/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:39:27.822957 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f19f0d-8dca-4840-9945-c069496f4b0b None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:27.823172 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f19f0d-8dca-4840-9945-c069496f4b0b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:27.823842 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f19f0d-8dca-4840-9945-c069496f4b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:27.851564 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-f2f19f0d-8dca-4840-9945-c069496f4b0b None None] MFA Rules not processed for user `f8992b66faab4574a478c740b88cf7d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:27.852767 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f2f19f0d-8dca-4840-9945-c069496f4b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:27.927891 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1060/2119] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:39:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:39:27.938815 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc020b-4588-45a3-aff0-6d994a5803fe admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:27.940636 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-14fc020b-4588-45a3-aff0-6d994a5803fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:27.999232 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc020b-4588-45a3-aff0-6d994a5803fe admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:28.002925 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf1194-7bc5-4356-896c-70a3acf89fc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:28.003581 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf1194-7bc5-4356-896c-70a3acf89fc1 service cinder] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:28.003868 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf1194-7bc5-4356-896c-70a3acf89fc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:28.004145 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf1194-7bc5-4356-896c-70a3acf89fc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:28.013436 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf1194-7bc5-4356-896c-70a3acf89fc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:28.015010 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf1194-7bc5-4356-896c-70a3acf89fc1 service cinder] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:28.025021 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1060/2120] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:39:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:39:28.169929 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f19f0d-8dca-4840-9945-c069496f4b0b None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:28.179997 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f19f0d-8dca-4840-9945-c069496f4b0b None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:28.188948 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77680a76-8cff-4cdd-a5e0-c3ed97854cf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:28.189626 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77680a76-8cff-4cdd-a5e0-c3ed97854cf0 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:28.189984 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77680a76-8cff-4cdd-a5e0-c3ed97854cf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:28.190232 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77680a76-8cff-4cdd-a5e0-c3ed97854cf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:28.255250 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:28.267640 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77680a76-8cff-4cdd-a5e0-c3ed97854cf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:28.269524 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77680a76-8cff-4cdd-a5e0-c3ed97854cf0 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:28.284204 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1061/2121] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:39:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 17:39:31.927455 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf1194-7bc5-4356-896c-70a3acf89fc1 service cinder] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:31.934103 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:32.002217 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf1194-7bc5-4356-896c-70a3acf89fc1 service cinder] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:32.007189 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de1a99-1beb-473b-9f80-ccaa1a5d3f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:32.008072 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de1a99-1beb-473b-9f80-ccaa1a5d3f89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:32.008345 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de1a99-1beb-473b-9f80-ccaa1a5d3f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:32.008619 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de1a99-1beb-473b-9f80-ccaa1a5d3f89 admin admin] PATH_INFO: `/v3/users/48b5628a2146487b84e45ee036f81968` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:32.009856 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de1a99-1beb-473b-9f80-ccaa1a5d3f89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48b5628a2146487b84e45ee036f81968)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:32.011776 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de1a99-1beb-473b-9f80-ccaa1a5d3f89 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:32.080243 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-31de1a99-1beb-473b-9f80-ccaa1a5d3f89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48b5628a2146487b84e45ee036f81968'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:32.080973 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-31de1a99-1beb-473b-9f80-ccaa1a5d3f89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48b5628a2146487b84e45ee036f81968'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:32.088253 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-31de1a99-1beb-473b-9f80-ccaa1a5d3f89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48b5628a2146487b84e45ee036f81968'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:32.088902 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-31de1a99-1beb-473b-9f80-ccaa1a5d3f89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48b5628a2146487b84e45ee036f81968'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:32.105711 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-31de1a99-1beb-473b-9f80-ccaa1a5d3f89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48b5628a2146487b84e45ee036f81968'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:32.120970 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1061/2122] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:39:31 2022] DELETE /identity/v3/users/48b5628a2146487b84e45ee036f81968 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:39:32.125446 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9dd61-d146-4ef8-8647-0a5ceb881957 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:32.125898 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9dd61-d146-4ef8-8647-0a5ceb881957 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:32.126054 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9dd61-d146-4ef8-8647-0a5ceb881957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:32.144855 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-2fa9dd61-d146-4ef8-8647-0a5ceb881957 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:32.146192 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-2fa9dd61-d146-4ef8-8647-0a5ceb881957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:32.209825 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1062/2123] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:39:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:39:32.216600 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de1a99-1beb-473b-9f80-ccaa1a5d3f89 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:32.218132 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-31de1a99-1beb-473b-9f80-ccaa1a5d3f89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:32.277224 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de1a99-1beb-473b-9f80-ccaa1a5d3f89 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:32.280921 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd0406-7a5c-4524-ba8d-a48e5ddf6201 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:32.281584 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd0406-7a5c-4524-ba8d-a48e5ddf6201 service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:32.281894 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd0406-7a5c-4524-ba8d-a48e5ddf6201 service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:32.282174 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd0406-7a5c-4524-ba8d-a48e5ddf6201 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:32.291342 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fd0406-7a5c-4524-ba8d-a48e5ddf6201 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:32.292781 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fd0406-7a5c-4524-ba8d-a48e5ddf6201 service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:32.302773 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1062/2124] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:39:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:39:32.650813 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9dd61-d146-4ef8-8647-0a5ceb881957 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:32.652268 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-2fa9dd61-d146-4ef8-8647-0a5ceb881957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:32.664540 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9dd61-d146-4ef8-8647-0a5ceb881957 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:32.669734 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17490860-d71a-419a-a98c-5a9b1093819d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:32.670744 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17490860-d71a-419a-a98c-5a9b1093819d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:32.670951 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17490860-d71a-419a-a98c-5a9b1093819d admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:32.671233 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17490860-d71a-419a-a98c-5a9b1093819d admin admin] PATH_INFO: `/v3/projects/8dc67dcdf6af4e4d90a238f8f7867eba` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:32.672917 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17490860-d71a-419a-a98c-5a9b1093819d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dc67dcdf6af4e4d90a238f8f7867eba)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:32.674659 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17490860-d71a-419a-a98c-5a9b1093819d admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:32.738126 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-17490860-d71a-419a-a98c-5a9b1093819d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dc67dcdf6af4e4d90a238f8f7867eba', 'request_id': 'req-17490860-d71a-419a-a98c-5a9b1093819d'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:32.752393 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-17490860-d71a-419a-a98c-5a9b1093819d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dc67dcdf6af4e4d90a238f8f7867eba', 'request_id': 'req-17490860-d71a-419a-a98c-5a9b1093819d'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:32.762417 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-17490860-d71a-419a-a98c-5a9b1093819d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dc67dcdf6af4e4d90a238f8f7867eba', 'request_id': 'req-17490860-d71a-419a-a98c-5a9b1093819d'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:32.777367 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-17490860-d71a-419a-a98c-5a9b1093819d admin admin] The token cache is being invalidate because project 8dc67dcdf6af4e4d90a238f8f7867eba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:39:32.777829 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-17490860-d71a-419a-a98c-5a9b1093819d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:32.778577 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-17490860-d71a-419a-a98c-5a9b1093819d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:32.780493 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1063/2125] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:39:32 2022] DELETE /identity/v3/projects/8dc67dcdf6af4e4d90a238f8f7867eba => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:39:32.785144 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd0406-7a5c-4524-ba8d-a48e5ddf6201 service neutron] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:32.796181 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd0406-7a5c-4524-ba8d-a48e5ddf6201 service neutron] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:32.821705 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:32.862941 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ebde2-88f0-43f6-ae2d-757be94c14c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:32.863829 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ebde2-88f0-43f6-ae2d-757be94c14c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:32.864109 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ebde2-88f0-43f6-ae2d-757be94c14c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:32.864383 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ebde2-88f0-43f6-ae2d-757be94c14c7 admin admin] PATH_INFO: `/v3/users/f8992b66faab4574a478c740b88cf7d8` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:32.865534 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7ebde2-88f0-43f6-ae2d-757be94c14c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8992b66faab4574a478c740b88cf7d8)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:32.867512 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7ebde2-88f0-43f6-ae2d-757be94c14c7 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:32.921307 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-5c7ebde2-88f0-43f6-ae2d-757be94c14c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8992b66faab4574a478c740b88cf7d8'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:32.921982 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-5c7ebde2-88f0-43f6-ae2d-757be94c14c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8992b66faab4574a478c740b88cf7d8'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:32.928820 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-5c7ebde2-88f0-43f6-ae2d-757be94c14c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8992b66faab4574a478c740b88cf7d8'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:32.929448 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-5c7ebde2-88f0-43f6-ae2d-757be94c14c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8992b66faab4574a478c740b88cf7d8'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:32.941747 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-5c7ebde2-88f0-43f6-ae2d-757be94c14c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8992b66faab4574a478c740b88cf7d8'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:32.959128 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1063/2126] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:39:32 2022] DELETE /identity/v3/users/f8992b66faab4574a478c740b88cf7d8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:39:33.391418 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17490860-d71a-419a-a98c-5a9b1093819d admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:33.393052 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-17490860-d71a-419a-a98c-5a9b1093819d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:33.415617 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17490860-d71a-419a-a98c-5a9b1093819d admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:33.504508 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae60f62-ee39-471f-a4be-894c4b70bdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:33.505404 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae60f62-ee39-471f-a4be-894c4b70bdea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:33.505687 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae60f62-ee39-471f-a4be-894c4b70bdea admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:33.506001 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae60f62-ee39-471f-a4be-894c4b70bdea admin admin] PATH_INFO: `/v3/projects/3fbfdc7e2915409dac8967519b928591` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:33.507198 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae60f62-ee39-471f-a4be-894c4b70bdea admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fbfdc7e2915409dac8967519b928591)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:33.509274 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae60f62-ee39-471f-a4be-894c4b70bdea admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:33.531714 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:33.558387 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-2ae60f62-ee39-471f-a4be-894c4b70bdea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fbfdc7e2915409dac8967519b928591', 'request_id': 'req-2ae60f62-ee39-471f-a4be-894c4b70bdea'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:33.567474 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-2ae60f62-ee39-471f-a4be-894c4b70bdea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fbfdc7e2915409dac8967519b928591', 'request_id': 'req-2ae60f62-ee39-471f-a4be-894c4b70bdea'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:33.574395 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-2ae60f62-ee39-471f-a4be-894c4b70bdea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fbfdc7e2915409dac8967519b928591', 'request_id': 'req-2ae60f62-ee39-471f-a4be-894c4b70bdea'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:33.588539 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-2ae60f62-ee39-471f-a4be-894c4b70bdea admin admin] The token cache is being invalidate because project 3fbfdc7e2915409dac8967519b928591 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:39:33.588816 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-2ae60f62-ee39-471f-a4be-894c4b70bdea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:33.589481 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-2ae60f62-ee39-471f-a4be-894c4b70bdea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:33.591079 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1064/2127] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:39:33 2022] DELETE /identity/v3/projects/3fbfdc7e2915409dac8967519b928591 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:39:33.597163 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def902a6-ca56-41a9-b09f-faf1d1cbf9dc None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:33.597505 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def902a6-ca56-41a9-b09f-faf1d1cbf9dc None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:33.598109 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def902a6-ca56-41a9-b09f-faf1d1cbf9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:33.626169 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-def902a6-ca56-41a9-b09f-faf1d1cbf9dc None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:33.627681 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-def902a6-ca56-41a9-b09f-faf1d1cbf9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:33.698649 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1064/2128] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:39:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:39:33.707069 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967ecb3-6d54-4353-8489-8937ee36feba None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:33.708209 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967ecb3-6d54-4353-8489-8937ee36feba None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:33.708664 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967ecb3-6d54-4353-8489-8937ee36feba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:33.729238 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-a967ecb3-6d54-4353-8489-8937ee36feba None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:33.730495 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a967ecb3-6d54-4353-8489-8937ee36feba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:33.740121 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1065/2129] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:39:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:39:33.744386 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def902a6-ca56-41a9-b09f-faf1d1cbf9dc None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:33.754552 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def902a6-ca56-41a9-b09f-faf1d1cbf9dc None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:33.759357 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d0022-126a-4c66-bb4a-9a4f7e865358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:33.760051 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d0022-126a-4c66-bb4a-9a4f7e865358 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:33.760333 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d0022-126a-4c66-bb4a-9a4f7e865358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:33.760607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d0022-126a-4c66-bb4a-9a4f7e865358 admin admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:33.761347 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112d0022-126a-4c66-bb4a-9a4f7e865358 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:39:33.761656 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112d0022-126a-4c66-bb4a-9a4f7e865358 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:33.763309 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112d0022-126a-4c66-bb4a-9a4f7e865358 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:33.776458 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1065/2130] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:39:33.780946 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967ecb3-6d54-4353-8489-8937ee36feba None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:33.791891 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967ecb3-6d54-4353-8489-8937ee36feba None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:33.797015 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb2082-2885-433a-9eea-b49eca4e9955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:33.797762 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb2082-2885-433a-9eea-b49eca4e9955 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:33.798137 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb2082-2885-433a-9eea-b49eca4e9955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:33.798465 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb2082-2885-433a-9eea-b49eca4e9955 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:33.799289 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cb2082-2885-433a-9eea-b49eca4e9955 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:33.801306 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cb2082-2885-433a-9eea-b49eca4e9955 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:33.848020 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1066/2131] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:39:33 2022] POST /identity/v3/projects => generated 389 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:39:33.852703 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d0022-126a-4c66-bb4a-9a4f7e865358 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:33.866237 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d0022-126a-4c66-bb4a-9a4f7e865358 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:33.897885 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:33.926403 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b5b84-5623-47e7-bf29-88a45ad219b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:33.927108 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b5b84-5623-47e7-bf29-88a45ad219b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:33.927414 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b5b84-5623-47e7-bf29-88a45ad219b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:33.927690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b5b84-5623-47e7-bf29-88a45ad219b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:33.928399 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b5b84-5623-47e7-bf29-88a45ad219b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:33.930359 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b5b84-5623-47e7-bf29-88a45ad219b6 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:33.952374 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1066/2132] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:39:33 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 17:39:33.956721 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb2082-2885-433a-9eea-b49eca4e9955 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:33.967209 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb2082-2885-433a-9eea-b49eca4e9955 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:33.972214 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af657315-0df1-4f50-9cba-41c88c1eebc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:33.972877 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af657315-0df1-4f50-9cba-41c88c1eebc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:33.973154 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af657315-0df1-4f50-9cba-41c88c1eebc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:33.973427 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af657315-0df1-4f50-9cba-41c88c1eebc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:33.974191 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af657315-0df1-4f50-9cba-41c88c1eebc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:33.975789 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af657315-0df1-4f50-9cba-41c88c1eebc6 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:33.986489 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1067/2133] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:39:33.991027 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b5b84-5623-47e7-bf29-88a45ad219b6 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:34.001906 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b5b84-5623-47e7-bf29-88a45ad219b6 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:34.006821 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd89da-e983-4d06-9cc5-6b51735213ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:34.007493 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd89da-e983-4d06-9cc5-6b51735213ad admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:34.007778 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd89da-e983-4d06-9cc5-6b51735213ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:34.008056 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd89da-e983-4d06-9cc5-6b51735213ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:34.008800 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd89da-e983-4d06-9cc5-6b51735213ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:34.010504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd89da-e983-4d06-9cc5-6b51735213ad admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:34.021509 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1067/2134] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:39:34.025761 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af657315-0df1-4f50-9cba-41c88c1eebc6 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:34.036032 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af657315-0df1-4f50-9cba-41c88c1eebc6 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:34.041306 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc243b-647e-46df-be7a-d23f32b2d078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:34.042305 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc243b-647e-46df-be7a-d23f32b2d078 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:34.042524 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc243b-647e-46df-be7a-d23f32b2d078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:34.042810 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc243b-647e-46df-be7a-d23f32b2d078 admin admin] PATH_INFO: `/v3/projects/9e702d5922524b778626801c54baf0b3/users/c6d62119a02f4e5bba93762b18a236f6/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:34.058754 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefc243b-647e-46df-be7a-d23f32b2d078 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e702d5922524b778626801c54baf0b3, user_id=c6d62119a02f4e5bba93762b18a236f6, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:34.061423 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefc243b-647e-46df-be7a-d23f32b2d078 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:34.076848 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1068/2135] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:39:34 2022] PUT /identity/v3/projects/9e702d5922524b778626801c54baf0b3/users/c6d62119a02f4e5bba93762b18a236f6/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:39:34.088346 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ccfc48-b6bb-4098-8ea8-56644381d864 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:34.088644 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ccfc48-b6bb-4098-8ea8-56644381d864 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:34.088934 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ccfc48-b6bb-4098-8ea8-56644381d864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:34.117413 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-47ccfc48-b6bb-4098-8ea8-56644381d864 None None] MFA Rules not processed for user `c6d62119a02f4e5bba93762b18a236f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:34.118801 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-47ccfc48-b6bb-4098-8ea8-56644381d864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:34.190031 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1068/2136] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:39:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:39:34.195413 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc243b-647e-46df-be7a-d23f32b2d078 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:34.261080 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc243b-647e-46df-be7a-d23f32b2d078 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:34.265836 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28617fdd-dc42-4190-a29f-b171cf498a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:34.266511 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28617fdd-dc42-4190-a29f-b171cf498a95 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:34.266796 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28617fdd-dc42-4190-a29f-b171cf498a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:34.267076 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28617fdd-dc42-4190-a29f-b171cf498a95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:34.267947 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28617fdd-dc42-4190-a29f-b171cf498a95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:34.269799 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28617fdd-dc42-4190-a29f-b171cf498a95 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:34.301019 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1069/2137] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:39:34 2022] POST /identity/v3/projects => generated 389 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:39:34.306545 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ccfc48-b6bb-4098-8ea8-56644381d864 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:34.318280 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ccfc48-b6bb-4098-8ea8-56644381d864 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:34.377940 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f209b-3784-4b9f-9d86-06493850a20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:34.378624 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f209b-3784-4b9f-9d86-06493850a20a admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:34.378903 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f209b-3784-4b9f-9d86-06493850a20a admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:34.379177 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f209b-3784-4b9f-9d86-06493850a20a admin admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:34.379862 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90f209b-3784-4b9f-9d86-06493850a20a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:34.381814 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90f209b-3784-4b9f-9d86-06493850a20a admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:34.406021 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1069/2138] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:39:34 2022] POST /identity/v3/users => generated 301 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 17:39:34.411000 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28617fdd-dc42-4190-a29f-b171cf498a95 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:34.421512 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28617fdd-dc42-4190-a29f-b171cf498a95 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:34.426444 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85274ba6-8ef6-46dd-9e80-9d488c032449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:34.427112 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85274ba6-8ef6-46dd-9e80-9d488c032449 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:34.427413 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85274ba6-8ef6-46dd-9e80-9d488c032449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:34.427725 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85274ba6-8ef6-46dd-9e80-9d488c032449 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:34.428459 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85274ba6-8ef6-46dd-9e80-9d488c032449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:34.430089 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85274ba6-8ef6-46dd-9e80-9d488c032449 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:34.440870 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1070/2139] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:39:34.445042 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f209b-3784-4b9f-9d86-06493850a20a admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:34.456931 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f209b-3784-4b9f-9d86-06493850a20a admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:34.462354 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12594d8-4d2d-46fb-89b2-416775301152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:34.463255 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12594d8-4d2d-46fb-89b2-416775301152 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:34.463531 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12594d8-4d2d-46fb-89b2-416775301152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:34.463805 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12594d8-4d2d-46fb-89b2-416775301152 admin admin] PATH_INFO: `/v3/projects/b27613930fc64777b7af87b68f4d59e5/users/d35fb74f455b49dd8c347d34af17f475/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:34.480278 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12594d8-4d2d-46fb-89b2-416775301152 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b27613930fc64777b7af87b68f4d59e5, user_id=d35fb74f455b49dd8c347d34af17f475, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:34.483405 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12594d8-4d2d-46fb-89b2-416775301152 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:34.500870 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1070/2140] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:39:34 2022] PUT /identity/v3/projects/b27613930fc64777b7af87b68f4d59e5/users/d35fb74f455b49dd8c347d34af17f475/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:39:34.505338 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85274ba6-8ef6-46dd-9e80-9d488c032449 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:34.519987 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85274ba6-8ef6-46dd-9e80-9d488c032449 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:34.533898 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:34.581837 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7916d227-6ffe-470f-b819-b963e005e986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:34.582517 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916d227-6ffe-470f-b819-b963e005e986 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:34.582794 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916d227-6ffe-470f-b819-b963e005e986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:34.583063 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916d227-6ffe-470f-b819-b963e005e986 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:34.583792 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7916d227-6ffe-470f-b819-b963e005e986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:34.585375 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7916d227-6ffe-470f-b819-b963e005e986 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:34.596142 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1071/2141] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:39:34.599905 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12594d8-4d2d-46fb-89b2-416775301152 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:34.607229 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:34.611381 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12594d8-4d2d-46fb-89b2-416775301152 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:34.617455 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc54d50-edfa-4b9c-a3d3-7113c8b5a667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:34.618360 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc54d50-edfa-4b9c-a3d3-7113c8b5a667 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:34.618661 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc54d50-edfa-4b9c-a3d3-7113c8b5a667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:34.618927 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc54d50-edfa-4b9c-a3d3-7113c8b5a667 admin admin] PATH_INFO: `/v3/projects/b27613930fc64777b7af87b68f4d59e5/users/d35fb74f455b49dd8c347d34af17f475/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:34.620883 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc54d50-edfa-4b9c-a3d3-7113c8b5a667 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b27613930fc64777b7af87b68f4d59e5, user_id=d35fb74f455b49dd8c347d34af17f475, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:34.623549 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc54d50-edfa-4b9c-a3d3-7113c8b5a667 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:34.634234 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1071/2142] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:39:34 2022] PUT /identity/v3/projects/b27613930fc64777b7af87b68f4d59e5/users/d35fb74f455b49dd8c347d34af17f475/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:39:34.644736 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d6441-2103-430b-95b9-f0e57ea0e112 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:34.645096 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d6441-2103-430b-95b9-f0e57ea0e112 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:34.645383 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d6441-2103-430b-95b9-f0e57ea0e112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:34.673585 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-173d6441-2103-430b-95b9-f0e57ea0e112 None None] MFA Rules not processed for user `d35fb74f455b49dd8c347d34af17f475`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:34.674828 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-173d6441-2103-430b-95b9-f0e57ea0e112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:34.747393 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1072/2143] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:39:34 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:39:34.762602 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc54d50-edfa-4b9c-a3d3-7113c8b5a667 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:34.764396 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-1fc54d50-edfa-4b9c-a3d3-7113c8b5a667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:34.823073 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc54d50-edfa-4b9c-a3d3-7113c8b5a667 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:34.827085 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd9f47-77c6-4ecf-a215-7bc41decea4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:34.827753 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd9f47-77c6-4ecf-a215-7bc41decea4a service cinder] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:34.828014 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd9f47-77c6-4ecf-a215-7bc41decea4a service cinder] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:34.828283 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd9f47-77c6-4ecf-a215-7bc41decea4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:34.838162 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd9f47-77c6-4ecf-a215-7bc41decea4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:34.839583 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd9f47-77c6-4ecf-a215-7bc41decea4a service cinder] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:34.850410 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1072/2144] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:39:34 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:39:35.109568 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d6441-2103-430b-95b9-f0e57ea0e112 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:35.185666 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d6441-2103-430b-95b9-f0e57ea0e112 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:35.191933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71b54a-22b9-4cf3-ab9a-3d5a19bc6d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:35.193978 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71b54a-22b9-4cf3-ab9a-3d5a19bc6d01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:35.194289 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71b54a-22b9-4cf3-ab9a-3d5a19bc6d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:35.194576 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71b54a-22b9-4cf3-ab9a-3d5a19bc6d01 admin admin] PATH_INFO: `/v3/users/c6d62119a02f4e5bba93762b18a236f6` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:35.195911 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a71b54a-22b9-4cf3-ab9a-3d5a19bc6d01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6d62119a02f4e5bba93762b18a236f6)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:35.199238 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a71b54a-22b9-4cf3-ab9a-3d5a19bc6d01 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:35.264858 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:35.274843 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9a71b54a-22b9-4cf3-ab9a-3d5a19bc6d01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6d62119a02f4e5bba93762b18a236f6'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:35.275745 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9a71b54a-22b9-4cf3-ab9a-3d5a19bc6d01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6d62119a02f4e5bba93762b18a236f6'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:35.285271 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9a71b54a-22b9-4cf3-ab9a-3d5a19bc6d01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6d62119a02f4e5bba93762b18a236f6'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:35.306457 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9a71b54a-22b9-4cf3-ab9a-3d5a19bc6d01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6d62119a02f4e5bba93762b18a236f6'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:35.315923 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9a71b54a-22b9-4cf3-ab9a-3d5a19bc6d01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6d62119a02f4e5bba93762b18a236f6'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:35.324619 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1073/2145] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:39:35 2022] DELETE /identity/v3/users/c6d62119a02f4e5bba93762b18a236f6 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:39:35.329005 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054caefa-97ab-4f32-b846-b0b1c2318732 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:35.329453 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054caefa-97ab-4f32-b846-b0b1c2318732 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:35.329453 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054caefa-97ab-4f32-b846-b0b1c2318732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:35.358019 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-054caefa-97ab-4f32-b846-b0b1c2318732 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:35.358019 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-054caefa-97ab-4f32-b846-b0b1c2318732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:35.426659 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1073/2146] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:39:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:39:35.436651 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71b54a-22b9-4cf3-ab9a-3d5a19bc6d01 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:35.438224 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-9a71b54a-22b9-4cf3-ab9a-3d5a19bc6d01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:35.498287 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71b54a-22b9-4cf3-ab9a-3d5a19bc6d01 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:35.502279 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78930b87-fb3c-472a-9502-396b1eca8317 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:35.502928 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78930b87-fb3c-472a-9502-396b1eca8317 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:35.503215 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78930b87-fb3c-472a-9502-396b1eca8317 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:35.503492 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78930b87-fb3c-472a-9502-396b1eca8317 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:35.512919 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78930b87-fb3c-472a-9502-396b1eca8317 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:35.514386 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78930b87-fb3c-472a-9502-396b1eca8317 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:35.524602 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1074/2147] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:39:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:39:35.804712 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054caefa-97ab-4f32-b846-b0b1c2318732 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:35.806346 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-054caefa-97ab-4f32-b846-b0b1c2318732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:35.822094 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054caefa-97ab-4f32-b846-b0b1c2318732 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:35.828623 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b391f-b688-438f-bc57-027169d4521b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:35.829538 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b391f-b688-438f-bc57-027169d4521b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:35.829871 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b391f-b688-438f-bc57-027169d4521b admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:35.830733 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b391f-b688-438f-bc57-027169d4521b admin admin] PATH_INFO: `/v3/projects/9e702d5922524b778626801c54baf0b3` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:35.831862 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760b391f-b688-438f-bc57-027169d4521b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e702d5922524b778626801c54baf0b3)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:35.833848 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760b391f-b688-438f-bc57-027169d4521b admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:35.882923 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-760b391f-b688-438f-bc57-027169d4521b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e702d5922524b778626801c54baf0b3', 'request_id': 'req-760b391f-b688-438f-bc57-027169d4521b'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:35.892015 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-760b391f-b688-438f-bc57-027169d4521b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e702d5922524b778626801c54baf0b3', 'request_id': 'req-760b391f-b688-438f-bc57-027169d4521b'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:35.897734 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-760b391f-b688-438f-bc57-027169d4521b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e702d5922524b778626801c54baf0b3', 'request_id': 'req-760b391f-b688-438f-bc57-027169d4521b'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:35.909074 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-760b391f-b688-438f-bc57-027169d4521b admin admin] The token cache is being invalidate because project 9e702d5922524b778626801c54baf0b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80150) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:39:35.909359 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-760b391f-b688-438f-bc57-027169d4521b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:35.910016 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-760b391f-b688-438f-bc57-027169d4521b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:35.911550 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1074/2148] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:39:35 2022] DELETE /identity/v3/projects/9e702d5922524b778626801c54baf0b3 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:39:35.915664 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78930b87-fb3c-472a-9502-396b1eca8317 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:35.925949 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78930b87-fb3c-472a-9502-396b1eca8317 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:35.986655 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd34cee3-97c9-49c9-8079-bc4f43569df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:35.987528 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34cee3-97c9-49c9-8079-bc4f43569df5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:35.987805 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34cee3-97c9-49c9-8079-bc4f43569df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:35.988075 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34cee3-97c9-49c9-8079-bc4f43569df5 admin admin] PATH_INFO: `/v3/users/d35fb74f455b49dd8c347d34af17f475` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:35.989295 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd34cee3-97c9-49c9-8079-bc4f43569df5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d35fb74f455b49dd8c347d34af17f475)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:35.991272 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd34cee3-97c9-49c9-8079-bc4f43569df5 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:36.043213 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-cd34cee3-97c9-49c9-8079-bc4f43569df5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd35fb74f455b49dd8c347d34af17f475'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:36.043973 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-cd34cee3-97c9-49c9-8079-bc4f43569df5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd35fb74f455b49dd8c347d34af17f475'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:36.051085 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-cd34cee3-97c9-49c9-8079-bc4f43569df5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd35fb74f455b49dd8c347d34af17f475'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:36.056148 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:36.065772 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-cd34cee3-97c9-49c9-8079-bc4f43569df5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd35fb74f455b49dd8c347d34af17f475'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:36.074580 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-cd34cee3-97c9-49c9-8079-bc4f43569df5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd35fb74f455b49dd8c347d34af17f475'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:36.082498 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1075/2149] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:39:35 2022] DELETE /identity/v3/users/d35fb74f455b49dd8c347d34af17f475 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:39:36.264951 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57350e31-cfe0-4f3e-aa8b-f41d56891743 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:36.265240 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57350e31-cfe0-4f3e-aa8b-f41d56891743 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:36.265514 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57350e31-cfe0-4f3e-aa8b-f41d56891743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:36.293079 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-57350e31-cfe0-4f3e-aa8b-f41d56891743 None None] MFA Rules not processed for user `b73d09bd7c1e4753a45cfdb00cc5abe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:36.294356 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-57350e31-cfe0-4f3e-aa8b-f41d56891743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:36.318507 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:36.372453 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1075/2150] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Jul 15 17:39:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:39:36.422075 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd34cee3-97c9-49c9-8079-bc4f43569df5 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:36.423836 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-cd34cee3-97c9-49c9-8079-bc4f43569df5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:36.453043 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57350e31-cfe0-4f3e-aa8b-f41d56891743 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:36.455080 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-57350e31-cfe0-4f3e-aa8b-f41d56891743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:36.506938 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd34cee3-97c9-49c9-8079-bc4f43569df5 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:36.512981 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c532f908-b91b-4717-bd69-51202f772e6a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dea565b75784465a8ea073883261d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:36.513739 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532f908-b91b-4717-bd69-51202f772e6a service swift] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:36.514141 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532f908-b91b-4717-bd69-51202f772e6a service swift] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:36.514536 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532f908-b91b-4717-bd69-51202f772e6a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:36.524240 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c532f908-b91b-4717-bd69-51202f772e6a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:36.525980 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c532f908-b91b-4717-bd69-51202f772e6a service swift] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:36.537844 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1076/2151] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Jul 15 17:39:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 17:39:36.560396 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57350e31-cfe0-4f3e-aa8b-f41d56891743 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:36.565386 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2baae16-4e4d-43ec-a38a-7400ca8e0c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:36.574716 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2baae16-4e4d-43ec-a38a-7400ca8e0c9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:36.575003 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2baae16-4e4d-43ec-a38a-7400ca8e0c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:36.575281 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2baae16-4e4d-43ec-a38a-7400ca8e0c9a admin admin] PATH_INFO: `/v3/projects/b27613930fc64777b7af87b68f4d59e5` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:36.576980 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2baae16-4e4d-43ec-a38a-7400ca8e0c9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b27613930fc64777b7af87b68f4d59e5)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:36.578994 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2baae16-4e4d-43ec-a38a-7400ca8e0c9a admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:36.659232 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-d2baae16-4e4d-43ec-a38a-7400ca8e0c9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b27613930fc64777b7af87b68f4d59e5', 'request_id': 'req-d2baae16-4e4d-43ec-a38a-7400ca8e0c9a'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:36.668592 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-d2baae16-4e4d-43ec-a38a-7400ca8e0c9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b27613930fc64777b7af87b68f4d59e5', 'request_id': 'req-d2baae16-4e4d-43ec-a38a-7400ca8e0c9a'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:36.676335 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-d2baae16-4e4d-43ec-a38a-7400ca8e0c9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b27613930fc64777b7af87b68f4d59e5', 'request_id': 'req-d2baae16-4e4d-43ec-a38a-7400ca8e0c9a'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:36.689147 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-d2baae16-4e4d-43ec-a38a-7400ca8e0c9a admin admin] The token cache is being invalidate because project b27613930fc64777b7af87b68f4d59e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80150) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:39:36.689745 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-d2baae16-4e4d-43ec-a38a-7400ca8e0c9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:36.690819 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-d2baae16-4e4d-43ec-a38a-7400ca8e0c9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:36.692935 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1076/2152] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:39:36 2022] DELETE /identity/v3/projects/b27613930fc64777b7af87b68f4d59e5 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:39:36.697715 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0629db-b23b-4d39-b7e7-bcd7b29bb4c0 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:36.698170 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0629db-b23b-4d39-b7e7-bcd7b29bb4c0 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:36.698794 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0629db-b23b-4d39-b7e7-bcd7b29bb4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:36.724348 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-be0629db-b23b-4d39-b7e7-bcd7b29bb4c0 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:36.725668 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-be0629db-b23b-4d39-b7e7-bcd7b29bb4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:36.796099 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1077/2153] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:39:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:39:36.798074 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073a4f5-d2b2-4423-8f70-3cc6cf2eca5c None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:36.798494 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073a4f5-d2b2-4423-8f70-3cc6cf2eca5c None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:36.798994 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073a4f5-d2b2-4423-8f70-3cc6cf2eca5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:36.821077 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-f073a4f5-d2b2-4423-8f70-3cc6cf2eca5c None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:36.822442 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-f073a4f5-d2b2-4423-8f70-3cc6cf2eca5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:36.838170 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1077/2154] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:39:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:39:36.840269 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0629db-b23b-4d39-b7e7-bcd7b29bb4c0 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:36.851936 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0629db-b23b-4d39-b7e7-bcd7b29bb4c0 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:36.857080 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c33132-780c-4c5d-bf95-b8af4fbf5513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:36.857974 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c33132-780c-4c5d-bf95-b8af4fbf5513 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:36.858727 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c33132-780c-4c5d-bf95-b8af4fbf5513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:36.858971 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c33132-780c-4c5d-bf95-b8af4fbf5513 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:36.859913 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c33132-780c-4c5d-bf95-b8af4fbf5513 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:39:36.860555 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c33132-780c-4c5d-bf95-b8af4fbf5513 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:36.862574 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c33132-780c-4c5d-bf95-b8af4fbf5513 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:36.880610 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1078/2155] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:39:36.885575 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f073a4f5-d2b2-4423-8f70-3cc6cf2eca5c None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:36.897494 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f073a4f5-d2b2-4423-8f70-3cc6cf2eca5c None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:36.912323 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f530c72-82f6-45a1-bc18-1d696af373ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:36.913766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f530c72-82f6-45a1-bc18-1d696af373ca admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:36.914122 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f530c72-82f6-45a1-bc18-1d696af373ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:36.914609 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f530c72-82f6-45a1-bc18-1d696af373ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:36.915609 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f530c72-82f6-45a1-bc18-1d696af373ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:36.917429 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f530c72-82f6-45a1-bc18-1d696af373ca admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:36.964303 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1078/2156] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:39:36 2022] POST /identity/v3/projects => generated 373 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:39:36.964811 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c33132-780c-4c5d-bf95-b8af4fbf5513 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:36.982572 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c33132-780c-4c5d-bf95-b8af4fbf5513 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:37.050056 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:37.059914 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114cc0b-f1ff-413e-bcc6-7b941a5268ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:37.060996 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114cc0b-f1ff-413e-bcc6-7b941a5268ed admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:37.061391 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114cc0b-f1ff-413e-bcc6-7b941a5268ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:37.061663 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114cc0b-f1ff-413e-bcc6-7b941a5268ed admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:37.063060 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7114cc0b-f1ff-413e-bcc6-7b941a5268ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:37.065540 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7114cc0b-f1ff-413e-bcc6-7b941a5268ed admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:37.091356 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1079/2157] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:39:36 2022] POST /identity/v3/users => generated 287 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 17:39:37.096338 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f530c72-82f6-45a1-bc18-1d696af373ca admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:37.119444 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f530c72-82f6-45a1-bc18-1d696af373ca admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:37.128011 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa0cf38-a1d8-48a0-979e-6852982f5a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:37.128807 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0cf38-a1d8-48a0-979e-6852982f5a82 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:37.129241 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0cf38-a1d8-48a0-979e-6852982f5a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:37.129349 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0cf38-a1d8-48a0-979e-6852982f5a82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:37.130614 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa0cf38-a1d8-48a0-979e-6852982f5a82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:37.132745 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa0cf38-a1d8-48a0-979e-6852982f5a82 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:37.145242 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1079/2158] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:39:37.149634 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114cc0b-f1ff-413e-bcc6-7b941a5268ed admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:37.181420 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114cc0b-f1ff-413e-bcc6-7b941a5268ed admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:37.209077 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33380611-3a6c-4af6-b804-b2967062ae68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:37.209899 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33380611-3a6c-4af6-b804-b2967062ae68 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:37.210225 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33380611-3a6c-4af6-b804-b2967062ae68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:37.210657 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33380611-3a6c-4af6-b804-b2967062ae68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:37.211412 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33380611-3a6c-4af6-b804-b2967062ae68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:37.213105 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33380611-3a6c-4af6-b804-b2967062ae68 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:37.235808 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1080/2159] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:39:37.236641 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa0cf38-a1d8-48a0-979e-6852982f5a82 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:37.247963 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa0cf38-a1d8-48a0-979e-6852982f5a82 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:37.252874 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8260e6b3-1c3a-462c-b6cf-7568aeac8927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:37.253814 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260e6b3-1c3a-462c-b6cf-7568aeac8927 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:37.254234 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260e6b3-1c3a-462c-b6cf-7568aeac8927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:37.254513 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260e6b3-1c3a-462c-b6cf-7568aeac8927 admin admin] PATH_INFO: `/v3/projects/acec926bea7f418fb816c45bb17deb90/users/258d160ddf8d499f977dd075b1c211e9/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:37.280074 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:37.289525 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8260e6b3-1c3a-462c-b6cf-7568aeac8927 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acec926bea7f418fb816c45bb17deb90, user_id=258d160ddf8d499f977dd075b1c211e9, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:37.292600 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8260e6b3-1c3a-462c-b6cf-7568aeac8927 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:37.350335 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1080/2160] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:39:37 2022] PUT /identity/v3/projects/acec926bea7f418fb816c45bb17deb90/users/258d160ddf8d499f977dd075b1c211e9/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:39:37.353737 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366b255-4bf4-4322-ae13-2b5fa91c3d53 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:37.354881 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366b255-4bf4-4322-ae13-2b5fa91c3d53 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:37.355375 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366b255-4bf4-4322-ae13-2b5fa91c3d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:37.388026 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-2366b255-4bf4-4322-ae13-2b5fa91c3d53 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:37.389457 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-2366b255-4bf4-4322-ae13-2b5fa91c3d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:37.490991 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1081/2161] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:39:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:39:37.501061 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8260e6b3-1c3a-462c-b6cf-7568aeac8927 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:37.503528 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-8260e6b3-1c3a-462c-b6cf-7568aeac8927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:37.601574 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8260e6b3-1c3a-462c-b6cf-7568aeac8927 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:37.607090 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28029480-3eea-4e10-8d15-14258329398a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:37.607993 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28029480-3eea-4e10-8d15-14258329398a service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:37.608348 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28029480-3eea-4e10-8d15-14258329398a service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:37.608686 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28029480-3eea-4e10-8d15-14258329398a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:37.622837 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28029480-3eea-4e10-8d15-14258329398a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:37.624628 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28029480-3eea-4e10-8d15-14258329398a service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:37.639581 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1081/2162] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:39:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:39:38.604845 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309a349-1c43-4d52-9098-7bebb4e18ee7 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:38.605643 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309a349-1c43-4d52-9098-7bebb4e18ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:38.606034 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309a349-1c43-4d52-9098-7bebb4e18ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:38.674796 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-1309a349-1c43-4d52-9098-7bebb4e18ee7 None None] MFA Rules not processed for user `258d160ddf8d499f977dd075b1c211e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:38.677363 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1309a349-1c43-4d52-9098-7bebb4e18ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:38.896533 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1082/2163] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:39:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:39:38.901057 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28029480-3eea-4e10-8d15-14258329398a service neutron] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:38.911238 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28029480-3eea-4e10-8d15-14258329398a service neutron] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:38.926568 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5495de5-e09a-435b-af62-56629562f585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:38.927349 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5495de5-e09a-435b-af62-56629562f585 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:38.928651 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5495de5-e09a-435b-af62-56629562f585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:38.929750 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5495de5-e09a-435b-af62-56629562f585 admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:38.930742 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5495de5-e09a-435b-af62-56629562f585 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:38.934585 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5495de5-e09a-435b-af62-56629562f585 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:38.983571 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1082/2164] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:39:38 2022] POST /identity/v3/projects => generated 373 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:39:38.984177 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1309a349-1c43-4d52-9098-7bebb4e18ee7 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:38.996773 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1309a349-1c43-4d52-9098-7bebb4e18ee7 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:39.064630 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96a2cd-6b14-45a7-8b59-433a701f5fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:39.065810 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96a2cd-6b14-45a7-8b59-433a701f5fdf admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:39.066325 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96a2cd-6b14-45a7-8b59-433a701f5fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:39.066658 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96a2cd-6b14-45a7-8b59-433a701f5fdf admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:39.067438 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b96a2cd-6b14-45a7-8b59-433a701f5fdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:39.069910 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b96a2cd-6b14-45a7-8b59-433a701f5fdf admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:39.081300 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:39.094812 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1083/2165] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:39:38 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 17:39:39.098964 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5495de5-e09a-435b-af62-56629562f585 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:39.110778 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5495de5-e09a-435b-af62-56629562f585 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:39.115823 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a735f-d2a4-4354-943c-7d919f5d29ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:39.116648 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a735f-d2a4-4354-943c-7d919f5d29ef admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:39.117015 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a735f-d2a4-4354-943c-7d919f5d29ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:39.117390 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a735f-d2a4-4354-943c-7d919f5d29ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:39.118263 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a735f-d2a4-4354-943c-7d919f5d29ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:39.120029 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a735f-d2a4-4354-943c-7d919f5d29ef admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:39.132056 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1083/2166] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:39:39.137449 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96a2cd-6b14-45a7-8b59-433a701f5fdf admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:39.151726 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96a2cd-6b14-45a7-8b59-433a701f5fdf admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:39.157705 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e4d9b-a8a0-4a1f-a818-7070853d911f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:39.158687 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e4d9b-a8a0-4a1f-a818-7070853d911f admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:39.159119 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e4d9b-a8a0-4a1f-a818-7070853d911f admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:39.159440 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e4d9b-a8a0-4a1f-a818-7070853d911f admin admin] PATH_INFO: `/v3/projects/d359bf1b89b849ebb5744fa84b06e11f/users/2e4424f05bd24fe1920380e1de6e86cc/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:39.178478 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e4d9b-a8a0-4a1f-a818-7070853d911f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d359bf1b89b849ebb5744fa84b06e11f, user_id=2e4424f05bd24fe1920380e1de6e86cc, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:39.181446 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e4d9b-a8a0-4a1f-a818-7070853d911f admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:39.198648 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1084/2167] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:39:39 2022] PUT /identity/v3/projects/d359bf1b89b849ebb5744fa84b06e11f/users/2e4424f05bd24fe1920380e1de6e86cc/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:39:39.202861 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a735f-d2a4-4354-943c-7d919f5d29ef admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:39.215917 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a735f-d2a4-4354-943c-7d919f5d29ef admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:39.294595 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac18f2-bb0b-457a-89d8-0d7e0f42522f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:39.295567 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac18f2-bb0b-457a-89d8-0d7e0f42522f admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:39.295870 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac18f2-bb0b-457a-89d8-0d7e0f42522f admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:39.296140 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac18f2-bb0b-457a-89d8-0d7e0f42522f admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:39.296919 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac18f2-bb0b-457a-89d8-0d7e0f42522f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:39.298659 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac18f2-bb0b-457a-89d8-0d7e0f42522f admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:39.314206 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1084/2168] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:39:39.318887 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e4d9b-a8a0-4a1f-a818-7070853d911f admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:39.332312 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e4d9b-a8a0-4a1f-a818-7070853d911f admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:39.337163 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7249a6-de37-4020-8871-8393c0091e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:39.338151 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7249a6-de37-4020-8871-8393c0091e9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:39.338454 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7249a6-de37-4020-8871-8393c0091e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:39.338715 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7249a6-de37-4020-8871-8393c0091e9d admin admin] PATH_INFO: `/v3/projects/d359bf1b89b849ebb5744fa84b06e11f/users/2e4424f05bd24fe1920380e1de6e86cc/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:39.341049 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7249a6-de37-4020-8871-8393c0091e9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d359bf1b89b849ebb5744fa84b06e11f, user_id=2e4424f05bd24fe1920380e1de6e86cc, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:39.343839 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7249a6-de37-4020-8871-8393c0091e9d admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:39.356739 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1085/2169] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:39:39 2022] PUT /identity/v3/projects/d359bf1b89b849ebb5744fa84b06e11f/users/2e4424f05bd24fe1920380e1de6e86cc/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:39:40.388923 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738117e7-a854-4a86-b6b1-fabece57d559 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:40.389904 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738117e7-a854-4a86-b6b1-fabece57d559 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:40.390425 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738117e7-a854-4a86-b6b1-fabece57d559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:40.424449 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-738117e7-a854-4a86-b6b1-fabece57d559 None None] MFA Rules not processed for user `2e4424f05bd24fe1920380e1de6e86cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:40.425743 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-738117e7-a854-4a86-b6b1-fabece57d559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:40.525996 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:40.594794 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1085/2170] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:39:40 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:39:40.607993 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a733f37-465d-4596-b27d-3d18d57afe62 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:40.608577 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a733f37-465d-4596-b27d-3d18d57afe62 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:40.608971 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a733f37-465d-4596-b27d-3d18d57afe62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:40.632068 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-5a733f37-465d-4596-b27d-3d18d57afe62 None None] MFA Rules not processed for user `258d160ddf8d499f977dd075b1c211e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:40.633043 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5a733f37-465d-4596-b27d-3d18d57afe62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:40.712949 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1086/2171] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:39:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:39:40.724530 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738117e7-a854-4a86-b6b1-fabece57d559 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:40.727038 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-738117e7-a854-4a86-b6b1-fabece57d559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:40.835609 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738117e7-a854-4a86-b6b1-fabece57d559 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:40.845568 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e8185e-b810-414d-9d8b-61930d5bc5f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:40.846563 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8185e-b810-414d-9d8b-61930d5bc5f3 service nova] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:40.847155 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8185e-b810-414d-9d8b-61930d5bc5f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:40.847480 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8185e-b810-414d-9d8b-61930d5bc5f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:40.857980 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e8185e-b810-414d-9d8b-61930d5bc5f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:40.860629 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e8185e-b810-414d-9d8b-61930d5bc5f3 service nova] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:40.874940 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1086/2172] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:39:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:39:42.440286 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a733f37-465d-4596-b27d-3d18d57afe62 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:42.442641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5a733f37-465d-4596-b27d-3d18d57afe62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:42.598097 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a733f37-465d-4596-b27d-3d18d57afe62 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:42.609577 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d6efd-89ff-4c19-b9f9-4357b6cfbf98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:42.610262 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d6efd-89ff-4c19-b9f9-4357b6cfbf98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:42.610738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d6efd-89ff-4c19-b9f9-4357b6cfbf98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:42.611301 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d6efd-89ff-4c19-b9f9-4357b6cfbf98 admin admin] PATH_INFO: `/v3/users/d94efa1cd4a64ca59ac1934920c2a9bf` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:42.613159 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d6efd-89ff-4c19-b9f9-4357b6cfbf98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d94efa1cd4a64ca59ac1934920c2a9bf)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:42.616446 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d6efd-89ff-4c19-b9f9-4357b6cfbf98 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:42.695511 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-ad4d6efd-89ff-4c19-b9f9-4357b6cfbf98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd94efa1cd4a64ca59ac1934920c2a9bf'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:42.696228 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-ad4d6efd-89ff-4c19-b9f9-4357b6cfbf98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd94efa1cd4a64ca59ac1934920c2a9bf'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:42.717370 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-ad4d6efd-89ff-4c19-b9f9-4357b6cfbf98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd94efa1cd4a64ca59ac1934920c2a9bf'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:42.741463 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:42.758371 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-ad4d6efd-89ff-4c19-b9f9-4357b6cfbf98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd94efa1cd4a64ca59ac1934920c2a9bf'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:42.774763 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-ad4d6efd-89ff-4c19-b9f9-4357b6cfbf98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd94efa1cd4a64ca59ac1934920c2a9bf'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:42.784709 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1087/2173] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:39:42 2022] DELETE /identity/v3/users/d94efa1cd4a64ca59ac1934920c2a9bf => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:39:42.791014 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d2641-26ae-417a-a646-a5ee91fddb7e None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:42.791524 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d2641-26ae-417a-a646-a5ee91fddb7e None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:42.791853 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d2641-26ae-417a-a646-a5ee91fddb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:42.818539 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-885d2641-26ae-417a-a646-a5ee91fddb7e None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:42.820426 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-885d2641-26ae-417a-a646-a5ee91fddb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:42.964970 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1087/2174] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:39:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:39:42.991082 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d6efd-89ff-4c19-b9f9-4357b6cfbf98 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:42.994563 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ad4d6efd-89ff-4c19-b9f9-4357b6cfbf98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:43.121926 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d6efd-89ff-4c19-b9f9-4357b6cfbf98 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:43.125519 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a5590-0333-49c7-b15b-3c275d2b0a73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:43.126204 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a5590-0333-49c7-b15b-3c275d2b0a73 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:43.126484 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a5590-0333-49c7-b15b-3c275d2b0a73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:43.126770 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a5590-0333-49c7-b15b-3c275d2b0a73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:43.150117 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a5590-0333-49c7-b15b-3c275d2b0a73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:43.151693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a5590-0333-49c7-b15b-3c275d2b0a73 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:43.174971 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1088/2175] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:39:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:39:44.242517 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d2641-26ae-417a-a646-a5ee91fddb7e None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:44.244080 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-885d2641-26ae-417a-a646-a5ee91fddb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:44.261166 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d2641-26ae-417a-a646-a5ee91fddb7e None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:44.277060 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac02ef6-7739-4c3e-a362-42d721f967a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:44.278020 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac02ef6-7739-4c3e-a362-42d721f967a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:44.278289 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac02ef6-7739-4c3e-a362-42d721f967a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:44.278729 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac02ef6-7739-4c3e-a362-42d721f967a9 admin admin] PATH_INFO: `/v3/projects/bcf7866e97464673bed0259d10430ded` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:44.280000 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac02ef6-7739-4c3e-a362-42d721f967a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcf7866e97464673bed0259d10430ded)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:44.289241 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac02ef6-7739-4c3e-a362-42d721f967a9 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:44.399892 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-8ac02ef6-7739-4c3e-a362-42d721f967a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcf7866e97464673bed0259d10430ded', 'request_id': 'req-8ac02ef6-7739-4c3e-a362-42d721f967a9'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:44.421412 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-8ac02ef6-7739-4c3e-a362-42d721f967a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcf7866e97464673bed0259d10430ded', 'request_id': 'req-8ac02ef6-7739-4c3e-a362-42d721f967a9'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:44.436484 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:44.440790 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-8ac02ef6-7739-4c3e-a362-42d721f967a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcf7866e97464673bed0259d10430ded', 'request_id': 'req-8ac02ef6-7739-4c3e-a362-42d721f967a9'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:44.485772 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-8ac02ef6-7739-4c3e-a362-42d721f967a9 admin admin] The token cache is being invalidate because project bcf7866e97464673bed0259d10430ded was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80150) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:39:44.486369 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-8ac02ef6-7739-4c3e-a362-42d721f967a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:44.487602 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-8ac02ef6-7739-4c3e-a362-42d721f967a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:44.493277 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1088/2176] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:39:44 2022] DELETE /identity/v3/projects/bcf7866e97464673bed0259d10430ded => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:39:44.494886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c651f-5e9d-48fb-8b09-fa995d4d3770 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:44.495729 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c651f-5e9d-48fb-8b09-fa995d4d3770 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:44.496158 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c651f-5e9d-48fb-8b09-fa995d4d3770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:44.530105 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-582c651f-5e9d-48fb-8b09-fa995d4d3770 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:44.531913 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-582c651f-5e9d-48fb-8b09-fa995d4d3770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:44.755485 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b02d2-fc4d-41c4-abaf-224ade3919bf None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:44.755798 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b02d2-fc4d-41c4-abaf-224ade3919bf None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:44.756187 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b02d2-fc4d-41c4-abaf-224ade3919bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:44.773045 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1089/2177] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:39:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:39:44.800253 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-f40b02d2-fc4d-41c4-abaf-224ade3919bf None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:44.803125 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-f40b02d2-fc4d-41c4-abaf-224ade3919bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:44.834583 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1089/2178] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:39:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:39:44.847299 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c651f-5e9d-48fb-8b09-fa995d4d3770 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:44.868257 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c651f-5e9d-48fb-8b09-fa995d4d3770 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:44.874861 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0081a6a0-0878-4756-b999-02b384ce1c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:44.875757 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081a6a0-0878-4756-b999-02b384ce1c4b admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:44.876138 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081a6a0-0878-4756-b999-02b384ce1c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:44.876519 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081a6a0-0878-4756-b999-02b384ce1c4b admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:44.877475 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0081a6a0-0878-4756-b999-02b384ce1c4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:39:44.878123 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0081a6a0-0878-4756-b999-02b384ce1c4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:44.880975 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0081a6a0-0878-4756-b999-02b384ce1c4b admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:44.905758 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1090/2179] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:39:44.907153 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b02d2-fc4d-41c4-abaf-224ade3919bf None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:44.917606 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b02d2-fc4d-41c4-abaf-224ade3919bf None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:44.926362 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c26f9-a31c-41db-ba8d-509d413d381a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:44.927186 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c26f9-a31c-41db-ba8d-509d413d381a admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:44.927568 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c26f9-a31c-41db-ba8d-509d413d381a admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:44.927932 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c26f9-a31c-41db-ba8d-509d413d381a admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:44.928741 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c26f9-a31c-41db-ba8d-509d413d381a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:44.930808 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c26f9-a31c-41db-ba8d-509d413d381a admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:44.969526 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1090/2180] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:39:44 2022] POST /identity/v3/projects => generated 363 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:39:44.971862 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0081a6a0-0878-4756-b999-02b384ce1c4b admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:45.001853 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0081a6a0-0878-4756-b999-02b384ce1c4b admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:45.124218 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c08aee-6c6c-4544-8a9a-05a77d24d590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:45.126382 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c08aee-6c6c-4544-8a9a-05a77d24d590 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:45.127016 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c08aee-6c6c-4544-8a9a-05a77d24d590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:45.127647 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c08aee-6c6c-4544-8a9a-05a77d24d590 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:45.128921 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c08aee-6c6c-4544-8a9a-05a77d24d590 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:45.131449 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c08aee-6c6c-4544-8a9a-05a77d24d590 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:45.163473 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1091/2181] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:39:44 2022] POST /identity/v3/users => generated 282 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:39:45.167727 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c26f9-a31c-41db-ba8d-509d413d381a admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:45.190219 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c26f9-a31c-41db-ba8d-509d413d381a admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:45.195770 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211b218-7cfa-4850-bcce-6251e9a8f0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:45.198726 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211b218-7cfa-4850-bcce-6251e9a8f0be admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:45.198726 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211b218-7cfa-4850-bcce-6251e9a8f0be admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:45.198726 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211b218-7cfa-4850-bcce-6251e9a8f0be admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:45.198726 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211b218-7cfa-4850-bcce-6251e9a8f0be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:45.209387 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211b218-7cfa-4850-bcce-6251e9a8f0be admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:45.225638 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1091/2182] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:39:45.230515 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c08aee-6c6c-4544-8a9a-05a77d24d590 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:45.236685 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:45.248106 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c08aee-6c6c-4544-8a9a-05a77d24d590 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:45.261309 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8edb992-8040-4379-bc4c-eb318fc82d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:45.262067 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8edb992-8040-4379-bc4c-eb318fc82d4a admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:45.262992 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8edb992-8040-4379-bc4c-eb318fc82d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:45.263279 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8edb992-8040-4379-bc4c-eb318fc82d4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:45.264030 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8edb992-8040-4379-bc4c-eb318fc82d4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:45.265978 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8edb992-8040-4379-bc4c-eb318fc82d4a admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:45.279347 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1092/2183] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:39:45.287789 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211b218-7cfa-4850-bcce-6251e9a8f0be admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:45.301717 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211b218-7cfa-4850-bcce-6251e9a8f0be admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:45.319587 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043b5d8-17f4-4699-ad06-c643df871208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:45.320535 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043b5d8-17f4-4699-ad06-c643df871208 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:45.320819 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043b5d8-17f4-4699-ad06-c643df871208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:45.321090 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043b5d8-17f4-4699-ad06-c643df871208 admin admin] PATH_INFO: `/v3/projects/246c9296fad34fe6b1706e6a759c4efc/users/ec4f197e2f35425785491d587de57161/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:45.341000 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e043b5d8-17f4-4699-ad06-c643df871208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=246c9296fad34fe6b1706e6a759c4efc, user_id=ec4f197e2f35425785491d587de57161, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:45.345598 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e043b5d8-17f4-4699-ad06-c643df871208 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:45.373112 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1092/2184] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:39:45 2022] PUT /identity/v3/projects/246c9296fad34fe6b1706e6a759c4efc/users/ec4f197e2f35425785491d587de57161/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:39:45.375052 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875b2a7-d053-47eb-9a8c-8c17df8cb92a None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:45.375522 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875b2a7-d053-47eb-9a8c-8c17df8cb92a None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:45.375801 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875b2a7-d053-47eb-9a8c-8c17df8cb92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:45.407945 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-b875b2a7-d053-47eb-9a8c-8c17df8cb92a None None] MFA Rules not processed for user `ec4f197e2f35425785491d587de57161`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:45.409851 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b875b2a7-d053-47eb-9a8c-8c17df8cb92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:45.510579 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1093/2185] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:39:45 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:39:45.520342 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043b5d8-17f4-4699-ad06-c643df871208 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:45.522620 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-e043b5d8-17f4-4699-ad06-c643df871208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:45.653563 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043b5d8-17f4-4699-ad06-c643df871208 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:45.664981 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6cdb02-659b-4dd8-bed4-4e7b0d648d33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:45.665672 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6cdb02-659b-4dd8-bed4-4e7b0d648d33 service cinder] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:45.666046 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6cdb02-659b-4dd8-bed4-4e7b0d648d33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:45.666407 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6cdb02-659b-4dd8-bed4-4e7b0d648d33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:45.682841 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6cdb02-659b-4dd8-bed4-4e7b0d648d33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:45.685419 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6cdb02-659b-4dd8-bed4-4e7b0d648d33 service cinder] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:45.697619 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1093/2186] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:39:45 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:39:51.623906 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b875b2a7-d053-47eb-9a8c-8c17df8cb92a None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:51.625380 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b875b2a7-d053-47eb-9a8c-8c17df8cb92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:51.712194 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b875b2a7-d053-47eb-9a8c-8c17df8cb92a None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:51.718912 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073be6f-d013-4768-b671-9dc246787e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:51.719848 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073be6f-d013-4768-b671-9dc246787e46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:51.720120 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073be6f-d013-4768-b671-9dc246787e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:51.720392 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073be6f-d013-4768-b671-9dc246787e46 admin admin] PATH_INFO: `/v3/users/515dc0eed4bb4ef584a6e09e6ef697a4` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:51.721651 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8073be6f-d013-4768-b671-9dc246787e46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=515dc0eed4bb4ef584a6e09e6ef697a4)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:51.723785 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8073be6f-d013-4768-b671-9dc246787e46 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:51.853519 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-8073be6f-d013-4768-b671-9dc246787e46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '515dc0eed4bb4ef584a6e09e6ef697a4'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:51.854254 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-8073be6f-d013-4768-b671-9dc246787e46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '515dc0eed4bb4ef584a6e09e6ef697a4'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:51.884774 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-8073be6f-d013-4768-b671-9dc246787e46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '515dc0eed4bb4ef584a6e09e6ef697a4'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:51.902907 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-8073be6f-d013-4768-b671-9dc246787e46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '515dc0eed4bb4ef584a6e09e6ef697a4'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:51.956659 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-8073be6f-d013-4768-b671-9dc246787e46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '515dc0eed4bb4ef584a6e09e6ef697a4'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:51.960276 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:51.969928 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1094/2187] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:39:51 2022] DELETE /identity/v3/users/515dc0eed4bb4ef584a6e09e6ef697a4 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:39:51.972144 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6728e33-399c-4040-b156-864d2b8afe3c None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:51.973044 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6728e33-399c-4040-b156-864d2b8afe3c None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:51.973579 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6728e33-399c-4040-b156-864d2b8afe3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:51.993670 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-d6728e33-399c-4040-b156-864d2b8afe3c None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:51.995074 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-d6728e33-399c-4040-b156-864d2b8afe3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:52.119248 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1094/2188] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:39:52.130338 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073be6f-d013-4768-b671-9dc246787e46 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:52.133150 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8073be6f-d013-4768-b671-9dc246787e46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:52.215449 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073be6f-d013-4768-b671-9dc246787e46 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:52.219261 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a7afd3-1127-4f4c-9e1f-a3471a2288ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:52.219919 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7afd3-1127-4f4c-9e1f-a3471a2288ba service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:52.220186 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7afd3-1127-4f4c-9e1f-a3471a2288ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:52.220466 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7afd3-1127-4f4c-9e1f-a3471a2288ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:52.233238 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a7afd3-1127-4f4c-9e1f-a3471a2288ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:52.234726 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a7afd3-1127-4f4c-9e1f-a3471a2288ba service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:52.247543 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1095/2189] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:39:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:39:52.588211 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6728e33-399c-4040-b156-864d2b8afe3c None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:52.589970 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-d6728e33-399c-4040-b156-864d2b8afe3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:52.603474 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6728e33-399c-4040-b156-864d2b8afe3c None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:52.610251 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a7f4fe-50c6-4005-a638-14989a345f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:52.611386 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7f4fe-50c6-4005-a638-14989a345f14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:52.611837 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7f4fe-50c6-4005-a638-14989a345f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:52.612263 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7f4fe-50c6-4005-a638-14989a345f14 admin admin] PATH_INFO: `/v3/projects/4bd7fa0c1b0949bdb2a69038299df39c` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:52.614291 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a7f4fe-50c6-4005-a638-14989a345f14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bd7fa0c1b0949bdb2a69038299df39c)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:52.616489 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a7f4fe-50c6-4005-a638-14989a345f14 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:52.679159 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:52.707300 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-84a7f4fe-50c6-4005-a638-14989a345f14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bd7fa0c1b0949bdb2a69038299df39c', 'request_id': 'req-84a7f4fe-50c6-4005-a638-14989a345f14'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:52.719438 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-84a7f4fe-50c6-4005-a638-14989a345f14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bd7fa0c1b0949bdb2a69038299df39c', 'request_id': 'req-84a7f4fe-50c6-4005-a638-14989a345f14'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:52.737564 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-84a7f4fe-50c6-4005-a638-14989a345f14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bd7fa0c1b0949bdb2a69038299df39c', 'request_id': 'req-84a7f4fe-50c6-4005-a638-14989a345f14'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:52.751451 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-84a7f4fe-50c6-4005-a638-14989a345f14 admin admin] The token cache is being invalidate because project 4bd7fa0c1b0949bdb2a69038299df39c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80150) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:39:52.752047 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-84a7f4fe-50c6-4005-a638-14989a345f14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:52.752780 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-84a7f4fe-50c6-4005-a638-14989a345f14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:52.754865 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1095/2190] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:39:52 2022] DELETE /identity/v3/projects/4bd7fa0c1b0949bdb2a69038299df39c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:39:52.759867 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cc89b-89fb-4726-ac11-cf8aadf00f4e None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:52.760887 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cc89b-89fb-4726-ac11-cf8aadf00f4e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:52.761387 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cc89b-89fb-4726-ac11-cf8aadf00f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:52.786406 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-1b4cc89b-89fb-4726-ac11-cf8aadf00f4e None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:52.788199 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1b4cc89b-89fb-4726-ac11-cf8aadf00f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:52.886313 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1096/2191] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:39:52.898292 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f18ab-81ac-47fd-8e5f-30e839832d5f None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:52.898692 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f18ab-81ac-47fd-8e5f-30e839832d5f None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:52.898868 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f18ab-81ac-47fd-8e5f-30e839832d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:52.922996 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-e35f18ab-81ac-47fd-8e5f-30e839832d5f None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:52.924362 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-e35f18ab-81ac-47fd-8e5f-30e839832d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:52.937704 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1096/2192] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:39:52.941478 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4cc89b-89fb-4726-ac11-cf8aadf00f4e None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:52.955110 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4cc89b-89fb-4726-ac11-cf8aadf00f4e None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:52.966116 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5517903-bcd6-4fdc-b189-21658bb52144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:52.966765 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5517903-bcd6-4fdc-b189-21658bb52144 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:52.967141 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5517903-bcd6-4fdc-b189-21658bb52144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:52.967550 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5517903-bcd6-4fdc-b189-21658bb52144 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:52.968558 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5517903-bcd6-4fdc-b189-21658bb52144 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:39:52.968921 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5517903-bcd6-4fdc-b189-21658bb52144 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:52.970647 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5517903-bcd6-4fdc-b189-21658bb52144 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:52.989905 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1097/2193] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:39:52.991103 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f18ab-81ac-47fd-8e5f-30e839832d5f None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:53.001253 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f18ab-81ac-47fd-8e5f-30e839832d5f None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:53.006537 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685235be-4136-4692-a52b-a762ff400173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:53.007218 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685235be-4136-4692-a52b-a762ff400173 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:53.007501 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685235be-4136-4692-a52b-a762ff400173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:53.007775 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685235be-4136-4692-a52b-a762ff400173 admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:53.008478 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685235be-4136-4692-a52b-a762ff400173 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:53.010594 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685235be-4136-4692-a52b-a762ff400173 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:53.047347 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1097/2194] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:39:52 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 17:39:53.051322 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5517903-bcd6-4fdc-b189-21658bb52144 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:53.064987 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5517903-bcd6-4fdc-b189-21658bb52144 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:53.154610 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc059732-e487-4006-925c-253e7bf75c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:53.156199 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc059732-e487-4006-925c-253e7bf75c5b admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:53.157424 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc059732-e487-4006-925c-253e7bf75c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:53.158141 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc059732-e487-4006-925c-253e7bf75c5b admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:53.160071 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc059732-e487-4006-925c-253e7bf75c5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:53.165026 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc059732-e487-4006-925c-253e7bf75c5b admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:53.203862 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1098/2195] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:39:53 2022] POST /identity/v3/users => generated 288 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 17:39:53.208254 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685235be-4136-4692-a52b-a762ff400173 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:53.226220 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685235be-4136-4692-a52b-a762ff400173 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:53.237888 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e07347-b23b-4fd2-a1eb-393c913c4785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:53.240574 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e07347-b23b-4fd2-a1eb-393c913c4785 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:53.242056 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e07347-b23b-4fd2-a1eb-393c913c4785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:53.244082 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e07347-b23b-4fd2-a1eb-393c913c4785 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:53.246750 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e07347-b23b-4fd2-a1eb-393c913c4785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:53.250232 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e07347-b23b-4fd2-a1eb-393c913c4785 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:53.304309 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1098/2196] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:39:53.309192 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc059732-e487-4006-925c-253e7bf75c5b admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:53.325729 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc059732-e487-4006-925c-253e7bf75c5b admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:53.341023 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc6f6a-fac8-4068-bd82-0c2f7a513b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:53.341799 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc6f6a-fac8-4068-bd82-0c2f7a513b45 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:53.342145 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc6f6a-fac8-4068-bd82-0c2f7a513b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:53.342490 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc6f6a-fac8-4068-bd82-0c2f7a513b45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:53.343373 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cc6f6a-fac8-4068-bd82-0c2f7a513b45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:53.367679 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cc6f6a-fac8-4068-bd82-0c2f7a513b45 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:53.383796 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1099/2197] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:39:53.397567 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e07347-b23b-4fd2-a1eb-393c913c4785 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:53.408340 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e07347-b23b-4fd2-a1eb-393c913c4785 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:53.414382 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59d132-20d7-4f28-8073-339b9c2c0f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:53.415351 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59d132-20d7-4f28-8073-339b9c2c0f0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:53.415639 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59d132-20d7-4f28-8073-339b9c2c0f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:53.416040 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59d132-20d7-4f28-8073-339b9c2c0f0f admin admin] PATH_INFO: `/v3/projects/56f755041b984f9ebd0e506e08e3e5f9/users/bdb0a874e0ad49b3a37d2538acb44a71/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:53.434970 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59d132-20d7-4f28-8073-339b9c2c0f0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=56f755041b984f9ebd0e506e08e3e5f9, user_id=bdb0a874e0ad49b3a37d2538acb44a71, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:53.437716 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59d132-20d7-4f28-8073-339b9c2c0f0f admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:53.470455 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1099/2198] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:39:53 2022] PUT /identity/v3/projects/56f755041b984f9ebd0e506e08e3e5f9/users/bdb0a874e0ad49b3a37d2538acb44a71/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:39:53.480295 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562aa415-1030-4167-a87e-b1e4d7b7a6fb None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:53.480664 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562aa415-1030-4167-a87e-b1e4d7b7a6fb None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:53.481013 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562aa415-1030-4167-a87e-b1e4d7b7a6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:53.501214 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:53.514255 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-562aa415-1030-4167-a87e-b1e4d7b7a6fb None None] MFA Rules not processed for user `bdb0a874e0ad49b3a37d2538acb44a71`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:53.515925 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-562aa415-1030-4167-a87e-b1e4d7b7a6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:53.608982 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1100/2199] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:39:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:39:53.620447 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59d132-20d7-4f28-8073-339b9c2c0f0f admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:53.622431 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-bb59d132-20d7-4f28-8073-339b9c2c0f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:53.689969 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59d132-20d7-4f28-8073-339b9c2c0f0f admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:53.694296 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5d4ee-5fa1-4ca5-990b-1160ebf96859 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:53.694968 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5d4ee-5fa1-4ca5-990b-1160ebf96859 service cinder] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:53.695247 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5d4ee-5fa1-4ca5-990b-1160ebf96859 service cinder] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:53.695525 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5d4ee-5fa1-4ca5-990b-1160ebf96859 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:53.705861 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b5d4ee-5fa1-4ca5-990b-1160ebf96859 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:53.707367 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b5d4ee-5fa1-4ca5-990b-1160ebf96859 service cinder] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:53.717810 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1100/2200] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:39:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 17:39:57.194309 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09857286-7d35-4298-9c16-78d27841b3a2 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:57.194882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09857286-7d35-4298-9c16-78d27841b3a2 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:57.194882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09857286-7d35-4298-9c16-78d27841b3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:57.214375 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-09857286-7d35-4298-9c16-78d27841b3a2 None None] MFA Rules not processed for user `b73d09bd7c1e4753a45cfdb00cc5abe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:39:57.215594 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-09857286-7d35-4298-9c16-78d27841b3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:57.270506 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1101/2201] 10.222.0.27 () {58 vars in 967 bytes} [Fri Jul 15 17:39:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:39:57.283338 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5d4ee-5fa1-4ca5-990b-1160ebf96859 service cinder] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:57.284890 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-54b5d4ee-5fa1-4ca5-990b-1160ebf96859 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:57.342860 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:39:57.364316 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5d4ee-5fa1-4ca5-990b-1160ebf96859 service cinder] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:57.369869 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41b22d-f22f-497d-879c-a995daf98355 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dea565b75784465a8ea073883261d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:57.370566 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41b22d-f22f-497d-879c-a995daf98355 service swift] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:57.370872 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41b22d-f22f-497d-879c-a995daf98355 service swift] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:57.371150 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41b22d-f22f-497d-879c-a995daf98355 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:57.381142 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c41b22d-f22f-497d-879c-a995daf98355 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:57.382781 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c41b22d-f22f-497d-879c-a995daf98355 service swift] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:57.391949 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1101/2202] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Jul 15 17:39:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 17:39:57.989070 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09857286-7d35-4298-9c16-78d27841b3a2 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:57.990706 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-09857286-7d35-4298-9c16-78d27841b3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:58.004396 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09857286-7d35-4298-9c16-78d27841b3a2 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:58.009500 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8b494-921b-4853-8882-78b660bb8c52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:58.010254 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8b494-921b-4853-8882-78b660bb8c52 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:58.010669 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8b494-921b-4853-8882-78b660bb8c52 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:58.011034 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8b494-921b-4853-8882-78b660bb8c52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:58.013423 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d5f8b494-921b-4853-8882-78b660bb8c52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:58.087073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f8b494-921b-4853-8882-78b660bb8c52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:58.088444 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f8b494-921b-4853-8882-78b660bb8c52 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:58.098528 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1102/2203] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:39:57 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:39:59.663720 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41b22d-f22f-497d-879c-a995daf98355 service swift] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:39:59.665592 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-3c41b22d-f22f-497d-879c-a995daf98355 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:39:59.740395 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41b22d-f22f-497d-879c-a995daf98355 service swift] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:39:59.745059 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a64f73-5b53-47c6-80f6-52a15e11bf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:39:59.745985 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a64f73-5b53-47c6-80f6-52a15e11bf85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:39:59.746268 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a64f73-5b53-47c6-80f6-52a15e11bf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:39:59.746544 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a64f73-5b53-47c6-80f6-52a15e11bf85 admin admin] PATH_INFO: `/v3/users/afc6391173d04c2895bfef69225c29c1` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:39:59.747729 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a64f73-5b53-47c6-80f6-52a15e11bf85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afc6391173d04c2895bfef69225c29c1)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:39:59.749649 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a64f73-5b53-47c6-80f6-52a15e11bf85 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:39:59.802336 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-45a64f73-5b53-47c6-80f6-52a15e11bf85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afc6391173d04c2895bfef69225c29c1'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:59.803000 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-45a64f73-5b53-47c6-80f6-52a15e11bf85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afc6391173d04c2895bfef69225c29c1'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:59.810220 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-45a64f73-5b53-47c6-80f6-52a15e11bf85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afc6391173d04c2895bfef69225c29c1'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:59.810866 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-45a64f73-5b53-47c6-80f6-52a15e11bf85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afc6391173d04c2895bfef69225c29c1'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:59.833636 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-45a64f73-5b53-47c6-80f6-52a15e11bf85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afc6391173d04c2895bfef69225c29c1'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:39:59.850899 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1102/2204] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:39:59 2022] DELETE /identity/v3/users/afc6391173d04c2895bfef69225c29c1 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:40:00.110072 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8b494-921b-4853-8882-78b660bb8c52 service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:40:00.124021 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8b494-921b-4853-8882-78b660bb8c52 service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:40:00.167160 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:40:00.193117 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c710f3e-734a-4935-b032-5d8043975fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:40:00.194138 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c710f3e-734a-4935-b032-5d8043975fbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:00.194416 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c710f3e-734a-4935-b032-5d8043975fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:00.194684 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c710f3e-734a-4935-b032-5d8043975fbf admin admin] PATH_INFO: `/v3/projects/70594cd6864a4e698b2227e45ab33b65` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:00.195863 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c710f3e-734a-4935-b032-5d8043975fbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=70594cd6864a4e698b2227e45ab33b65)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:40:00.198167 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c710f3e-734a-4935-b032-5d8043975fbf admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:40:00.252716 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-4c710f3e-734a-4935-b032-5d8043975fbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70594cd6864a4e698b2227e45ab33b65', 'request_id': 'req-4c710f3e-734a-4935-b032-5d8043975fbf'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:00.264852 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-4c710f3e-734a-4935-b032-5d8043975fbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70594cd6864a4e698b2227e45ab33b65', 'request_id': 'req-4c710f3e-734a-4935-b032-5d8043975fbf'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:00.271134 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-4c710f3e-734a-4935-b032-5d8043975fbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70594cd6864a4e698b2227e45ab33b65', 'request_id': 'req-4c710f3e-734a-4935-b032-5d8043975fbf'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:00.283979 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-4c710f3e-734a-4935-b032-5d8043975fbf admin admin] The token cache is being invalidate because project 70594cd6864a4e698b2227e45ab33b65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:40:00.284348 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-4c710f3e-734a-4935-b032-5d8043975fbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:00.285400 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-4c710f3e-734a-4935-b032-5d8043975fbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:00.293576 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1103/2205] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:40:00 2022] DELETE /identity/v3/projects/70594cd6864a4e698b2227e45ab33b65 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:40:00.295472 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807a3d5-a15f-4270-b916-b61ac9251de8 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:00.296003 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807a3d5-a15f-4270-b916-b61ac9251de8 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:00.296288 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807a3d5-a15f-4270-b916-b61ac9251de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:00.329113 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-b807a3d5-a15f-4270-b916-b61ac9251de8 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:40:00.330391 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-b807a3d5-a15f-4270-b916-b61ac9251de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:40:00.403572 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:40:00.421843 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1103/2206] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:40:00.424634 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efba7d-34d3-4e97-a68f-d67ecdc763f4 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:00.424948 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efba7d-34d3-4e97-a68f-d67ecdc763f4 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:00.425361 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efba7d-34d3-4e97-a68f-d67ecdc763f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:00.452548 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-95efba7d-34d3-4e97-a68f-d67ecdc763f4 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:40:00.459479 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-95efba7d-34d3-4e97-a68f-d67ecdc763f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:40:00.473353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1104/2207] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:40:00.475493 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807a3d5-a15f-4270-b916-b61ac9251de8 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:40:00.486465 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807a3d5-a15f-4270-b916-b61ac9251de8 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:40:00.491672 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b7583-e9af-473c-98af-9627b6521e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:40:00.492368 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b7583-e9af-473c-98af-9627b6521e20 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:00.492644 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b7583-e9af-473c-98af-9627b6521e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:00.492914 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b7583-e9af-473c-98af-9627b6521e20 admin admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:00.493732 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b7583-e9af-473c-98af-9627b6521e20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:40:00.494064 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b7583-e9af-473c-98af-9627b6521e20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:40:00.495695 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b7583-e9af-473c-98af-9627b6521e20 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:40:00.507820 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1104/2208] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:40:00.512464 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95efba7d-34d3-4e97-a68f-d67ecdc763f4 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:40:00.524045 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95efba7d-34d3-4e97-a68f-d67ecdc763f4 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:40:00.529011 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169dcec6-3e9b-4e75-9963-abc4e345b6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:40:00.529919 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169dcec6-3e9b-4e75-9963-abc4e345b6ad admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:00.530198 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169dcec6-3e9b-4e75-9963-abc4e345b6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:00.530468 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169dcec6-3e9b-4e75-9963-abc4e345b6ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:00.531181 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169dcec6-3e9b-4e75-9963-abc4e345b6ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:40:00.533082 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169dcec6-3e9b-4e75-9963-abc4e345b6ad admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:40:00.565624 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1105/2209] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:40:00 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:40:00.565979 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b7583-e9af-473c-98af-9627b6521e20 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:40:00.578202 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b7583-e9af-473c-98af-9627b6521e20 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:40:00.643835 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967eb8a5-78d9-47a0-93b0-46448b2386d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:40:00.644605 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967eb8a5-78d9-47a0-93b0-46448b2386d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:00.644882 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967eb8a5-78d9-47a0-93b0-46448b2386d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:00.645157 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967eb8a5-78d9-47a0-93b0-46448b2386d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:00.645873 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967eb8a5-78d9-47a0-93b0-46448b2386d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:40:00.647779 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967eb8a5-78d9-47a0-93b0-46448b2386d4 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:40:00.673213 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1105/2210] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:40:00 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:40:00.677879 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169dcec6-3e9b-4e75-9963-abc4e345b6ad admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:40:00.690946 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169dcec6-3e9b-4e75-9963-abc4e345b6ad admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:40:00.699073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a851a-b9b2-4438-a7b0-a5c22edd80a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:40:00.699765 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a851a-b9b2-4438-a7b0-a5c22edd80a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:00.700048 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a851a-b9b2-4438-a7b0-a5c22edd80a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:00.700321 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a851a-b9b2-4438-a7b0-a5c22edd80a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:00.701063 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a851a-b9b2-4438-a7b0-a5c22edd80a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:40:00.702982 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a851a-b9b2-4438-a7b0-a5c22edd80a1 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:40:00.716625 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1106/2211] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 17:40:00.718803 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967eb8a5-78d9-47a0-93b0-46448b2386d4 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:40:00.729231 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967eb8a5-78d9-47a0-93b0-46448b2386d4 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:40:00.738125 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c01896-6a4a-4c96-924a-b304330a87ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:40:00.739209 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c01896-6a4a-4c96-924a-b304330a87ad admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:00.739553 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c01896-6a4a-4c96-924a-b304330a87ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:00.740018 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c01896-6a4a-4c96-924a-b304330a87ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:00.740835 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c01896-6a4a-4c96-924a-b304330a87ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:40:00.742526 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c01896-6a4a-4c96-924a-b304330a87ad admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:40:00.753375 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1106/2212] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 17:40:00.757953 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a851a-b9b2-4438-a7b0-a5c22edd80a1 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:40:00.768314 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a851a-b9b2-4438-a7b0-a5c22edd80a1 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:40:00.774196 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed1604-d41a-46cc-a8a6-557e07297249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:40:00.775120 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed1604-d41a-46cc-a8a6-557e07297249 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:00.775438 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed1604-d41a-46cc-a8a6-557e07297249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:00.775714 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed1604-d41a-46cc-a8a6-557e07297249 admin admin] PATH_INFO: `/v3/projects/bc55fd9d76d34c459e9d023d3851ea99/users/d7bc0d3f472a4c008cc32b4af5d3def8/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:00.793398 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed1604-d41a-46cc-a8a6-557e07297249 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc55fd9d76d34c459e9d023d3851ea99, user_id=d7bc0d3f472a4c008cc32b4af5d3def8, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:40:00.796111 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed1604-d41a-46cc-a8a6-557e07297249 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:40:00.814831 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1107/2213] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:40:00 2022] PUT /identity/v3/projects/bc55fd9d76d34c459e9d023d3851ea99/users/d7bc0d3f472a4c008cc32b4af5d3def8/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:40:00.820576 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f66a1e-0688-4bc1-b14a-ae9ccecc26d3 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:00.820869 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f66a1e-0688-4bc1-b14a-ae9ccecc26d3 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:00.821183 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f66a1e-0688-4bc1-b14a-ae9ccecc26d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:00.839984 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-e8f66a1e-0688-4bc1-b14a-ae9ccecc26d3 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:40:00.841478 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-e8f66a1e-0688-4bc1-b14a-ae9ccecc26d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:40:00.905432 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1107/2214] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:40:00.915329 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed1604-d41a-46cc-a8a6-557e07297249 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:40:00.917321 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-25ed1604-d41a-46cc-a8a6-557e07297249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:40:00.981850 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed1604-d41a-46cc-a8a6-557e07297249 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:40:00.985499 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde5379-0051-4d54-87c6-e280605dc879 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:40:00.986189 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde5379-0051-4d54-87c6-e280605dc879 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:00.986468 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde5379-0051-4d54-87c6-e280605dc879 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:00.986750 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde5379-0051-4d54-87c6-e280605dc879 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:00.997393 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fde5379-0051-4d54-87c6-e280605dc879 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:40:00.998885 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fde5379-0051-4d54-87c6-e280605dc879 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:40:01.011973 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1108/2215] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:40:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:40:04.282604 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f66a1e-0688-4bc1-b14a-ae9ccecc26d3 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:40:04.284108 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-e8f66a1e-0688-4bc1-b14a-ae9ccecc26d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:40:04.297283 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f66a1e-0688-4bc1-b14a-ae9ccecc26d3 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:40:04.319517 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd087e6e-1fa4-4275-803a-0f319eb6e944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:40:04.321337 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd087e6e-1fa4-4275-803a-0f319eb6e944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:04.321623 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd087e6e-1fa4-4275-803a-0f319eb6e944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:04.321935 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd087e6e-1fa4-4275-803a-0f319eb6e944 admin admin] PATH_INFO: `/v3/users/bdb0a874e0ad49b3a37d2538acb44a71` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:04.325032 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd087e6e-1fa4-4275-803a-0f319eb6e944 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdb0a874e0ad49b3a37d2538acb44a71)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:40:04.327414 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd087e6e-1fa4-4275-803a-0f319eb6e944 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:40:04.410503 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-bd087e6e-1fa4-4275-803a-0f319eb6e944 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdb0a874e0ad49b3a37d2538acb44a71'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:04.411640 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-bd087e6e-1fa4-4275-803a-0f319eb6e944 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdb0a874e0ad49b3a37d2538acb44a71'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:04.436566 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-bd087e6e-1fa4-4275-803a-0f319eb6e944 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdb0a874e0ad49b3a37d2538acb44a71'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:04.438739 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-bd087e6e-1fa4-4275-803a-0f319eb6e944 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdb0a874e0ad49b3a37d2538acb44a71'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:04.459732 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:40:04.479947 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-bd087e6e-1fa4-4275-803a-0f319eb6e944 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdb0a874e0ad49b3a37d2538acb44a71'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:04.510308 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1108/2216] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:40:04 2022] DELETE /identity/v3/users/bdb0a874e0ad49b3a37d2538acb44a71 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:40:04.515545 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3c80f-de39-4e75-82cf-c67bab2bf282 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:04.515545 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3c80f-de39-4e75-82cf-c67bab2bf282 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:04.515545 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3c80f-de39-4e75-82cf-c67bab2bf282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:04.528462 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:40:04.538306 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-b0f3c80f-de39-4e75-82cf-c67bab2bf282 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:40:04.539558 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b0f3c80f-de39-4e75-82cf-c67bab2bf282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:40:04.642219 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1109/2217] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:40:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:40:04.656823 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd087e6e-1fa4-4275-803a-0f319eb6e944 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:40:04.658648 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-bd087e6e-1fa4-4275-803a-0f319eb6e944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:40:04.781763 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd087e6e-1fa4-4275-803a-0f319eb6e944 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:40:04.787811 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2302a3-0772-4787-b521-03f48fe3c107 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:40:04.788506 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2302a3-0772-4787-b521-03f48fe3c107 service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:04.788835 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2302a3-0772-4787-b521-03f48fe3c107 service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:04.789119 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2302a3-0772-4787-b521-03f48fe3c107 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:04.800940 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2302a3-0772-4787-b521-03f48fe3c107 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:40:04.803695 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2302a3-0772-4787-b521-03f48fe3c107 service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:40:04.820507 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1109/2218] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:40:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:40:05.309066 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3c80f-de39-4e75-82cf-c67bab2bf282 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:40:05.310625 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b0f3c80f-de39-4e75-82cf-c67bab2bf282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:40:05.331860 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3c80f-de39-4e75-82cf-c67bab2bf282 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:40:05.338056 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f735047-5ff6-460c-9e66-35b36f16d47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:40:05.338445 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f735047-5ff6-460c-9e66-35b36f16d47a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:05.338711 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f735047-5ff6-460c-9e66-35b36f16d47a admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:05.338985 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f735047-5ff6-460c-9e66-35b36f16d47a admin admin] PATH_INFO: `/v3/projects/56f755041b984f9ebd0e506e08e3e5f9` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:05.340781 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f735047-5ff6-460c-9e66-35b36f16d47a admin admin] RBAC: Authorizing `identity:delete_project(project_id=56f755041b984f9ebd0e506e08e3e5f9)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:40:05.342849 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f735047-5ff6-460c-9e66-35b36f16d47a admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:40:05.414312 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7f735047-5ff6-460c-9e66-35b36f16d47a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56f755041b984f9ebd0e506e08e3e5f9', 'request_id': 'req-7f735047-5ff6-460c-9e66-35b36f16d47a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:05.433195 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7f735047-5ff6-460c-9e66-35b36f16d47a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56f755041b984f9ebd0e506e08e3e5f9', 'request_id': 'req-7f735047-5ff6-460c-9e66-35b36f16d47a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:05.442860 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7f735047-5ff6-460c-9e66-35b36f16d47a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56f755041b984f9ebd0e506e08e3e5f9', 'request_id': 'req-7f735047-5ff6-460c-9e66-35b36f16d47a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:05.456212 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7f735047-5ff6-460c-9e66-35b36f16d47a admin admin] The token cache is being invalidate because project 56f755041b984f9ebd0e506e08e3e5f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:40:05.456568 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7f735047-5ff6-460c-9e66-35b36f16d47a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:05.458105 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7f735047-5ff6-460c-9e66-35b36f16d47a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:05.460160 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1110/2219] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:40:05 2022] DELETE /identity/v3/projects/56f755041b984f9ebd0e506e08e3e5f9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:40:06.479430 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c34090-2bf8-4800-b315-94ba12354a29 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:06.480251 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c34090-2bf8-4800-b315-94ba12354a29 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:06.480537 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c34090-2bf8-4800-b315-94ba12354a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:06.523631 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-d5c34090-2bf8-4800-b315-94ba12354a29 None None] MFA Rules not processed for user `d7bc0d3f472a4c008cc32b4af5d3def8`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:40:06.524879 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-d5c34090-2bf8-4800-b315-94ba12354a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:40:06.607192 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1110/2220] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:40:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:40:06.611435 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f735047-5ff6-460c-9e66-35b36f16d47a admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:40:06.613034 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7f735047-5ff6-460c-9e66-35b36f16d47a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:40:06.703035 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f735047-5ff6-460c-9e66-35b36f16d47a admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:40:06.707599 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b4940-dba5-4539-903b-cf9030e4f05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:40:06.708268 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b4940-dba5-4539-903b-cf9030e4f05d admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:06.708548 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b4940-dba5-4539-903b-cf9030e4f05d admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:06.708821 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b4940-dba5-4539-903b-cf9030e4f05d admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:06.709522 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b4940-dba5-4539-903b-cf9030e4f05d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:40:06.711459 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b4940-dba5-4539-903b-cf9030e4f05d admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:40:06.745449 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1111/2221] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:40:06 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:40:06.749522 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c34090-2bf8-4800-b315-94ba12354a29 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:40:06.762138 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c34090-2bf8-4800-b315-94ba12354a29 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:40:06.836899 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b0ca8-f2a0-4846-87af-14acaf77c40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:40:06.837656 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b0ca8-f2a0-4846-87af-14acaf77c40c admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:06.837963 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b0ca8-f2a0-4846-87af-14acaf77c40c admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:06.838284 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b0ca8-f2a0-4846-87af-14acaf77c40c admin admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:06.838954 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b0ca8-f2a0-4846-87af-14acaf77c40c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:40:06.841177 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b0ca8-f2a0-4846-87af-14acaf77c40c admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:40:06.859120 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:40:06.865299 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1111/2222] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:40:06 2022] POST /identity/v3/users => generated 299 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:40:06.869227 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b4940-dba5-4539-903b-cf9030e4f05d admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:40:06.881734 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b4940-dba5-4539-903b-cf9030e4f05d admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:40:06.888836 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a36f9-9f11-4f94-a04e-422419b223bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:40:06.889689 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a36f9-9f11-4f94-a04e-422419b223bb admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:06.890006 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a36f9-9f11-4f94-a04e-422419b223bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:06.890277 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a36f9-9f11-4f94-a04e-422419b223bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:06.891016 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a36f9-9f11-4f94-a04e-422419b223bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:40:06.892874 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a36f9-9f11-4f94-a04e-422419b223bb admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:40:06.906582 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1112/2223] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:40:06.911144 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b0ca8-f2a0-4846-87af-14acaf77c40c admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:40:06.922326 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b0ca8-f2a0-4846-87af-14acaf77c40c admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:40:06.932910 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde370be-b439-4ea4-a3c9-bad57a70f1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:40:06.933921 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde370be-b439-4ea4-a3c9-bad57a70f1de admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:06.934199 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde370be-b439-4ea4-a3c9-bad57a70f1de admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:06.934481 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde370be-b439-4ea4-a3c9-bad57a70f1de admin admin] PATH_INFO: `/v3/projects/76e6318ec089406ba70a79a4f3f10926/users/52086a5bcecb4a4bb78e68da18f34cdf/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:06.952946 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde370be-b439-4ea4-a3c9-bad57a70f1de admin admin] RBAC: Authorizing `identity:create_grant(project_id=76e6318ec089406ba70a79a4f3f10926, user_id=52086a5bcecb4a4bb78e68da18f34cdf, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:40:06.955680 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde370be-b439-4ea4-a3c9-bad57a70f1de admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:40:06.981860 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1112/2224] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:40:06 2022] PUT /identity/v3/projects/76e6318ec089406ba70a79a4f3f10926/users/52086a5bcecb4a4bb78e68da18f34cdf/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:40:06.992734 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a36f9-9f11-4f94-a04e-422419b223bb admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:40:07.000094 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:40:07.005307 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a36f9-9f11-4f94-a04e-422419b223bb admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:40:07.077561 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99721aa-baa8-497b-809f-216c49b8511e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:40:07.078356 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99721aa-baa8-497b-809f-216c49b8511e admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:07.078553 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99721aa-baa8-497b-809f-216c49b8511e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:07.078822 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99721aa-baa8-497b-809f-216c49b8511e admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:07.079556 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99721aa-baa8-497b-809f-216c49b8511e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:40:07.081265 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99721aa-baa8-497b-809f-216c49b8511e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:40:07.092029 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1113/2225] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:40:07.096284 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde370be-b439-4ea4-a3c9-bad57a70f1de admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:40:07.109900 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde370be-b439-4ea4-a3c9-bad57a70f1de admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:40:07.115934 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77771fc7-48a8-45ef-95e1-1fae20913cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:40:07.116848 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77771fc7-48a8-45ef-95e1-1fae20913cff admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:07.117131 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77771fc7-48a8-45ef-95e1-1fae20913cff admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:07.117406 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77771fc7-48a8-45ef-95e1-1fae20913cff admin admin] PATH_INFO: `/v3/projects/76e6318ec089406ba70a79a4f3f10926/users/52086a5bcecb4a4bb78e68da18f34cdf/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:07.121398 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77771fc7-48a8-45ef-95e1-1fae20913cff admin admin] RBAC: Authorizing `identity:create_grant(project_id=76e6318ec089406ba70a79a4f3f10926, user_id=52086a5bcecb4a4bb78e68da18f34cdf, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:40:07.124091 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77771fc7-48a8-45ef-95e1-1fae20913cff admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:40:07.143420 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1113/2226] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:40:07 2022] PUT /identity/v3/projects/76e6318ec089406ba70a79a4f3f10926/users/52086a5bcecb4a4bb78e68da18f34cdf/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:40:11.143745 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089904c-524e-4c38-bcf6-77369b78ce17 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:11.144721 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089904c-524e-4c38-bcf6-77369b78ce17 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:11.145216 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089904c-524e-4c38-bcf6-77369b78ce17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:11.179596 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-7089904c-524e-4c38-bcf6-77369b78ce17 None None] MFA Rules not processed for user `9a6b1637ae344e6fa593b0aa10c003d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:40:11.182602 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7089904c-524e-4c38-bcf6-77369b78ce17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:40:11.278143 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1114/2227] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:40:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:40:12.743079 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1535f-7933-4312-a646-27d54c21a896 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:12.743551 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1535f-7933-4312-a646-27d54c21a896 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:12.743855 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1535f-7933-4312-a646-27d54c21a896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:12.774232 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-98b1535f-7933-4312-a646-27d54c21a896 None None] MFA Rules not processed for user `52086a5bcecb4a4bb78e68da18f34cdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:40:12.775971 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-98b1535f-7933-4312-a646-27d54c21a896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:40:12.862180 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1114/2228] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:40:12 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:40:12.874831 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7089904c-524e-4c38-bcf6-77369b78ce17 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:40:12.876858 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7089904c-524e-4c38-bcf6-77369b78ce17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:40:12.948512 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7089904c-524e-4c38-bcf6-77369b78ce17 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:40:12.957195 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca55503-0d7b-4c3e-beb6-dd01b1906a63 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14775984c9d4463a8e8848dcf189714b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:40:12.958135 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca55503-0d7b-4c3e-beb6-dd01b1906a63 service glance] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:12.958579 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca55503-0d7b-4c3e-beb6-dd01b1906a63 service glance] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:12.958852 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca55503-0d7b-4c3e-beb6-dd01b1906a63 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:13.036574 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca55503-0d7b-4c3e-beb6-dd01b1906a63 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:40:13.038692 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca55503-0d7b-4c3e-beb6-dd01b1906a63 service glance] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:40:13.045440 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:40:13.053742 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1115/2229] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:40:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:40:13.193734 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8540e5-94d0-4a3e-bf77-be32a952f614 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:13.194364 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8540e5-94d0-4a3e-bf77-be32a952f614 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:13.194686 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8540e5-94d0-4a3e-bf77-be32a952f614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:13.221502 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-1e8540e5-94d0-4a3e-bf77-be32a952f614 None None] MFA Rules not processed for user `b73d09bd7c1e4753a45cfdb00cc5abe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:40:13.222785 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-1e8540e5-94d0-4a3e-bf77-be32a952f614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:40:13.283214 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1115/2230] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Jul 15 17:40:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:40:13.296181 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca55503-0d7b-4c3e-beb6-dd01b1906a63 service glance] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:40:13.297909 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-cca55503-0d7b-4c3e-beb6-dd01b1906a63 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:40:13.376027 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca55503-0d7b-4c3e-beb6-dd01b1906a63 service glance] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:40:13.381735 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad956a0-b509-44d7-baff-78b5273655fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dea565b75784465a8ea073883261d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:40:13.382432 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad956a0-b509-44d7-baff-78b5273655fd service swift] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:13.382716 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad956a0-b509-44d7-baff-78b5273655fd service swift] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:13.382992 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad956a0-b509-44d7-baff-78b5273655fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:13.391600 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad956a0-b509-44d7-baff-78b5273655fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:40:13.393206 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad956a0-b509-44d7-baff-78b5273655fd service swift] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:40:13.402274 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1116/2231] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Jul 15 17:40:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 17:40:20.584769 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47159cbf-5ad1-4bca-93e4-1d59518f46d2 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:20.584769 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47159cbf-5ad1-4bca-93e4-1d59518f46d2 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:20.585469 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47159cbf-5ad1-4bca-93e4-1d59518f46d2 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:20.586624 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1116/2232] 10.222.0.27 () {54 vars in 921 bytes} [Fri Jul 15 17:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:40:20.597197 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd4a5d-4be6-4757-b9e1-d5166a082356 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:20.597753 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd4a5d-4be6-4757-b9e1-d5166a082356 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:20.598210 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd4a5d-4be6-4757-b9e1-d5166a082356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:20.636562 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-36dd4a5d-4be6-4757-b9e1-d5166a082356 None None] MFA Rules not processed for user `96b2105f8d29443383ed51a8fd5cec6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:40:20.640821 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-36dd4a5d-4be6-4757-b9e1-d5166a082356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:40:20.731063 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1117/2233] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Jul 15 17:40:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:40:20.749313 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47159cbf-5ad1-4bca-93e4-1d59518f46d2 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:40:20.751269 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-47159cbf-5ad1-4bca-93e4-1d59518f46d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:40:20.794336 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47159cbf-5ad1-4bca-93e4-1d59518f46d2 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:40:20.807099 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fc878-3eb7-49ec-97b8-8f4f210a7943 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96b2105f8d29443383ed51a8fd5cec6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:40:20.807552 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fc878-3eb7-49ec-97b8-8f4f210a7943 service placement] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:20.807839 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fc878-3eb7-49ec-97b8-8f4f210a7943 service placement] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:20.808113 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fc878-3eb7-49ec-97b8-8f4f210a7943 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:20.828360 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14fc878-3eb7-49ec-97b8-8f4f210a7943 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:40:20.830031 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14fc878-3eb7-49ec-97b8-8f4f210a7943 service placement] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:40:20.870821 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1117/2234] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:40:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:40:21.773846 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd4a5d-4be6-4757-b9e1-d5166a082356 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:40:21.775913 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-36dd4a5d-4be6-4757-b9e1-d5166a082356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:40:21.929689 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd4a5d-4be6-4757-b9e1-d5166a082356 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:40:21.942012 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb6101-d9a4-447d-970b-0891be463762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:40:21.942954 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb6101-d9a4-447d-970b-0891be463762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:21.943407 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb6101-d9a4-447d-970b-0891be463762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:21.943681 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb6101-d9a4-447d-970b-0891be463762 admin admin] PATH_INFO: `/v3/users/258d160ddf8d499f977dd075b1c211e9` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:21.945863 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cb6101-d9a4-447d-970b-0891be463762 admin admin] RBAC: Authorizing `identity:delete_user(user_id=258d160ddf8d499f977dd075b1c211e9)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:40:21.948174 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cb6101-d9a4-447d-970b-0891be463762 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:40:22.013946 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:40:22.050808 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e2cb6101-d9a4-447d-970b-0891be463762 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '258d160ddf8d499f977dd075b1c211e9'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:22.051494 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e2cb6101-d9a4-447d-970b-0891be463762 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '258d160ddf8d499f977dd075b1c211e9'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:22.073935 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e2cb6101-d9a4-447d-970b-0891be463762 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '258d160ddf8d499f977dd075b1c211e9'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:22.095750 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e2cb6101-d9a4-447d-970b-0891be463762 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '258d160ddf8d499f977dd075b1c211e9'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:22.118609 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e2cb6101-d9a4-447d-970b-0891be463762 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '258d160ddf8d499f977dd075b1c211e9'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:22.134569 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1118/2235] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:40:21 2022] DELETE /identity/v3/users/258d160ddf8d499f977dd075b1c211e9 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:40:22.382930 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fc878-3eb7-49ec-97b8-8f4f210a7943 service placement] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:40:22.394602 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fc878-3eb7-49ec-97b8-8f4f210a7943 service placement] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:40:22.454542 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:40:22.485431 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d76778-29d3-4a11-b835-fbcaef2cd725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:40:22.486602 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d76778-29d3-4a11-b835-fbcaef2cd725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:22.486885 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d76778-29d3-4a11-b835-fbcaef2cd725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:22.487259 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d76778-29d3-4a11-b835-fbcaef2cd725 admin admin] PATH_INFO: `/v3/projects/acec926bea7f418fb816c45bb17deb90` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:22.490936 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d76778-29d3-4a11-b835-fbcaef2cd725 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acec926bea7f418fb816c45bb17deb90)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:40:22.493378 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d76778-29d3-4a11-b835-fbcaef2cd725 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:40:22.563510 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-f8d76778-29d3-4a11-b835-fbcaef2cd725 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acec926bea7f418fb816c45bb17deb90', 'request_id': 'req-f8d76778-29d3-4a11-b835-fbcaef2cd725'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:22.582848 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-f8d76778-29d3-4a11-b835-fbcaef2cd725 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acec926bea7f418fb816c45bb17deb90', 'request_id': 'req-f8d76778-29d3-4a11-b835-fbcaef2cd725'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:22.592238 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-f8d76778-29d3-4a11-b835-fbcaef2cd725 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acec926bea7f418fb816c45bb17deb90', 'request_id': 'req-f8d76778-29d3-4a11-b835-fbcaef2cd725'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:22.605642 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-f8d76778-29d3-4a11-b835-fbcaef2cd725 admin admin] The token cache is being invalidate because project acec926bea7f418fb816c45bb17deb90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80150) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:40:22.605981 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-f8d76778-29d3-4a11-b835-fbcaef2cd725 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:22.607027 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-f8d76778-29d3-4a11-b835-fbcaef2cd725 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:22.608785 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1118/2236] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:40:22 2022] DELETE /identity/v3/projects/acec926bea7f418fb816c45bb17deb90 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:40:22.613968 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb6101-d9a4-447d-970b-0891be463762 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:40:22.615602 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-e2cb6101-d9a4-447d-970b-0891be463762 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:40:22.636577 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb6101-d9a4-447d-970b-0891be463762 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:40:22.719713 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5dfbbd-12fe-4838-8965-518e2a5bd53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:40:22.720731 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dfbbd-12fe-4838-8965-518e2a5bd53c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:22.721273 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dfbbd-12fe-4838-8965-518e2a5bd53c admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:22.722044 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dfbbd-12fe-4838-8965-518e2a5bd53c admin admin] PATH_INFO: `/v3/users/2e4424f05bd24fe1920380e1de6e86cc` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:22.723218 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5dfbbd-12fe-4838-8965-518e2a5bd53c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e4424f05bd24fe1920380e1de6e86cc)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:40:22.725559 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5dfbbd-12fe-4838-8965-518e2a5bd53c admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:40:22.789814 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9a5dfbbd-12fe-4838-8965-518e2a5bd53c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e4424f05bd24fe1920380e1de6e86cc'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:22.791221 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9a5dfbbd-12fe-4838-8965-518e2a5bd53c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e4424f05bd24fe1920380e1de6e86cc'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:22.799818 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9a5dfbbd-12fe-4838-8965-518e2a5bd53c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e4424f05bd24fe1920380e1de6e86cc'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:22.813827 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9a5dfbbd-12fe-4838-8965-518e2a5bd53c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e4424f05bd24fe1920380e1de6e86cc'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:22.825010 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9a5dfbbd-12fe-4838-8965-518e2a5bd53c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e4424f05bd24fe1920380e1de6e86cc'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:22.832801 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1119/2237] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:40:22 2022] DELETE /identity/v3/users/2e4424f05bd24fe1920380e1de6e86cc => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:40:23.027570 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d76778-29d3-4a11-b835-fbcaef2cd725 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:40:23.029897 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-f8d76778-29d3-4a11-b835-fbcaef2cd725 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:40:23.048760 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d76778-29d3-4a11-b835-fbcaef2cd725 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:40:23.114191 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20a12d-c3d8-449c-b8a1-99219d568a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:40:23.115181 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20a12d-c3d8-449c-b8a1-99219d568a8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:23.115636 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20a12d-c3d8-449c-b8a1-99219d568a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:23.116080 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20a12d-c3d8-449c-b8a1-99219d568a8b admin admin] PATH_INFO: `/v3/projects/d359bf1b89b849ebb5744fa84b06e11f` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:23.117282 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20a12d-c3d8-449c-b8a1-99219d568a8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d359bf1b89b849ebb5744fa84b06e11f)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:40:23.119340 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20a12d-c3d8-449c-b8a1-99219d568a8b admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:40:23.197081 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-1d20a12d-c3d8-449c-b8a1-99219d568a8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd359bf1b89b849ebb5744fa84b06e11f', 'request_id': 'req-1d20a12d-c3d8-449c-b8a1-99219d568a8b'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:23.212601 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-1d20a12d-c3d8-449c-b8a1-99219d568a8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd359bf1b89b849ebb5744fa84b06e11f', 'request_id': 'req-1d20a12d-c3d8-449c-b8a1-99219d568a8b'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:23.226584 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-1d20a12d-c3d8-449c-b8a1-99219d568a8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd359bf1b89b849ebb5744fa84b06e11f', 'request_id': 'req-1d20a12d-c3d8-449c-b8a1-99219d568a8b'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:23.238533 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:40:23.245592 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-1d20a12d-c3d8-449c-b8a1-99219d568a8b admin admin] The token cache is being invalidate because project d359bf1b89b849ebb5744fa84b06e11f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80150) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:40:23.247633 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-1d20a12d-c3d8-449c-b8a1-99219d568a8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:23.248569 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-1d20a12d-c3d8-449c-b8a1-99219d568a8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:23.251785 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1119/2238] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:40:23 2022] DELETE /identity/v3/projects/d359bf1b89b849ebb5744fa84b06e11f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:40:23.257474 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b749653-51bc-4fc8-adf6-cca358acb7ab None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:23.258148 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b749653-51bc-4fc8-adf6-cca358acb7ab None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:23.258724 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b749653-51bc-4fc8-adf6-cca358acb7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:23.282803 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-8b749653-51bc-4fc8-adf6-cca358acb7ab None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:40:23.284642 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8b749653-51bc-4fc8-adf6-cca358acb7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:40:23.310058 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:40:23.369829 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1120/2239] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:40:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:40:23.374225 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3bda8-88a5-40df-82d5-f2c4abb8a66e None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:23.374633 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3bda8-88a5-40df-82d5-f2c4abb8a66e None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:23.375005 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3bda8-88a5-40df-82d5-f2c4abb8a66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:23.397243 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-2cb3bda8-88a5-40df-82d5-f2c4abb8a66e None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:40:23.398805 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-2cb3bda8-88a5-40df-82d5-f2c4abb8a66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:40:23.410130 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1120/2240] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:40:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:40:23.414653 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b749653-51bc-4fc8-adf6-cca358acb7ab None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:40:23.428044 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b749653-51bc-4fc8-adf6-cca358acb7ab None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:40:23.432868 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b559d7-214d-4b33-a272-9542179b6ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:40:23.433650 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b559d7-214d-4b33-a272-9542179b6ccb admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:23.434056 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b559d7-214d-4b33-a272-9542179b6ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:23.434436 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b559d7-214d-4b33-a272-9542179b6ccb admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:23.435284 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b559d7-214d-4b33-a272-9542179b6ccb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:40:23.435691 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b559d7-214d-4b33-a272-9542179b6ccb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:40:23.438210 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b559d7-214d-4b33-a272-9542179b6ccb admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:40:23.473627 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1121/2241] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:40:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:40:23.475336 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3bda8-88a5-40df-82d5-f2c4abb8a66e None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:40:23.485695 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3bda8-88a5-40df-82d5-f2c4abb8a66e None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:40:23.491426 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b97d1-878f-47d7-8b5d-43682894be45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:40:23.492349 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b97d1-878f-47d7-8b5d-43682894be45 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:23.492729 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b97d1-878f-47d7-8b5d-43682894be45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:23.493105 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b97d1-878f-47d7-8b5d-43682894be45 admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:23.494095 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9b97d1-878f-47d7-8b5d-43682894be45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:40:23.498189 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9b97d1-878f-47d7-8b5d-43682894be45 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:40:23.540037 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1121/2242] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:40:23 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 17:40:23.544842 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b559d7-214d-4b33-a272-9542179b6ccb admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:40:23.556988 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b559d7-214d-4b33-a272-9542179b6ccb admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:40:23.648351 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3dda0-8cff-48e4-9e1a-f3e877db092d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:40:23.649204 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3dda0-8cff-48e4-9e1a-f3e877db092d admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:23.649585 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3dda0-8cff-48e4-9e1a-f3e877db092d admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:23.649995 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3dda0-8cff-48e4-9e1a-f3e877db092d admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:23.650919 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed3dda0-8cff-48e4-9e1a-f3e877db092d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:40:23.653328 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed3dda0-8cff-48e4-9e1a-f3e877db092d admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:40:23.688110 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1122/2243] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:40:23 2022] POST /identity/v3/users => generated 287 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:40:23.691955 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b97d1-878f-47d7-8b5d-43682894be45 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:40:23.711603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b97d1-878f-47d7-8b5d-43682894be45 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:40:23.720172 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e82736-25f5-4a52-a2d2-bcfab332b5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:40:23.721526 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e82736-25f5-4a52-a2d2-bcfab332b5b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:23.722122 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e82736-25f5-4a52-a2d2-bcfab332b5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:23.725909 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e82736-25f5-4a52-a2d2-bcfab332b5b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:23.726710 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e82736-25f5-4a52-a2d2-bcfab332b5b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:40:23.733768 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e82736-25f5-4a52-a2d2-bcfab332b5b4 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:40:23.749736 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1122/2244] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:40:23.753536 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3dda0-8cff-48e4-9e1a-f3e877db092d admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:40:23.767656 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3dda0-8cff-48e4-9e1a-f3e877db092d admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:40:23.783979 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada8e2ab-46a0-4c3f-a77d-fd5c7349dceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:40:23.784892 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8e2ab-46a0-4c3f-a77d-fd5c7349dceb admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:23.785171 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8e2ab-46a0-4c3f-a77d-fd5c7349dceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:23.785757 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8e2ab-46a0-4c3f-a77d-fd5c7349dceb admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:23.786695 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada8e2ab-46a0-4c3f-a77d-fd5c7349dceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:40:23.788708 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada8e2ab-46a0-4c3f-a77d-fd5c7349dceb admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:40:23.819040 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1123/2245] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:40:23.823146 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e82736-25f5-4a52-a2d2-bcfab332b5b4 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:40:23.836267 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e82736-25f5-4a52-a2d2-bcfab332b5b4 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:40:23.846462 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e55df-2625-4ae3-875d-c96dd7be070f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:40:23.848283 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e55df-2625-4ae3-875d-c96dd7be070f admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:23.848770 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e55df-2625-4ae3-875d-c96dd7be070f admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:23.849131 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e55df-2625-4ae3-875d-c96dd7be070f admin admin] PATH_INFO: `/v3/projects/06095352a94440548441d9ea53faf2d6/users/b279e6ce2aba4d5fb0882f05f4c3cd78/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:23.869400 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88e55df-2625-4ae3-875d-c96dd7be070f admin admin] RBAC: Authorizing `identity:create_grant(project_id=06095352a94440548441d9ea53faf2d6, user_id=b279e6ce2aba4d5fb0882f05f4c3cd78, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:40:23.879873 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88e55df-2625-4ae3-875d-c96dd7be070f admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:40:23.917348 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1123/2246] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:40:23 2022] PUT /identity/v3/projects/06095352a94440548441d9ea53faf2d6/users/b279e6ce2aba4d5fb0882f05f4c3cd78/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:40:23.928179 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a02232-0204-4325-b84d-1458acf32ce3 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:23.929040 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a02232-0204-4325-b84d-1458acf32ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:23.929713 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a02232-0204-4325-b84d-1458acf32ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:23.971956 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-39a02232-0204-4325-b84d-1458acf32ce3 None None] MFA Rules not processed for user `b279e6ce2aba4d5fb0882f05f4c3cd78`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:40:23.973968 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-39a02232-0204-4325-b84d-1458acf32ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:40:24.060515 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1124/2247] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:40:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:40:24.073326 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e55df-2625-4ae3-875d-c96dd7be070f admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:40:24.075431 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-b88e55df-2625-4ae3-875d-c96dd7be070f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:40:24.141864 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e55df-2625-4ae3-875d-c96dd7be070f admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:40:24.146285 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bfa14b-ae1a-401f-bee0-c21ce2087acf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:40:24.146950 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfa14b-ae1a-401f-bee0-c21ce2087acf service cinder] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:24.147238 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfa14b-ae1a-401f-bee0-c21ce2087acf service cinder] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:24.147516 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfa14b-ae1a-401f-bee0-c21ce2087acf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:24.158837 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bfa14b-ae1a-401f-bee0-c21ce2087acf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:40:24.161071 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bfa14b-ae1a-401f-bee0-c21ce2087acf service cinder] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:40:24.173254 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1124/2248] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:40:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:40:24.195362 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a02232-0204-4325-b84d-1458acf32ce3 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:40:24.221474 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:40:24.275087 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a02232-0204-4325-b84d-1458acf32ce3 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:40:24.280056 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d503e1e4-d382-4ebc-b53c-ffcf870aa420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:40:24.280987 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503e1e4-d382-4ebc-b53c-ffcf870aa420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:24.281270 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503e1e4-d382-4ebc-b53c-ffcf870aa420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:24.281547 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503e1e4-d382-4ebc-b53c-ffcf870aa420 admin admin] PATH_INFO: `/v3/users/b279e6ce2aba4d5fb0882f05f4c3cd78` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:24.282977 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d503e1e4-d382-4ebc-b53c-ffcf870aa420 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b279e6ce2aba4d5fb0882f05f4c3cd78)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:40:24.285096 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d503e1e4-d382-4ebc-b53c-ffcf870aa420 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:40:24.346412 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d503e1e4-d382-4ebc-b53c-ffcf870aa420 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b279e6ce2aba4d5fb0882f05f4c3cd78'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:24.347158 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d503e1e4-d382-4ebc-b53c-ffcf870aa420 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b279e6ce2aba4d5fb0882f05f4c3cd78'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:24.354384 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d503e1e4-d382-4ebc-b53c-ffcf870aa420 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b279e6ce2aba4d5fb0882f05f4c3cd78'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:24.366551 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d503e1e4-d382-4ebc-b53c-ffcf870aa420 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b279e6ce2aba4d5fb0882f05f4c3cd78'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:24.376525 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d503e1e4-d382-4ebc-b53c-ffcf870aa420 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b279e6ce2aba4d5fb0882f05f4c3cd78'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:24.387185 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1125/2249] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:40:24 2022] DELETE /identity/v3/users/b279e6ce2aba4d5fb0882f05f4c3cd78 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:40:24.401017 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85dabfa-56a3-46c5-99da-7bee0d5fb003 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:24.401017 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85dabfa-56a3-46c5-99da-7bee0d5fb003 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:24.401017 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85dabfa-56a3-46c5-99da-7bee0d5fb003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:24.433995 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-d85dabfa-56a3-46c5-99da-7bee0d5fb003 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:40:24.435234 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-d85dabfa-56a3-46c5-99da-7bee0d5fb003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:40:24.511407 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1125/2250] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:40:24.521451 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d503e1e4-d382-4ebc-b53c-ffcf870aa420 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:40:24.522967 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d503e1e4-d382-4ebc-b53c-ffcf870aa420 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:40:24.592753 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d503e1e4-d382-4ebc-b53c-ffcf870aa420 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:40:24.601569 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a5605-6549-421a-9ee8-b13ed4ea20b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:40:24.602631 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a5605-6549-421a-9ee8-b13ed4ea20b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:24.602976 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a5605-6549-421a-9ee8-b13ed4ea20b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:24.603308 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a5605-6549-421a-9ee8-b13ed4ea20b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:24.613535 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a5605-6549-421a-9ee8-b13ed4ea20b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:40:24.616794 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a5605-6549-421a-9ee8-b13ed4ea20b9 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:40:24.626267 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1126/2251] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:40:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:40:24.927796 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85dabfa-56a3-46c5-99da-7bee0d5fb003 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:40:24.929611 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-d85dabfa-56a3-46c5-99da-7bee0d5fb003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:40:24.946574 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85dabfa-56a3-46c5-99da-7bee0d5fb003 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:40:24.952086 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c894071-253b-4ece-b9fe-3a5379d1a447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:40:24.953245 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c894071-253b-4ece-b9fe-3a5379d1a447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:24.955038 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c894071-253b-4ece-b9fe-3a5379d1a447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:24.955419 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c894071-253b-4ece-b9fe-3a5379d1a447 admin admin] PATH_INFO: `/v3/projects/06095352a94440548441d9ea53faf2d6` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:24.956985 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c894071-253b-4ece-b9fe-3a5379d1a447 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06095352a94440548441d9ea53faf2d6)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:40:24.959088 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c894071-253b-4ece-b9fe-3a5379d1a447 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:40:25.016206 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:40:25.032306 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-4c894071-253b-4ece-b9fe-3a5379d1a447 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06095352a94440548441d9ea53faf2d6', 'request_id': 'req-4c894071-253b-4ece-b9fe-3a5379d1a447'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:25.042673 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-4c894071-253b-4ece-b9fe-3a5379d1a447 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06095352a94440548441d9ea53faf2d6', 'request_id': 'req-4c894071-253b-4ece-b9fe-3a5379d1a447'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:25.051635 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-4c894071-253b-4ece-b9fe-3a5379d1a447 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06095352a94440548441d9ea53faf2d6', 'request_id': 'req-4c894071-253b-4ece-b9fe-3a5379d1a447'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:25.071216 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-4c894071-253b-4ece-b9fe-3a5379d1a447 admin admin] The token cache is being invalidate because project 06095352a94440548441d9ea53faf2d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80150) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:40:25.071515 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-4c894071-253b-4ece-b9fe-3a5379d1a447 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:25.072218 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-4c894071-253b-4ece-b9fe-3a5379d1a447 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:25.078229 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1126/2252] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:40:24 2022] DELETE /identity/v3/projects/06095352a94440548441d9ea53faf2d6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:40:25.080264 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e164aca-673e-4724-8724-541bfba4bf3a None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:25.080873 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e164aca-673e-4724-8724-541bfba4bf3a None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:25.080968 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e164aca-673e-4724-8724-541bfba4bf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:25.118339 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-6e164aca-673e-4724-8724-541bfba4bf3a None None] MFA Rules not processed for user `d7bc0d3f472a4c008cc32b4af5d3def8`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:40:25.120086 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-6e164aca-673e-4724-8724-541bfba4bf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:40:25.180825 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:40:25.214591 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1127/2253] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:40:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:40:27.258513 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10f80b-e069-4abf-b40c-43e1792403f8 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:27.258931 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10f80b-e069-4abf-b40c-43e1792403f8 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:27.259146 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10f80b-e069-4abf-b40c-43e1792403f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:27.277962 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e164aca-673e-4724-8724-541bfba4bf3a None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:40:27.279145 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-dd10f80b-e069-4abf-b40c-43e1792403f8 None None] MFA Rules not processed for user `b73d09bd7c1e4753a45cfdb00cc5abe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:40:27.280242 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-dd10f80b-e069-4abf-b40c-43e1792403f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:40:27.280369 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-6e164aca-673e-4724-8724-541bfba4bf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:40:27.344007 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1127/2254] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Jul 15 17:40:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:40:27.364263 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10f80b-e069-4abf-b40c-43e1792403f8 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:40:27.366675 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-dd10f80b-e069-4abf-b40c-43e1792403f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:40:27.388542 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e164aca-673e-4724-8724-541bfba4bf3a None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:40:27.393680 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe542b3c-4efc-43a2-a00e-109feb9e9087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:40:27.394824 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe542b3c-4efc-43a2-a00e-109feb9e9087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:27.395107 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe542b3c-4efc-43a2-a00e-109feb9e9087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:27.395385 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe542b3c-4efc-43a2-a00e-109feb9e9087 admin admin] PATH_INFO: `/v3/users/ec4f197e2f35425785491d587de57161` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:27.396628 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe542b3c-4efc-43a2-a00e-109feb9e9087 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec4f197e2f35425785491d587de57161)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:40:27.398615 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe542b3c-4efc-43a2-a00e-109feb9e9087 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:40:27.452557 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10f80b-e069-4abf-b40c-43e1792403f8 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:40:27.457838 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099a665-8b0a-40a9-b346-85339116551a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dea565b75784465a8ea073883261d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:40:27.458589 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099a665-8b0a-40a9-b346-85339116551a service swift] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:27.458748 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099a665-8b0a-40a9-b346-85339116551a service swift] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:27.459019 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099a665-8b0a-40a9-b346-85339116551a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:27.459149 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-fe542b3c-4efc-43a2-a00e-109feb9e9087 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec4f197e2f35425785491d587de57161'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:27.460956 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-fe542b3c-4efc-43a2-a00e-109feb9e9087 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec4f197e2f35425785491d587de57161'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:27.468354 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c099a665-8b0a-40a9-b346-85339116551a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:40:27.469993 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c099a665-8b0a-40a9-b346-85339116551a service swift] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:40:27.473042 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-fe542b3c-4efc-43a2-a00e-109feb9e9087 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec4f197e2f35425785491d587de57161'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:27.484175 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1128/2255] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Jul 15 17:40:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 17:40:27.491163 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-fe542b3c-4efc-43a2-a00e-109feb9e9087 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec4f197e2f35425785491d587de57161'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:27.501909 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-fe542b3c-4efc-43a2-a00e-109feb9e9087 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec4f197e2f35425785491d587de57161'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:27.513560 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1128/2256] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:40:27 2022] DELETE /identity/v3/users/ec4f197e2f35425785491d587de57161 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:40:27.516477 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6e345-6747-4e37-a2f1-ea811fb32023 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:27.516767 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6e345-6747-4e37-a2f1-ea811fb32023 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:27.517037 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6e345-6747-4e37-a2f1-ea811fb32023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:27.537405 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-93c6e345-6747-4e37-a2f1-ea811fb32023 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:40:27.538675 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-93c6e345-6747-4e37-a2f1-ea811fb32023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:40:27.598797 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:40:27.615804 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1129/2257] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:40:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:40:27.625627 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe542b3c-4efc-43a2-a00e-109feb9e9087 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:40:27.627146 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-fe542b3c-4efc-43a2-a00e-109feb9e9087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:40:27.703693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe542b3c-4efc-43a2-a00e-109feb9e9087 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:40:27.707868 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398ffed-77df-47c4-9921-7f36a9f0cc14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:40:27.708770 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398ffed-77df-47c4-9921-7f36a9f0cc14 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:27.709047 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398ffed-77df-47c4-9921-7f36a9f0cc14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:27.709324 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398ffed-77df-47c4-9921-7f36a9f0cc14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:27.722751 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4398ffed-77df-47c4-9921-7f36a9f0cc14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:40:27.724768 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4398ffed-77df-47c4-9921-7f36a9f0cc14 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:40:27.738815 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1129/2258] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:40:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:40:28.423755 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6e345-6747-4e37-a2f1-ea811fb32023 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:40:28.426893 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-93c6e345-6747-4e37-a2f1-ea811fb32023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:40:28.467031 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6e345-6747-4e37-a2f1-ea811fb32023 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:40:28.484607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc9baf-7545-4e4f-8f08-bfaf9d2755ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:40:28.485854 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc9baf-7545-4e4f-8f08-bfaf9d2755ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:28.486301 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc9baf-7545-4e4f-8f08-bfaf9d2755ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:28.486720 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc9baf-7545-4e4f-8f08-bfaf9d2755ec admin admin] PATH_INFO: `/v3/projects/246c9296fad34fe6b1706e6a759c4efc` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:28.488409 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc9baf-7545-4e4f-8f08-bfaf9d2755ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=246c9296fad34fe6b1706e6a759c4efc)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:40:28.501305 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc9baf-7545-4e4f-8f08-bfaf9d2755ec admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:40:28.590353 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-9ecc9baf-7545-4e4f-8f08-bfaf9d2755ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '246c9296fad34fe6b1706e6a759c4efc', 'request_id': 'req-9ecc9baf-7545-4e4f-8f08-bfaf9d2755ec'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:28.600142 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-9ecc9baf-7545-4e4f-8f08-bfaf9d2755ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '246c9296fad34fe6b1706e6a759c4efc', 'request_id': 'req-9ecc9baf-7545-4e4f-8f08-bfaf9d2755ec'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:28.608705 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-9ecc9baf-7545-4e4f-8f08-bfaf9d2755ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '246c9296fad34fe6b1706e6a759c4efc', 'request_id': 'req-9ecc9baf-7545-4e4f-8f08-bfaf9d2755ec'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:28.623235 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-9ecc9baf-7545-4e4f-8f08-bfaf9d2755ec admin admin] The token cache is being invalidate because project 246c9296fad34fe6b1706e6a759c4efc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80150) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:40:28.623670 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-9ecc9baf-7545-4e4f-8f08-bfaf9d2755ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:28.624520 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-9ecc9baf-7545-4e4f-8f08-bfaf9d2755ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:28.626766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1130/2259] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:40:28 2022] DELETE /identity/v3/projects/246c9296fad34fe6b1706e6a759c4efc => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:40:28.631513 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c31b6-8a79-4022-b7fc-f5e2aa3edfbb None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:28.632401 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c31b6-8a79-4022-b7fc-f5e2aa3edfbb None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:28.632714 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c31b6-8a79-4022-b7fc-f5e2aa3edfbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:28.653615 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-535c31b6-8a79-4022-b7fc-f5e2aa3edfbb None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:40:28.654858 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-535c31b6-8a79-4022-b7fc-f5e2aa3edfbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:40:28.659315 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:40:28.722211 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1130/2260] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:40:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:40:28.730482 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583db012-5c87-4f10-a22c-f25256485c7f None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:28.730771 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583db012-5c87-4f10-a22c-f25256485c7f None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:28.731076 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583db012-5c87-4f10-a22c-f25256485c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:28.753314 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-583db012-5c87-4f10-a22c-f25256485c7f None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:40:28.754696 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-583db012-5c87-4f10-a22c-f25256485c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:40:28.766544 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1131/2261] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:40:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:40:28.767860 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c31b6-8a79-4022-b7fc-f5e2aa3edfbb None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:40:28.779116 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c31b6-8a79-4022-b7fc-f5e2aa3edfbb None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:40:28.784420 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285fec41-bce7-42a0-8259-7a600941b82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:40:28.785292 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285fec41-bce7-42a0-8259-7a600941b82f admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:28.785835 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285fec41-bce7-42a0-8259-7a600941b82f admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:28.786230 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285fec41-bce7-42a0-8259-7a600941b82f admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:28.787051 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285fec41-bce7-42a0-8259-7a600941b82f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:40:28.787427 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285fec41-bce7-42a0-8259-7a600941b82f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:40:28.789215 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285fec41-bce7-42a0-8259-7a600941b82f admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:40:28.805830 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1131/2262] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:40:28.808616 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583db012-5c87-4f10-a22c-f25256485c7f None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:40:28.818928 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583db012-5c87-4f10-a22c-f25256485c7f None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:40:28.824778 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7466e6-19ef-4304-a447-6a6c6e917aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:40:28.825559 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7466e6-19ef-4304-a447-6a6c6e917aba admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:28.825932 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7466e6-19ef-4304-a447-6a6c6e917aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:28.826271 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7466e6-19ef-4304-a447-6a6c6e917aba admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:28.827048 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7466e6-19ef-4304-a447-6a6c6e917aba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:40:28.829058 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7466e6-19ef-4304-a447-6a6c6e917aba admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:40:28.862030 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1132/2263] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:40:28 2022] POST /identity/v3/projects => generated 389 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:40:28.866123 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285fec41-bce7-42a0-8259-7a600941b82f admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:40:28.876233 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285fec41-bce7-42a0-8259-7a600941b82f admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:40:28.948124 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fc72b-767f-4a78-adbb-41a615ca3eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:40:28.948906 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fc72b-767f-4a78-adbb-41a615ca3eff admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:28.949260 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fc72b-767f-4a78-adbb-41a615ca3eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:28.949602 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fc72b-767f-4a78-adbb-41a615ca3eff admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:28.950696 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002fc72b-767f-4a78-adbb-41a615ca3eff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:40:28.953580 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002fc72b-767f-4a78-adbb-41a615ca3eff admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:40:28.983513 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1132/2264] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:40:28 2022] POST /identity/v3/users => generated 295 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:40:28.984903 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7466e6-19ef-4304-a447-6a6c6e917aba admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:40:28.995205 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7466e6-19ef-4304-a447-6a6c6e917aba admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:40:29.000201 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a6b5cc-5188-4c97-aba8-77ddbc63277e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:40:29.000461 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6b5cc-5188-4c97-aba8-77ddbc63277e admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:29.000783 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6b5cc-5188-4c97-aba8-77ddbc63277e admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:29.004871 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6b5cc-5188-4c97-aba8-77ddbc63277e admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:29.004871 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a6b5cc-5188-4c97-aba8-77ddbc63277e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:40:29.004871 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a6b5cc-5188-4c97-aba8-77ddbc63277e admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:40:29.015010 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1133/2265] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:40:29.019210 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fc72b-767f-4a78-adbb-41a615ca3eff admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:40:29.030758 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fc72b-767f-4a78-adbb-41a615ca3eff admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:40:29.036084 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9515f7-260b-4699-ae63-11d36b936c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:40:29.036887 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9515f7-260b-4699-ae63-11d36b936c50 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:29.037268 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9515f7-260b-4699-ae63-11d36b936c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:29.037664 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9515f7-260b-4699-ae63-11d36b936c50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:29.038548 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9515f7-260b-4699-ae63-11d36b936c50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:40:29.040223 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9515f7-260b-4699-ae63-11d36b936c50 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:40:29.051254 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1133/2266] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:40:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 17:40:29.055343 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a6b5cc-5188-4c97-aba8-77ddbc63277e admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:40:29.065541 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a6b5cc-5188-4c97-aba8-77ddbc63277e admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:40:29.070192 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e79c0-f4c5-4163-88b7-e324c42a06b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:40:29.071218 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e79c0-f4c5-4163-88b7-e324c42a06b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:29.071556 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e79c0-f4c5-4163-88b7-e324c42a06b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:29.071834 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e79c0-f4c5-4163-88b7-e324c42a06b3 admin admin] PATH_INFO: `/v3/projects/494f442f60ef4ac1a5eabbff78a96bbf/users/7c36e304f79c40cd8d0a232c4af6e2fe/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:29.088550 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904e79c0-f4c5-4163-88b7-e324c42a06b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=494f442f60ef4ac1a5eabbff78a96bbf, user_id=7c36e304f79c40cd8d0a232c4af6e2fe, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:40:29.091278 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904e79c0-f4c5-4163-88b7-e324c42a06b3 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:40:29.111037 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1134/2267] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:40:29 2022] PUT /identity/v3/projects/494f442f60ef4ac1a5eabbff78a96bbf/users/7c36e304f79c40cd8d0a232c4af6e2fe/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:40:29.121761 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee6a4e-5284-47e9-aaf5-9fd133f1ae09 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:29.122334 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee6a4e-5284-47e9-aaf5-9fd133f1ae09 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:29.122673 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee6a4e-5284-47e9-aaf5-9fd133f1ae09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:29.156359 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-ffee6a4e-5284-47e9-aaf5-9fd133f1ae09 None None] MFA Rules not processed for user `7c36e304f79c40cd8d0a232c4af6e2fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:40:29.158027 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ffee6a4e-5284-47e9-aaf5-9fd133f1ae09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:40:29.233685 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1134/2268] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:40:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:40:29.245248 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e79c0-f4c5-4163-88b7-e324c42a06b3 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:40:29.247662 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-904e79c0-f4c5-4163-88b7-e324c42a06b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:40:29.346656 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e79c0-f4c5-4163-88b7-e324c42a06b3 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:40:29.351804 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94610ab4-eba3-4b07-9ed6-444a07ee03d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:40:29.352622 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94610ab4-eba3-4b07-9ed6-444a07ee03d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:29.353071 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94610ab4-eba3-4b07-9ed6-444a07ee03d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:29.353456 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94610ab4-eba3-4b07-9ed6-444a07ee03d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:29.366443 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94610ab4-eba3-4b07-9ed6-444a07ee03d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:40:29.368117 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94610ab4-eba3-4b07-9ed6-444a07ee03d8 service cinder] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:40:29.379491 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1135/2269] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:40:29 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:40:39.233346 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=95,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:40:39.374342 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=81,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:40:39.624017 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee6a4e-5284-47e9-aaf5-9fd133f1ae09 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:40:39.691866 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee6a4e-5284-47e9-aaf5-9fd133f1ae09 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:40:39.697533 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b8fcc-a3d7-4951-a4e8-930e6dbd3b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:40:39.698467 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b8fcc-a3d7-4951-a4e8-930e6dbd3b26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:39.698750 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b8fcc-a3d7-4951-a4e8-930e6dbd3b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:39.699023 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b8fcc-a3d7-4951-a4e8-930e6dbd3b26 admin admin] PATH_INFO: `/v3/users/7c36e304f79c40cd8d0a232c4af6e2fe` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:39.700327 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b8fcc-a3d7-4951-a4e8-930e6dbd3b26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c36e304f79c40cd8d0a232c4af6e2fe)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:40:39.702353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b8fcc-a3d7-4951-a4e8-930e6dbd3b26 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:40:39.765750 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a66b8fcc-a3d7-4951-a4e8-930e6dbd3b26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c36e304f79c40cd8d0a232c4af6e2fe'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:39.766579 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a66b8fcc-a3d7-4951-a4e8-930e6dbd3b26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c36e304f79c40cd8d0a232c4af6e2fe'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:39.775384 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a66b8fcc-a3d7-4951-a4e8-930e6dbd3b26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c36e304f79c40cd8d0a232c4af6e2fe'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:39.788818 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a66b8fcc-a3d7-4951-a4e8-930e6dbd3b26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c36e304f79c40cd8d0a232c4af6e2fe'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:39.799299 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-a66b8fcc-a3d7-4951-a4e8-930e6dbd3b26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c36e304f79c40cd8d0a232c4af6e2fe'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:39.806160 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1135/2270] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:40:39 2022] DELETE /identity/v3/users/7c36e304f79c40cd8d0a232c4af6e2fe => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:40:39.812119 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6e6f9-d466-4d88-ab45-969d221c6165 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:39.812474 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6e6f9-d466-4d88-ab45-969d221c6165 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:39.812872 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6e6f9-d466-4d88-ab45-969d221c6165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:39.834606 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-c4d6e6f9-d466-4d88-ab45-969d221c6165 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:40:39.837007 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-c4d6e6f9-d466-4d88-ab45-969d221c6165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:40:39.899812 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1136/2271] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:40:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:40:39.911165 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b8fcc-a3d7-4951-a4e8-930e6dbd3b26 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:40:39.913152 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a66b8fcc-a3d7-4951-a4e8-930e6dbd3b26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:40:39.979795 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b8fcc-a3d7-4951-a4e8-930e6dbd3b26 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:40:39.983690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab4b1e-53ba-4b43-9034-364801acf444 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:40:39.984347 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab4b1e-53ba-4b43-9034-364801acf444 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:39.984630 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab4b1e-53ba-4b43-9034-364801acf444 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:39.984906 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab4b1e-53ba-4b43-9034-364801acf444 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:39.994523 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab4b1e-53ba-4b43-9034-364801acf444 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:40:39.995982 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab4b1e-53ba-4b43-9034-364801acf444 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:40:40.008100 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1136/2272] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:40:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:40:40.536494 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d6e6f9-d466-4d88-ab45-969d221c6165 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:40:40.538546 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-c4d6e6f9-d466-4d88-ab45-969d221c6165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:40:40.551376 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d6e6f9-d466-4d88-ab45-969d221c6165 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:40:40.560478 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d5919-0572-4699-a076-306593f9af61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:40:40.561826 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d5919-0572-4699-a076-306593f9af61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:40.562154 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d5919-0572-4699-a076-306593f9af61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:40.562540 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d5919-0572-4699-a076-306593f9af61 admin admin] PATH_INFO: `/v3/projects/494f442f60ef4ac1a5eabbff78a96bbf` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:40.563724 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d5919-0572-4699-a076-306593f9af61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=494f442f60ef4ac1a5eabbff78a96bbf)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:40:40.565722 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d5919-0572-4699-a076-306593f9af61 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:40:40.618917 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-391d5919-0572-4699-a076-306593f9af61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '494f442f60ef4ac1a5eabbff78a96bbf', 'request_id': 'req-391d5919-0572-4699-a076-306593f9af61'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:40.627539 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-391d5919-0572-4699-a076-306593f9af61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '494f442f60ef4ac1a5eabbff78a96bbf', 'request_id': 'req-391d5919-0572-4699-a076-306593f9af61'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:40.633711 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-391d5919-0572-4699-a076-306593f9af61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '494f442f60ef4ac1a5eabbff78a96bbf', 'request_id': 'req-391d5919-0572-4699-a076-306593f9af61'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:40.645108 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-391d5919-0572-4699-a076-306593f9af61 admin admin] The token cache is being invalidate because project 494f442f60ef4ac1a5eabbff78a96bbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80150) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:40:40.645419 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-391d5919-0572-4699-a076-306593f9af61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:40.646072 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-391d5919-0572-4699-a076-306593f9af61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:40:40.647891 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1137/2273] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:40:40 2022] DELETE /identity/v3/projects/494f442f60ef4ac1a5eabbff78a96bbf => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:40:44.749168 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab4b1e-53ba-4b43-9034-364801acf444 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:40:44.751904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f1ab4b1e-53ba-4b43-9034-364801acf444 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:40:44.781994 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:40:44.829388 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab4b1e-53ba-4b43-9034-364801acf444 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:40:44.888828 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16805803-538e-48ce-8645-72dc3a7a76d1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96b2105f8d29443383ed51a8fd5cec6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:40:44.889509 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16805803-538e-48ce-8645-72dc3a7a76d1 service placement] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:44.889792 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16805803-538e-48ce-8645-72dc3a7a76d1 service placement] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:44.890080 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16805803-538e-48ce-8645-72dc3a7a76d1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:44.891884 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-16805803-538e-48ce-8645-72dc3a7a76d1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:40:44.904139 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16805803-538e-48ce-8645-72dc3a7a76d1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:40:44.905750 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16805803-538e-48ce-8645-72dc3a7a76d1 service placement] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:40:44.916502 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1137/2274] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:40:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:40:50.642096 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:40:54.911801 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=48 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:40:59.152978 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d5919-0572-4699-a076-306593f9af61 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:40:59.155766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-391d5919-0572-4699-a076-306593f9af61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:40:59.220919 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d5919-0572-4699-a076-306593f9af61 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:40:59.225165 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15985ef-11d4-4b16-af13-168e20400dc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:40:59.225825 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15985ef-11d4-4b16-af13-168e20400dc1 service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:40:59.226105 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15985ef-11d4-4b16-af13-168e20400dc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:40:59.226376 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15985ef-11d4-4b16-af13-168e20400dc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:40:59.228415 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-c15985ef-11d4-4b16-af13-168e20400dc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:40:59.295225 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15985ef-11d4-4b16-af13-168e20400dc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:40:59.296691 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15985ef-11d4-4b16-af13-168e20400dc1 service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:40:59.308685 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1138/2275] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:40:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:41:05.879666 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa14d0-0f6c-4a60-ac4e-d58fbf866c13 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:41:05.880181 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa14d0-0f6c-4a60-ac4e-d58fbf866c13 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:41:05.880181 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa14d0-0f6c-4a60-ac4e-d58fbf866c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:41:05.902534 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-77fa14d0-0f6c-4a60-ac4e-d58fbf866c13 None None] MFA Rules not processed for user `1332dc25fb5c4d5b8ed7bd0bd77243d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:41:05.905187 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-77fa14d0-0f6c-4a60-ac4e-d58fbf866c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:41:05.967290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1138/2276] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:41:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:41:09.302169 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=50 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:41:15.959069 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=25 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:41:22.774597 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941524c-2e85-478f-aca2-7fd75f752500 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:41:22.774597 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941524c-2e85-478f-aca2-7fd75f752500 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:41:22.774597 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941524c-2e85-478f-aca2-7fd75f752500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:41:22.791849 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-3941524c-2e85-478f-aca2-7fd75f752500 None None] MFA Rules not processed for user `b73d09bd7c1e4753a45cfdb00cc5abe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:41:22.793086 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-3941524c-2e85-478f-aca2-7fd75f752500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:41:22.856709 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1139/2277] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Jul 15 17:41:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:41:22.896240 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa14d0-0f6c-4a60-ac4e-d58fbf866c13 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:41:22.896240 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-77fa14d0-0f6c-4a60-ac4e-d58fbf866c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:41:22.966376 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa14d0-0f6c-4a60-ac4e-d58fbf866c13 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:41:22.972010 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7526a7a0-9f50-4363-baab-9fdcdcdf86c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dea565b75784465a8ea073883261d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:41:22.972688 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526a7a0-9f50-4363-baab-9fdcdcdf86c4 service swift] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:41:22.972967 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526a7a0-9f50-4363-baab-9fdcdcdf86c4 service swift] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:41:22.973236 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526a7a0-9f50-4363-baab-9fdcdcdf86c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:41:22.982241 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7526a7a0-9f50-4363-baab-9fdcdcdf86c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:41:22.983842 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7526a7a0-9f50-4363-baab-9fdcdcdf86c4 service swift] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:41:22.993259 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1139/2278] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Jul 15 17:41:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 17:41:32.849077 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=25 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:41:32.989407 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=32 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:41:39.082432 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193054a9-833f-4ac1-85b1-451c85f947bb None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:41:39.083454 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193054a9-833f-4ac1-85b1-451c85f947bb None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:41:39.083734 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193054a9-833f-4ac1-85b1-451c85f947bb None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:41:39.086100 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1140/2279] 10.222.0.27 () {54 vars in 921 bytes} [Fri Jul 15 17:41:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:41:39.091284 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26afb426-0b4b-4940-b2d6-7f06db615819 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:41:39.091794 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26afb426-0b4b-4940-b2d6-7f06db615819 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:41:39.091885 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26afb426-0b4b-4940-b2d6-7f06db615819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:41:39.111633 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-26afb426-0b4b-4940-b2d6-7f06db615819 None None] MFA Rules not processed for user `f9d548c8199e4fdbbce7597bebd63421`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:41:39.112852 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-26afb426-0b4b-4940-b2d6-7f06db615819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:41:39.186442 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1140/2280] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Jul 15 17:41:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:41:39.198565 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193054a9-833f-4ac1-85b1-451c85f947bb None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:41:39.200477 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-193054a9-833f-4ac1-85b1-451c85f947bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:41:39.269064 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193054a9-833f-4ac1-85b1-451c85f947bb None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:41:39.273807 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a5eff1-7b12-4599-ab38-de2c86721f6f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14775984c9d4463a8e8848dcf189714b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:41:39.274555 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5eff1-7b12-4599-ab38-de2c86721f6f service glance] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:41:39.274835 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5eff1-7b12-4599-ab38-de2c86721f6f service glance] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:41:39.275104 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5eff1-7b12-4599-ab38-de2c86721f6f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:41:39.289240 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a5eff1-7b12-4599-ab38-de2c86721f6f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:41:39.291708 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a5eff1-7b12-4599-ab38-de2c86721f6f service glance] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:41:39.309056 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1141/2281] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:41:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:41:39.386013 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfb346-f600-4b39-9356-cf4c6b08f156 None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:41:39.386431 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfb346-f600-4b39-9356-cf4c6b08f156 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:41:39.386805 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfb346-f600-4b39-9356-cf4c6b08f156 None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:41:39.388302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1141/2282] 10.222.0.27 () {54 vars in 921 bytes} [Fri Jul 15 17:41:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:41:39.393335 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f6ee1-f4e6-44ba-8011-2959686b74d3 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:41:39.393601 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f6ee1-f4e6-44ba-8011-2959686b74d3 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:41:39.393974 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f6ee1-f4e6-44ba-8011-2959686b74d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:41:39.413185 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-df1f6ee1-f4e6-44ba-8011-2959686b74d3 None None] MFA Rules not processed for user `989272e5e803405d87d0833d503bb572`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:41:39.414452 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-df1f6ee1-f4e6-44ba-8011-2959686b74d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:41:39.422207 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1142/2283] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Jul 15 17:41:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:41:39.434492 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcfb346-f600-4b39-9356-cf4c6b08f156 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:41:39.436624 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-0bcfb346-f600-4b39-9356-cf4c6b08f156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:41:39.451611 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcfb346-f600-4b39-9356-cf4c6b08f156 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:41:39.456444 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01294c-5486-4ecf-b8f7-7fd730425515 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:41:39.457500 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01294c-5486-4ecf-b8f7-7fd730425515 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:41:39.457861 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01294c-5486-4ecf-b8f7-7fd730425515 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:41:39.458225 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01294c-5486-4ecf-b8f7-7fd730425515 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:41:39.470051 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da01294c-5486-4ecf-b8f7-7fd730425515 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:41:39.472160 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da01294c-5486-4ecf-b8f7-7fd730425515 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:41:39.482229 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1142/2284] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:41:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:41:39.576797 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75dac90-019a-4292-a7fe-8907222d105d None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:41:39.577173 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75dac90-019a-4292-a7fe-8907222d105d None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:41:39.577449 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75dac90-019a-4292-a7fe-8907222d105d None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:41:39.579498 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1143/2285] 10.222.0.27 () {54 vars in 921 bytes} [Fri Jul 15 17:41:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:41:39.585052 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71ba3c-7e87-43f4-b171-1fb27dd98525 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:41:39.585368 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71ba3c-7e87-43f4-b171-1fb27dd98525 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:41:39.585640 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71ba3c-7e87-43f4-b171-1fb27dd98525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:41:39.605611 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-ae71ba3c-7e87-43f4-b171-1fb27dd98525 None None] MFA Rules not processed for user `f9d548c8199e4fdbbce7597bebd63421`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:41:39.606918 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-ae71ba3c-7e87-43f4-b171-1fb27dd98525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:41:39.617126 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1143/2286] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Jul 15 17:41:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:41:39.627950 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75dac90-019a-4292-a7fe-8907222d105d None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:41:39.640213 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75dac90-019a-4292-a7fe-8907222d105d None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:41:39.644000 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de42db-dc05-474f-8227-86089a324437 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:41:39.644642 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de42db-dc05-474f-8227-86089a324437 service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:41:39.644921 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de42db-dc05-474f-8227-86089a324437 service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:41:39.645197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de42db-dc05-474f-8227-86089a324437 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:41:39.656041 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de42db-dc05-474f-8227-86089a324437 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:41:39.657467 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de42db-dc05-474f-8227-86089a324437 service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:41:39.668048 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1144/2287] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:41:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:41:41.928789 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b853a7-a5d9-4684-b71a-b65eb4685c51 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:41:41.929271 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b853a7-a5d9-4684-b71a-b65eb4685c51 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:41:41.929271 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b853a7-a5d9-4684-b71a-b65eb4685c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:41:41.948552 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-c1b853a7-a5d9-4684-b71a-b65eb4685c51 None None] MFA Rules not processed for user `b73d09bd7c1e4753a45cfdb00cc5abe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:41:41.949721 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c1b853a7-a5d9-4684-b71a-b65eb4685c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:41:41.957883 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1144/2288] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Jul 15 17:41:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:41:41.970729 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de42db-dc05-474f-8227-86089a324437 service neutron] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:41:41.988164 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de42db-dc05-474f-8227-86089a324437 service neutron] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:41:41.996900 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f56adbe-9c9d-4a6c-bf1f-3170b42785ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dea565b75784465a8ea073883261d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:41:41.997538 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f56adbe-9c9d-4a6c-bf1f-3170b42785ce service swift] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:41:41.997823 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f56adbe-9c9d-4a6c-bf1f-3170b42785ce service swift] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:41:41.998295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f56adbe-9c9d-4a6c-bf1f-3170b42785ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:41:42.007025 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f56adbe-9c9d-4a6c-bf1f-3170b42785ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:41:42.008630 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f56adbe-9c9d-4a6c-bf1f-3170b42785ce service swift] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:41:42.017469 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1145/2289] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Jul 15 17:41:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 17:41:51.942630 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=43 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:41:52.014184 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=41 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:42:09.420057 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57c77b-a41d-4caf-84c3-97620ff3523a None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:42:09.420623 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57c77b-a41d-4caf-84c3-97620ff3523a None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:42:09.420623 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57c77b-a41d-4caf-84c3-97620ff3523a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:42:09.438965 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-9e57c77b-a41d-4caf-84c3-97620ff3523a None None] MFA Rules not processed for user `b73d09bd7c1e4753a45cfdb00cc5abe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:42:09.440172 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-9e57c77b-a41d-4caf-84c3-97620ff3523a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:42:09.449204 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1145/2290] 10.222.0.27 () {58 vars in 967 bytes} [Fri Jul 15 17:42:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:42:09.461929 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f56adbe-9c9d-4a6c-bf1f-3170b42785ce service swift] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:42:09.473746 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f56adbe-9c9d-4a6c-bf1f-3170b42785ce service swift] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:42:09.480200 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4306ce-9b46-4be8-8222-c858e3a65716 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dea565b75784465a8ea073883261d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:42:09.480877 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4306ce-9b46-4be8-8222-c858e3a65716 service swift] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:42:09.481154 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4306ce-9b46-4be8-8222-c858e3a65716 service swift] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:42:09.481432 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4306ce-9b46-4be8-8222-c858e3a65716 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:42:09.491046 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4306ce-9b46-4be8-8222-c858e3a65716 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:42:09.492635 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4306ce-9b46-4be8-8222-c858e3a65716 service swift] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:42:09.501007 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1146/2291] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Jul 15 17:42:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 17:42:19.433661 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:42:19.497634 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=6 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:42:30.196897 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a58c15-4407-479f-b49e-f3a8a41b34ba None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:42:30.197448 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a58c15-4407-479f-b49e-f3a8a41b34ba None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:42:30.197448 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a58c15-4407-479f-b49e-f3a8a41b34ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:42:30.216885 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-84a58c15-4407-479f-b49e-f3a8a41b34ba None None] MFA Rules not processed for user `9a6b1637ae344e6fa593b0aa10c003d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:42:30.218129 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-84a58c15-4407-479f-b49e-f3a8a41b34ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:42:30.280618 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1146/2292] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:42:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:42:40.271706 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=25 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:42:44.831651 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4306ce-9b46-4be8-8222-c858e3a65716 service swift] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:42:44.844558 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4306ce-9b46-4be8-8222-c858e3a65716 service swift] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:42:44.849016 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa6a91-2ff9-4bcf-95cc-65d4b40a10b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:42:44.849677 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa6a91-2ff9-4bcf-95cc-65d4b40a10b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:42:44.849990 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa6a91-2ff9-4bcf-95cc-65d4b40a10b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:42:44.850262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa6a91-2ff9-4bcf-95cc-65d4b40a10b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:42:44.852317 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-41aa6a91-2ff9-4bcf-95cc-65d4b40a10b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:42:44.878625 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa6a91-2ff9-4bcf-95cc-65d4b40a10b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:42:44.880078 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa6a91-2ff9-4bcf-95cc-65d4b40a10b2 service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:42:44.893172 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1147/2293] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:42:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:42:46.062101 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a58c15-4407-479f-b49e-f3a8a41b34ba None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:42:46.073398 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a58c15-4407-479f-b49e-f3a8a41b34ba None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:42:46.078467 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae09734-0559-440a-9c8f-b57bcff12c6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:42:46.079363 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae09734-0559-440a-9c8f-b57bcff12c6a service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:42:46.079652 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae09734-0559-440a-9c8f-b57bcff12c6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:42:46.079933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae09734-0559-440a-9c8f-b57bcff12c6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:42:46.082077 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-6ae09734-0559-440a-9c8f-b57bcff12c6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:42:46.096374 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae09734-0559-440a-9c8f-b57bcff12c6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:42:46.097885 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae09734-0559-440a-9c8f-b57bcff12c6a service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:42:46.109369 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1147/2294] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:42:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:42:54.886757 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=6 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:42:56.104331 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=6 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:43:09.114631 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa6a91-2ff9-4bcf-95cc-65d4b40a10b2 service neutron] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:43:09.117058 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-41aa6a91-2ff9-4bcf-95cc-65d4b40a10b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:43:09.131413 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa6a91-2ff9-4bcf-95cc-65d4b40a10b2 service neutron] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:43:09.139112 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe46a5b-b6d8-4fa3-892e-8399044f2daf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:43:09.139767 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe46a5b-b6d8-4fa3-892e-8399044f2daf service nova] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:43:09.140043 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe46a5b-b6d8-4fa3-892e-8399044f2daf service nova] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:43:09.140314 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe46a5b-b6d8-4fa3-892e-8399044f2daf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:43:09.142381 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-efe46a5b-b6d8-4fa3-892e-8399044f2daf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:43:09.153707 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe46a5b-b6d8-4fa3-892e-8399044f2daf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:43:09.155319 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe46a5b-b6d8-4fa3-892e-8399044f2daf service nova] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:43:09.165100 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1148/2295] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:43:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:43:19.160350 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=6 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:43:23.010804 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9cd6b-10a0-4920-ba0f-fb1c0cc90654 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:43:23.011363 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9cd6b-10a0-4920-ba0f-fb1c0cc90654 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:43:23.011363 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9cd6b-10a0-4920-ba0f-fb1c0cc90654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:43:23.029347 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-aad9cd6b-10a0-4920-ba0f-fb1c0cc90654 None None] MFA Rules not processed for user `1332dc25fb5c4d5b8ed7bd0bd77243d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:43:23.030613 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-aad9cd6b-10a0-4920-ba0f-fb1c0cc90654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:43:23.038033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1148/2296] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:43:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:43:23.366739 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe46a5b-b6d8-4fa3-892e-8399044f2daf service nova] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:43:23.376615 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe46a5b-b6d8-4fa3-892e-8399044f2daf service nova] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:43:23.380783 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b687fd9-7ba6-41f1-b4d3-abe5bdfa2fd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:43:23.381427 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b687fd9-7ba6-41f1-b4d3-abe5bdfa2fd8 service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:43:23.381708 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b687fd9-7ba6-41f1-b4d3-abe5bdfa2fd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:43:23.382007 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b687fd9-7ba6-41f1-b4d3-abe5bdfa2fd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:43:23.383814 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-9b687fd9-7ba6-41f1-b4d3-abe5bdfa2fd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:43:23.393557 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b687fd9-7ba6-41f1-b4d3-abe5bdfa2fd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:43:23.395175 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b687fd9-7ba6-41f1-b4d3-abe5bdfa2fd8 service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:43:23.403742 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1149/2297] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:43:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:43:23.744542 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9cd6b-10a0-4920-ba0f-fb1c0cc90654 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:43:23.746124 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-aad9cd6b-10a0-4920-ba0f-fb1c0cc90654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:43:23.762005 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9cd6b-10a0-4920-ba0f-fb1c0cc90654 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:43:23.767251 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c48cb-b689-4058-a187-33864efeda3f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96b2105f8d29443383ed51a8fd5cec6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:43:23.767976 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c48cb-b689-4058-a187-33864efeda3f service placement] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:43:23.768393 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c48cb-b689-4058-a187-33864efeda3f service placement] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:43:23.769365 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c48cb-b689-4058-a187-33864efeda3f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:43:23.771521 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-059c48cb-b689-4058-a187-33864efeda3f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:43:23.783638 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059c48cb-b689-4058-a187-33864efeda3f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:43:23.785974 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059c48cb-b689-4058-a187-33864efeda3f service placement] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:43:23.796095 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1149/2298] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:43:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:43:25.624963 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b687fd9-7ba6-41f1-b4d3-abe5bdfa2fd8 service neutron] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:43:25.634652 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b687fd9-7ba6-41f1-b4d3-abe5bdfa2fd8 service neutron] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:43:25.638307 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f5e9b-63a3-4e21-ae61-f9d9b4a88203 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:43:25.638959 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f5e9b-63a3-4e21-ae61-f9d9b4a88203 service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:43:25.639269 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f5e9b-63a3-4e21-ae61-f9d9b4a88203 service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:43:25.639545 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f5e9b-63a3-4e21-ae61-f9d9b4a88203 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:43:25.641310 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-d34f5e9b-63a3-4e21-ae61-f9d9b4a88203 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:43:25.652017 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f5e9b-63a3-4e21-ae61-f9d9b4a88203 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:43:25.653568 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f5e9b-63a3-4e21-ae61-f9d9b4a88203 service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:43:25.662606 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1150/2299] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:43:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 17:43:26.316077 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c48cb-b689-4058-a187-33864efeda3f service placement] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:43:26.333585 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c48cb-b689-4058-a187-33864efeda3f service placement] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:43:26.339517 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2029eb6e-eb65-49b3-b872-b2c62becb19d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:43:26.340389 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029eb6e-eb65-49b3-b872-b2c62becb19d service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:43:26.340672 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029eb6e-eb65-49b3-b872-b2c62becb19d service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:43:26.341001 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029eb6e-eb65-49b3-b872-b2c62becb19d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:43:26.343137 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-2029eb6e-eb65-49b3-b872-b2c62becb19d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:43:26.357125 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2029eb6e-eb65-49b3-b872-b2c62becb19d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:43:26.358752 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2029eb6e-eb65-49b3-b872-b2c62becb19d service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:43:26.370563 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1150/2300] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:43:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:43:28.006529 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f5e9b-63a3-4e21-ae61-f9d9b4a88203 service neutron] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:43:28.024400 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f5e9b-63a3-4e21-ae61-f9d9b4a88203 service neutron] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:43:28.035183 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c7646-1c11-4723-abfa-484928f9b3b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:43:28.035812 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c7646-1c11-4723-abfa-484928f9b3b2 service nova] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:43:28.036090 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c7646-1c11-4723-abfa-484928f9b3b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:43:28.036355 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c7646-1c11-4723-abfa-484928f9b3b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:43:28.038632 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-c46c7646-1c11-4723-abfa-484928f9b3b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:43:28.100270 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46c7646-1c11-4723-abfa-484928f9b3b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:43:28.101813 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46c7646-1c11-4723-abfa-484928f9b3b2 service nova] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:43:28.111090 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1151/2301] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:43:28 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:43:32.881721 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2029eb6e-eb65-49b3-b872-b2c62becb19d service nova] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:43:32.893832 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2029eb6e-eb65-49b3-b872-b2c62becb19d service nova] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:43:32.901095 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b307efb-8d98-40fe-a8fb-fc6af8703ede service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:43:32.901765 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b307efb-8d98-40fe-a8fb-fc6af8703ede service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:43:32.902076 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b307efb-8d98-40fe-a8fb-fc6af8703ede service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:43:32.902353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b307efb-8d98-40fe-a8fb-fc6af8703ede service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:43:32.904282 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-3b307efb-8d98-40fe-a8fb-fc6af8703ede service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:43:32.917149 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b307efb-8d98-40fe-a8fb-fc6af8703ede service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:43:32.918765 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b307efb-8d98-40fe-a8fb-fc6af8703ede service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:43:32.930146 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1151/2302] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:43:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:43:38.106769 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=40 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:43:38.874524 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3594c-daaa-4a45-8fac-24ced5ae0940 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:43:38.874814 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3594c-daaa-4a45-8fac-24ced5ae0940 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:43:38.875095 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3594c-daaa-4a45-8fac-24ced5ae0940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:43:38.893068 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-7cb3594c-daaa-4a45-8fac-24ced5ae0940 None None] MFA Rules not processed for user `0f7c910cba2b48b393805fcc4df8884a`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:43:38.894498 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-7cb3594c-daaa-4a45-8fac-24ced5ae0940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:43:38.901873 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1152/2303] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:43:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:43:39.220693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b307efb-8d98-40fe-a8fb-fc6af8703ede service nova] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:43:39.230777 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b307efb-8d98-40fe-a8fb-fc6af8703ede service nova] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:43:39.234352 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dac40d-ef76-4931-87f9-07bccead11ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:43:39.234997 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dac40d-ef76-4931-87f9-07bccead11ca service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:43:39.235273 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dac40d-ef76-4931-87f9-07bccead11ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:43:39.235541 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dac40d-ef76-4931-87f9-07bccead11ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:43:39.237278 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d6dac40d-ef76-4931-87f9-07bccead11ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:43:39.247229 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dac40d-ef76-4931-87f9-07bccead11ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:43:39.248657 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dac40d-ef76-4931-87f9-07bccead11ca service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:43:39.257210 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1152/2304] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:43:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:43:44.676372 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb3594c-daaa-4a45-8fac-24ced5ae0940 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:43:44.678887 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-7cb3594c-daaa-4a45-8fac-24ced5ae0940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:43:44.744135 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb3594c-daaa-4a45-8fac-24ced5ae0940 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:43:44.748538 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99b8e4-c654-4bc4-a32c-9f63c0194b00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:43:44.749214 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99b8e4-c654-4bc4-a32c-9f63c0194b00 service cinder] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:43:44.749493 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99b8e4-c654-4bc4-a32c-9f63c0194b00 service cinder] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:43:44.749766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99b8e4-c654-4bc4-a32c-9f63c0194b00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:43:44.751736 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-6c99b8e4-c654-4bc4-a32c-9f63c0194b00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:43:44.764654 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99b8e4-c654-4bc4-a32c-9f63c0194b00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:43:44.766108 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99b8e4-c654-4bc4-a32c-9f63c0194b00 service cinder] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:43:44.775591 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1153/2305] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:43:44 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:43:49.253401 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=27 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:43:54.771812 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=29 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:43:55.132635 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dac40d-ef76-4931-87f9-07bccead11ca service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:43:55.134322 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d6dac40d-ef76-4931-87f9-07bccead11ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:43:55.152335 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dac40d-ef76-4931-87f9-07bccead11ca service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:43:55.158635 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798e74a-dd4d-4e09-a1f1-e6eeb0290f9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:43:55.159415 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798e74a-dd4d-4e09-a1f1-e6eeb0290f9b service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:43:55.159756 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798e74a-dd4d-4e09-a1f1-e6eeb0290f9b service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:43:55.160030 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798e74a-dd4d-4e09-a1f1-e6eeb0290f9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:43:55.162028 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7798e74a-dd4d-4e09-a1f1-e6eeb0290f9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:43:55.180164 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798e74a-dd4d-4e09-a1f1-e6eeb0290f9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:43:55.181817 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798e74a-dd4d-4e09-a1f1-e6eeb0290f9b service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:43:55.195869 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1153/2306] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:43:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:44:05.189799 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=6 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:44:05.924650 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99b8e4-c654-4bc4-a32c-9f63c0194b00 service cinder] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:05.934698 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99b8e4-c654-4bc4-a32c-9f63c0194b00 service cinder] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:05.939511 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4491b-2ec8-4fb8-b8e7-3aa0e392f9d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:05.940245 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4491b-2ec8-4fb8-b8e7-3aa0e392f9d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:05.940632 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4491b-2ec8-4fb8-b8e7-3aa0e392f9d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:05.940967 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4491b-2ec8-4fb8-b8e7-3aa0e392f9d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:05.943801 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-5ed4491b-2ec8-4fb8-b8e7-3aa0e392f9d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:06.010513 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4491b-2ec8-4fb8-b8e7-3aa0e392f9d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:06.011954 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4491b-2ec8-4fb8-b8e7-3aa0e392f9d9 service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:06.021944 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1154/2307] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:44:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:44:10.006111 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798e74a-dd4d-4e09-a1f1-e6eeb0290f9b service nova] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:10.007644 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7798e74a-dd4d-4e09-a1f1-e6eeb0290f9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:10.023518 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798e74a-dd4d-4e09-a1f1-e6eeb0290f9b service nova] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:10.028879 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6be92-d434-41ea-adad-c54e54fa4aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:10.029797 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6be92-d434-41ea-adad-c54e54fa4aff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:10.030091 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6be92-d434-41ea-adad-c54e54fa4aff admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:10.030371 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6be92-d434-41ea-adad-c54e54fa4aff admin admin] PATH_INFO: `/v3/users/9a6b1637ae344e6fa593b0aa10c003d3` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:10.032986 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d6be92-d434-41ea-adad-c54e54fa4aff admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a6b1637ae344e6fa593b0aa10c003d3)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:10.035068 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d6be92-d434-41ea-adad-c54e54fa4aff admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:10.084825 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c3d6be92-d434-41ea-adad-c54e54fa4aff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a6b1637ae344e6fa593b0aa10c003d3'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:10.085756 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c3d6be92-d434-41ea-adad-c54e54fa4aff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a6b1637ae344e6fa593b0aa10c003d3'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:10.093864 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c3d6be92-d434-41ea-adad-c54e54fa4aff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a6b1637ae344e6fa593b0aa10c003d3'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:10.106149 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c3d6be92-d434-41ea-adad-c54e54fa4aff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a6b1637ae344e6fa593b0aa10c003d3'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:10.117266 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c3d6be92-d434-41ea-adad-c54e54fa4aff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a6b1637ae344e6fa593b0aa10c003d3'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:10.123371 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1154/2308] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:44:10 2022] DELETE /identity/v3/users/9a6b1637ae344e6fa593b0aa10c003d3 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:44:10.305269 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4491b-2ec8-4fb8-b8e7-3aa0e392f9d9 service neutron] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:10.321188 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4491b-2ec8-4fb8-b8e7-3aa0e392f9d9 service neutron] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:10.401421 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b496baf-75dd-40eb-a29f-a290c7e80d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:10.402383 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b496baf-75dd-40eb-a29f-a290c7e80d35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:10.402617 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b496baf-75dd-40eb-a29f-a290c7e80d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:10.402890 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b496baf-75dd-40eb-a29f-a290c7e80d35 admin admin] PATH_INFO: `/v3/projects/3daa5e049f97475bb8adf78342e2510c` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:10.404161 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b496baf-75dd-40eb-a29f-a290c7e80d35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3daa5e049f97475bb8adf78342e2510c)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:10.406154 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b496baf-75dd-40eb-a29f-a290c7e80d35 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:10.458781 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-6b496baf-75dd-40eb-a29f-a290c7e80d35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3daa5e049f97475bb8adf78342e2510c', 'request_id': 'req-6b496baf-75dd-40eb-a29f-a290c7e80d35'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:10.468052 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-6b496baf-75dd-40eb-a29f-a290c7e80d35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3daa5e049f97475bb8adf78342e2510c', 'request_id': 'req-6b496baf-75dd-40eb-a29f-a290c7e80d35'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:10.473729 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-6b496baf-75dd-40eb-a29f-a290c7e80d35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3daa5e049f97475bb8adf78342e2510c', 'request_id': 'req-6b496baf-75dd-40eb-a29f-a290c7e80d35'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:10.485323 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-6b496baf-75dd-40eb-a29f-a290c7e80d35 admin admin] The token cache is being invalidate because project 3daa5e049f97475bb8adf78342e2510c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80150) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:44:10.485609 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-6b496baf-75dd-40eb-a29f-a290c7e80d35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:10.486295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-6b496baf-75dd-40eb-a29f-a290c7e80d35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:10.487851 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1155/2309] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:44:10 2022] DELETE /identity/v3/projects/3daa5e049f97475bb8adf78342e2510c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:44:10.492894 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519273f-3f2b-4903-81d8-e5af02edd905 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:10.493197 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519273f-3f2b-4903-81d8-e5af02edd905 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:10.493470 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519273f-3f2b-4903-81d8-e5af02edd905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:10.512025 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-a519273f-3f2b-4903-81d8-e5af02edd905 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:44:10.513851 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a519273f-3f2b-4903-81d8-e5af02edd905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:10.576795 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1155/2310] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:44:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:44:10.585485 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee21777-5c51-4e12-b45f-91055f938246 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:10.585753 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee21777-5c51-4e12-b45f-91055f938246 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:10.586097 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee21777-5c51-4e12-b45f-91055f938246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:10.604958 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-3ee21777-5c51-4e12-b45f-91055f938246 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:44:10.606225 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-3ee21777-5c51-4e12-b45f-91055f938246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:10.615572 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1156/2311] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:44:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:44:10.620037 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519273f-3f2b-4903-81d8-e5af02edd905 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:10.629993 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519273f-3f2b-4903-81d8-e5af02edd905 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:10.635112 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502683f6-cd39-4819-9e9c-6d3bd3a79033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:10.635772 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502683f6-cd39-4819-9e9c-6d3bd3a79033 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:10.636060 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502683f6-cd39-4819-9e9c-6d3bd3a79033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:10.636330 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502683f6-cd39-4819-9e9c-6d3bd3a79033 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:10.637059 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502683f6-cd39-4819-9e9c-6d3bd3a79033 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:44:10.637365 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502683f6-cd39-4819-9e9c-6d3bd3a79033 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:10.638994 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502683f6-cd39-4819-9e9c-6d3bd3a79033 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:10.651040 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1156/2312] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:44:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:44:10.655459 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee21777-5c51-4e12-b45f-91055f938246 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:10.665612 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee21777-5c51-4e12-b45f-91055f938246 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:10.671500 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa3500-e0b1-4ee8-84d7-158b8d0069ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:10.672159 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa3500-e0b1-4ee8-84d7-158b8d0069ac admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:10.672440 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa3500-e0b1-4ee8-84d7-158b8d0069ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:10.672711 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa3500-e0b1-4ee8-84d7-158b8d0069ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:10.673410 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa3500-e0b1-4ee8-84d7-158b8d0069ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:10.675451 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa3500-e0b1-4ee8-84d7-158b8d0069ac admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:10.689880 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:44:10.706132 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1157/2313] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:44:10 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:44:10.710045 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502683f6-cd39-4819-9e9c-6d3bd3a79033 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:10.720095 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502683f6-cd39-4819-9e9c-6d3bd3a79033 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:10.780618 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc005d-f51b-4928-8d80-69eece41036d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:10.781316 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc005d-f51b-4928-8d80-69eece41036d admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:10.781601 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc005d-f51b-4928-8d80-69eece41036d admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:10.781905 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc005d-f51b-4928-8d80-69eece41036d admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:10.782605 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc005d-f51b-4928-8d80-69eece41036d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:10.784540 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc005d-f51b-4928-8d80-69eece41036d admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:10.791256 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:44:10.808643 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1157/2314] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:44:10 2022] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:44:10.813023 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa3500-e0b1-4ee8-84d7-158b8d0069ac admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:10.824147 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa3500-e0b1-4ee8-84d7-158b8d0069ac admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:10.829337 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284efdf9-1f87-4a6e-bcd0-220e62ac2cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:10.830021 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284efdf9-1f87-4a6e-bcd0-220e62ac2cbf admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:10.830307 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284efdf9-1f87-4a6e-bcd0-220e62ac2cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:10.830578 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284efdf9-1f87-4a6e-bcd0-220e62ac2cbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:10.831274 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284efdf9-1f87-4a6e-bcd0-220e62ac2cbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:10.832915 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284efdf9-1f87-4a6e-bcd0-220e62ac2cbf admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:10.843964 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1158/2315] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:44:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:44:10.848073 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc005d-f51b-4928-8d80-69eece41036d admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:10.858770 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc005d-f51b-4928-8d80-69eece41036d admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:10.863940 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aed281-15f2-4919-8557-5c0236ea2b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:10.864615 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aed281-15f2-4919-8557-5c0236ea2b41 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:10.864896 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aed281-15f2-4919-8557-5c0236ea2b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:10.865168 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aed281-15f2-4919-8557-5c0236ea2b41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:10.865973 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aed281-15f2-4919-8557-5c0236ea2b41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:10.867682 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aed281-15f2-4919-8557-5c0236ea2b41 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:10.878460 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1158/2316] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:44:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:44:10.883231 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284efdf9-1f87-4a6e-bcd0-220e62ac2cbf admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:10.894034 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284efdf9-1f87-4a6e-bcd0-220e62ac2cbf admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:10.899351 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8607a-a2ed-466a-8ac7-fab106c8c255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:10.900254 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8607a-a2ed-466a-8ac7-fab106c8c255 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:10.900536 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8607a-a2ed-466a-8ac7-fab106c8c255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:10.900812 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8607a-a2ed-466a-8ac7-fab106c8c255 admin admin] PATH_INFO: `/v3/projects/bedaadf3723640aeb1371d9822aaf119/users/a4bcfe1dcaf249389e2d1ecde8fd38a5/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:10.917000 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af8607a-a2ed-466a-8ac7-fab106c8c255 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bedaadf3723640aeb1371d9822aaf119, user_id=a4bcfe1dcaf249389e2d1ecde8fd38a5, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:10.919742 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af8607a-a2ed-466a-8ac7-fab106c8c255 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:10.935324 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1159/2317] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:44:10 2022] PUT /identity/v3/projects/bedaadf3723640aeb1371d9822aaf119/users/a4bcfe1dcaf249389e2d1ecde8fd38a5/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:44:10.947105 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c143d9-7234-4d3a-824c-90e0a4f5ffa8 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:10.947397 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c143d9-7234-4d3a-824c-90e0a4f5ffa8 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:10.947676 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c143d9-7234-4d3a-824c-90e0a4f5ffa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:10.974783 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-01c143d9-7234-4d3a-824c-90e0a4f5ffa8 None None] MFA Rules not processed for user `a4bcfe1dcaf249389e2d1ecde8fd38a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:44:10.975989 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-01c143d9-7234-4d3a-824c-90e0a4f5ffa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:11.044849 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1159/2318] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:44:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:44:11.056551 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8607a-a2ed-466a-8ac7-fab106c8c255 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:11.058442 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-8af8607a-a2ed-466a-8ac7-fab106c8c255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:11.136389 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8607a-a2ed-466a-8ac7-fab106c8c255 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:11.143081 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261432c-1aec-4329-bdc1-3c063140a1f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:11.143728 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261432c-1aec-4329-bdc1-3c063140a1f3 service nova] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:11.144014 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261432c-1aec-4329-bdc1-3c063140a1f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:11.144286 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261432c-1aec-4329-bdc1-3c063140a1f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:11.152713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5261432c-1aec-4329-bdc1-3c063140a1f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:11.154332 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5261432c-1aec-4329-bdc1-3c063140a1f3 service nova] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:11.163582 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1160/2319] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:44:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:44:11.277352 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c143d9-7234-4d3a-824c-90e0a4f5ffa8 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:11.278849 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-01c143d9-7234-4d3a-824c-90e0a4f5ffa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:11.345363 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c143d9-7234-4d3a-824c-90e0a4f5ffa8 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:11.349613 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606cbbf-b94b-40b3-9fce-e47b3caf20fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:11.350702 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606cbbf-b94b-40b3-9fce-e47b3caf20fc service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:11.351052 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606cbbf-b94b-40b3-9fce-e47b3caf20fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:11.351331 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606cbbf-b94b-40b3-9fce-e47b3caf20fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:11.353202 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-0606cbbf-b94b-40b3-9fce-e47b3caf20fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:11.427215 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0606cbbf-b94b-40b3-9fce-e47b3caf20fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:11.427982 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0606cbbf-b94b-40b3-9fce-e47b3caf20fc service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:11.441123 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1160/2320] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:44:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 17:44:13.835327 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd61e5a-f161-4160-8830-f57dfc39d729 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:13.835864 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd61e5a-f161-4160-8830-f57dfc39d729 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:13.836897 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd61e5a-f161-4160-8830-f57dfc39d729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:13.856643 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-dbd61e5a-f161-4160-8830-f57dfc39d729 None None] MFA Rules not processed for user `b73d09bd7c1e4753a45cfdb00cc5abe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:44:13.857886 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-dbd61e5a-f161-4160-8830-f57dfc39d729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:13.924204 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1161/2321] 10.222.0.27 () {58 vars in 967 bytes} [Fri Jul 15 17:44:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:44:13.987013 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606cbbf-b94b-40b3-9fce-e47b3caf20fc service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:13.987566 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd61e5a-f161-4160-8830-f57dfc39d729 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:13.988566 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-dbd61e5a-f161-4160-8830-f57dfc39d729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:14.013319 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:44:14.047247 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:44:14.055867 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606cbbf-b94b-40b3-9fce-e47b3caf20fc service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:14.060694 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf478b3-03d9-4691-998e-90b973e8f9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:14.062053 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf478b3-03d9-4691-998e-90b973e8f9de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:14.062053 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf478b3-03d9-4691-998e-90b973e8f9de admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:14.062364 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf478b3-03d9-4691-998e-90b973e8f9de admin admin] PATH_INFO: `/v3/users/a4bcfe1dcaf249389e2d1ecde8fd38a5` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:14.064020 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf478b3-03d9-4691-998e-90b973e8f9de admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4bcfe1dcaf249389e2d1ecde8fd38a5)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:14.065726 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf478b3-03d9-4691-998e-90b973e8f9de admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:14.071065 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd61e5a-f161-4160-8830-f57dfc39d729 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:14.076782 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de408650-ee8f-43b4-82fa-d24d550732a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dea565b75784465a8ea073883261d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:14.077541 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de408650-ee8f-43b4-82fa-d24d550732a5 service swift] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:14.078147 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de408650-ee8f-43b4-82fa-d24d550732a5 service swift] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:14.078501 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de408650-ee8f-43b4-82fa-d24d550732a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:14.088168 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de408650-ee8f-43b4-82fa-d24d550732a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:14.089883 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de408650-ee8f-43b4-82fa-d24d550732a5 service swift] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:14.099684 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1162/2322] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Jul 15 17:44:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 15 17:44:14.128707 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-8cf478b3-03d9-4691-998e-90b973e8f9de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4bcfe1dcaf249389e2d1ecde8fd38a5'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:14.129758 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-8cf478b3-03d9-4691-998e-90b973e8f9de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4bcfe1dcaf249389e2d1ecde8fd38a5'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:14.145519 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-8cf478b3-03d9-4691-998e-90b973e8f9de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4bcfe1dcaf249389e2d1ecde8fd38a5'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:14.161627 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-8cf478b3-03d9-4691-998e-90b973e8f9de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4bcfe1dcaf249389e2d1ecde8fd38a5'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:14.176815 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-8cf478b3-03d9-4691-998e-90b973e8f9de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4bcfe1dcaf249389e2d1ecde8fd38a5'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:14.185302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1161/2323] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:44:13 2022] DELETE /identity/v3/users/a4bcfe1dcaf249389e2d1ecde8fd38a5 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:44:14.190798 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba989a69-cfff-4fa4-a16f-b03fb5be1ad3 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:14.191210 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba989a69-cfff-4fa4-a16f-b03fb5be1ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:14.191586 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba989a69-cfff-4fa4-a16f-b03fb5be1ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:14.245146 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-ba989a69-cfff-4fa4-a16f-b03fb5be1ad3 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:44:14.247123 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-ba989a69-cfff-4fa4-a16f-b03fb5be1ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:14.422447 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1163/2324] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:44:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:44:14.430730 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf478b3-03d9-4691-998e-90b973e8f9de admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:14.432353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8cf478b3-03d9-4691-998e-90b973e8f9de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:14.506134 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf478b3-03d9-4691-998e-90b973e8f9de admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:14.514478 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e2391-4351-48a0-aeaf-2fb6e79e7b0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:14.516033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e2391-4351-48a0-aeaf-2fb6e79e7b0e service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:14.516393 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e2391-4351-48a0-aeaf-2fb6e79e7b0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:14.517978 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e2391-4351-48a0-aeaf-2fb6e79e7b0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:14.528579 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900e2391-4351-48a0-aeaf-2fb6e79e7b0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:14.530181 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900e2391-4351-48a0-aeaf-2fb6e79e7b0e service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:14.541526 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1162/2325] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:44:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:44:14.853699 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba989a69-cfff-4fa4-a16f-b03fb5be1ad3 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:14.855359 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-ba989a69-cfff-4fa4-a16f-b03fb5be1ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:14.872653 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba989a69-cfff-4fa4-a16f-b03fb5be1ad3 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:14.879078 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df13aa-bb8e-4885-8ff6-a1355d005a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:14.880462 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df13aa-bb8e-4885-8ff6-a1355d005a68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:14.880846 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df13aa-bb8e-4885-8ff6-a1355d005a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:14.881219 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df13aa-bb8e-4885-8ff6-a1355d005a68 admin admin] PATH_INFO: `/v3/projects/bedaadf3723640aeb1371d9822aaf119` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:14.882595 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df13aa-bb8e-4885-8ff6-a1355d005a68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bedaadf3723640aeb1371d9822aaf119)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:14.885966 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df13aa-bb8e-4885-8ff6-a1355d005a68 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:14.962863 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-16df13aa-bb8e-4885-8ff6-a1355d005a68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bedaadf3723640aeb1371d9822aaf119', 'request_id': 'req-16df13aa-bb8e-4885-8ff6-a1355d005a68'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:14.974778 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-16df13aa-bb8e-4885-8ff6-a1355d005a68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bedaadf3723640aeb1371d9822aaf119', 'request_id': 'req-16df13aa-bb8e-4885-8ff6-a1355d005a68'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:14.982233 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-16df13aa-bb8e-4885-8ff6-a1355d005a68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bedaadf3723640aeb1371d9822aaf119', 'request_id': 'req-16df13aa-bb8e-4885-8ff6-a1355d005a68'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:14.994905 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-16df13aa-bb8e-4885-8ff6-a1355d005a68 admin admin] The token cache is being invalidate because project bedaadf3723640aeb1371d9822aaf119 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80150) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:44:14.995408 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-16df13aa-bb8e-4885-8ff6-a1355d005a68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:14.996071 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-16df13aa-bb8e-4885-8ff6-a1355d005a68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:14.997820 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1164/2326] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:44:14 2022] DELETE /identity/v3/projects/bedaadf3723640aeb1371d9822aaf119 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:44:15.002922 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ac0ad-5917-48e1-a246-3c71db9726f7 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:15.003398 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ac0ad-5917-48e1-a246-3c71db9726f7 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:15.003594 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ac0ad-5917-48e1-a246-3c71db9726f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:15.024490 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-338ac0ad-5917-48e1-a246-3c71db9726f7 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:44:15.025846 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-338ac0ad-5917-48e1-a246-3c71db9726f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:15.076410 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:44:15.099901 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1163/2327] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:44:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:44:15.108221 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc6845-3b5d-449e-8a6b-47b5564a325a None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:15.108221 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc6845-3b5d-449e-8a6b-47b5564a325a None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:15.108539 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc6845-3b5d-449e-8a6b-47b5564a325a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:15.129404 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-aadc6845-3b5d-449e-8a6b-47b5564a325a None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:44:15.130831 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-aadc6845-3b5d-449e-8a6b-47b5564a325a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:15.140253 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1165/2328] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:44:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:44:15.144863 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ac0ad-5917-48e1-a246-3c71db9726f7 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:15.155454 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ac0ad-5917-48e1-a246-3c71db9726f7 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:15.160236 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba9945-60d3-478b-8daa-3dd0762e42e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:15.160990 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba9945-60d3-478b-8daa-3dd0762e42e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:15.161338 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba9945-60d3-478b-8daa-3dd0762e42e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:15.161681 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba9945-60d3-478b-8daa-3dd0762e42e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:15.162523 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba9945-60d3-478b-8daa-3dd0762e42e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:44:15.162831 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba9945-60d3-478b-8daa-3dd0762e42e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:15.164495 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba9945-60d3-478b-8daa-3dd0762e42e2 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:15.177117 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1164/2329] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:44:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:44:15.181453 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc6845-3b5d-449e-8a6b-47b5564a325a None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:15.192070 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc6845-3b5d-449e-8a6b-47b5564a325a None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:15.197242 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b2678-b852-4dca-8d2a-364d0c4b33ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:15.197945 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b2678-b852-4dca-8d2a-364d0c4b33ad admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:15.198344 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b2678-b852-4dca-8d2a-364d0c4b33ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:15.198636 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b2678-b852-4dca-8d2a-364d0c4b33ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:15.199367 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b2678-b852-4dca-8d2a-364d0c4b33ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:15.201306 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b2678-b852-4dca-8d2a-364d0c4b33ad admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:15.231292 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1166/2330] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:44:15 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 17:44:15.235938 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba9945-60d3-478b-8daa-3dd0762e42e2 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:15.248693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba9945-60d3-478b-8daa-3dd0762e42e2 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:15.328067 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d40956-4b6f-4831-a6d7-45a8cc15984c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:15.328787 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d40956-4b6f-4831-a6d7-45a8cc15984c admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:15.329072 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d40956-4b6f-4831-a6d7-45a8cc15984c admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:15.329353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d40956-4b6f-4831-a6d7-45a8cc15984c admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:15.331344 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d40956-4b6f-4831-a6d7-45a8cc15984c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:15.332126 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d40956-4b6f-4831-a6d7-45a8cc15984c admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:15.370865 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b2678-b852-4dca-8d2a-364d0c4b33ad admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:15.371033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1165/2331] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:44:15 2022] POST /identity/v3/users => generated 287 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:44:15.388495 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b2678-b852-4dca-8d2a-364d0c4b33ad admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:15.396563 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced733d-309a-42e2-859e-6ab4a100b857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:15.397632 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced733d-309a-42e2-859e-6ab4a100b857 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:15.399408 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced733d-309a-42e2-859e-6ab4a100b857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:15.399408 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced733d-309a-42e2-859e-6ab4a100b857 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:15.400397 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ced733d-309a-42e2-859e-6ab4a100b857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:15.403014 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ced733d-309a-42e2-859e-6ab4a100b857 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:15.431009 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1167/2332] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:44:15 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:44:15.432983 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d40956-4b6f-4831-a6d7-45a8cc15984c admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:15.444017 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d40956-4b6f-4831-a6d7-45a8cc15984c admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:15.449821 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d06416-8fbb-4f77-8172-2ac4e6882a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:15.450165 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d06416-8fbb-4f77-8172-2ac4e6882a32 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:15.450445 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d06416-8fbb-4f77-8172-2ac4e6882a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:15.452472 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d06416-8fbb-4f77-8172-2ac4e6882a32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:15.453245 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d06416-8fbb-4f77-8172-2ac4e6882a32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:15.454899 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d06416-8fbb-4f77-8172-2ac4e6882a32 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:15.475065 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1166/2333] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:44:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:44:15.480371 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced733d-309a-42e2-859e-6ab4a100b857 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:15.497627 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced733d-309a-42e2-859e-6ab4a100b857 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:15.502944 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcefd125-012e-4b0f-8439-7d587e22f270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:15.503954 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefd125-012e-4b0f-8439-7d587e22f270 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:15.504316 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefd125-012e-4b0f-8439-7d587e22f270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:15.504665 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefd125-012e-4b0f-8439-7d587e22f270 admin admin] PATH_INFO: `/v3/projects/65c525b7088442c6873e4f38ce4c6dee/users/949fd07a28904c47ad09388f0ebb430c/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:15.520222 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcefd125-012e-4b0f-8439-7d587e22f270 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65c525b7088442c6873e4f38ce4c6dee, user_id=949fd07a28904c47ad09388f0ebb430c, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:15.522983 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcefd125-012e-4b0f-8439-7d587e22f270 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:15.535700 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:44:15.541009 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1168/2334] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:44:15 2022] PUT /identity/v3/projects/65c525b7088442c6873e4f38ce4c6dee/users/949fd07a28904c47ad09388f0ebb430c/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:44:15.552225 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabda15-37e4-4b46-aa63-32c6e994f00e None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:15.552520 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabda15-37e4-4b46-aa63-32c6e994f00e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:15.552803 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabda15-37e4-4b46-aa63-32c6e994f00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:15.588041 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-daabda15-37e4-4b46-aa63-32c6e994f00e None None] MFA Rules not processed for user `949fd07a28904c47ad09388f0ebb430c`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:44:15.589332 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-daabda15-37e4-4b46-aa63-32c6e994f00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:15.671521 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1167/2335] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:44:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:44:15.682691 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcefd125-012e-4b0f-8439-7d587e22f270 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:15.684750 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-bcefd125-012e-4b0f-8439-7d587e22f270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:15.783718 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcefd125-012e-4b0f-8439-7d587e22f270 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:15.791238 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0450c9ca-df80-4376-8fc5-ddcfbef7b539 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:15.792045 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450c9ca-df80-4376-8fc5-ddcfbef7b539 service nova] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:15.792372 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450c9ca-df80-4376-8fc5-ddcfbef7b539 service nova] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:15.792715 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450c9ca-df80-4376-8fc5-ddcfbef7b539 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:15.802814 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0450c9ca-df80-4376-8fc5-ddcfbef7b539 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:15.804522 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0450c9ca-df80-4376-8fc5-ddcfbef7b539 service nova] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:15.816438 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1169/2336] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:44:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:44:16.077957 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daabda15-37e4-4b46-aa63-32c6e994f00e None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:16.151217 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:44:16.176294 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daabda15-37e4-4b46-aa63-32c6e994f00e None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:16.182795 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e24c4-145a-4c6b-bb13-8a21f6e2146b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:16.183769 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e24c4-145a-4c6b-bb13-8a21f6e2146b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:16.184022 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e24c4-145a-4c6b-bb13-8a21f6e2146b admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:16.184292 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e24c4-145a-4c6b-bb13-8a21f6e2146b admin admin] PATH_INFO: `/v3/users/949fd07a28904c47ad09388f0ebb430c` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:16.186008 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151e24c4-145a-4c6b-bb13-8a21f6e2146b admin admin] RBAC: Authorizing `identity:delete_user(user_id=949fd07a28904c47ad09388f0ebb430c)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:16.188433 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151e24c4-145a-4c6b-bb13-8a21f6e2146b admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:16.251564 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-151e24c4-145a-4c6b-bb13-8a21f6e2146b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '949fd07a28904c47ad09388f0ebb430c'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:16.252480 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-151e24c4-145a-4c6b-bb13-8a21f6e2146b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '949fd07a28904c47ad09388f0ebb430c'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:16.260660 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-151e24c4-145a-4c6b-bb13-8a21f6e2146b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '949fd07a28904c47ad09388f0ebb430c'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:16.275856 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-151e24c4-145a-4c6b-bb13-8a21f6e2146b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '949fd07a28904c47ad09388f0ebb430c'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:16.284744 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-151e24c4-145a-4c6b-bb13-8a21f6e2146b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '949fd07a28904c47ad09388f0ebb430c'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:16.292007 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1168/2337] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:44:16 2022] DELETE /identity/v3/users/949fd07a28904c47ad09388f0ebb430c => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:44:16.296591 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749c5ac-fc0a-426a-a918-83d3dadc2d44 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:16.297110 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749c5ac-fc0a-426a-a918-83d3dadc2d44 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:16.297222 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749c5ac-fc0a-426a-a918-83d3dadc2d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:16.325462 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-6749c5ac-fc0a-426a-a918-83d3dadc2d44 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:44:16.326763 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-6749c5ac-fc0a-426a-a918-83d3dadc2d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:16.422466 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1170/2338] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:44:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:44:16.442388 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e24c4-145a-4c6b-bb13-8a21f6e2146b admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:16.444658 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-151e24c4-145a-4c6b-bb13-8a21f6e2146b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:16.533365 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e24c4-145a-4c6b-bb13-8a21f6e2146b admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:16.536668 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88737302-01f1-4a78-866e-5577add164bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:16.537352 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88737302-01f1-4a78-866e-5577add164bd service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:16.537634 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88737302-01f1-4a78-866e-5577add164bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:16.537943 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88737302-01f1-4a78-866e-5577add164bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:16.548952 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88737302-01f1-4a78-866e-5577add164bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:16.550408 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88737302-01f1-4a78-866e-5577add164bd service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:16.563038 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1169/2339] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:44:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:44:17.406455 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6749c5ac-fc0a-426a-a918-83d3dadc2d44 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:17.409633 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-6749c5ac-fc0a-426a-a918-83d3dadc2d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:17.428124 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6749c5ac-fc0a-426a-a918-83d3dadc2d44 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:17.434112 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ae869-d3cc-4c5e-a890-2494fae602ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:17.435266 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ae869-d3cc-4c5e-a890-2494fae602ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:17.435545 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ae869-d3cc-4c5e-a890-2494fae602ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:17.436030 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ae869-d3cc-4c5e-a890-2494fae602ef admin admin] PATH_INFO: `/v3/projects/65c525b7088442c6873e4f38ce4c6dee` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:17.437455 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9ae869-d3cc-4c5e-a890-2494fae602ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=65c525b7088442c6873e4f38ce4c6dee)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:17.441345 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9ae869-d3cc-4c5e-a890-2494fae602ef admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:17.501643 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-fe9ae869-d3cc-4c5e-a890-2494fae602ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65c525b7088442c6873e4f38ce4c6dee', 'request_id': 'req-fe9ae869-d3cc-4c5e-a890-2494fae602ef'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:17.513460 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-fe9ae869-d3cc-4c5e-a890-2494fae602ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65c525b7088442c6873e4f38ce4c6dee', 'request_id': 'req-fe9ae869-d3cc-4c5e-a890-2494fae602ef'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:17.522788 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-fe9ae869-d3cc-4c5e-a890-2494fae602ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65c525b7088442c6873e4f38ce4c6dee', 'request_id': 'req-fe9ae869-d3cc-4c5e-a890-2494fae602ef'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:17.534293 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-fe9ae869-d3cc-4c5e-a890-2494fae602ef admin admin] The token cache is being invalidate because project 65c525b7088442c6873e4f38ce4c6dee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80150) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:44:17.534585 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-fe9ae869-d3cc-4c5e-a890-2494fae602ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:17.535929 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-fe9ae869-d3cc-4c5e-a890-2494fae602ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:17.537772 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1171/2340] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:44:17 2022] DELETE /identity/v3/projects/65c525b7088442c6873e4f38ce4c6dee => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:44:17.542859 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6158ee9-a729-4d0f-ae84-6ee5c394a9c3 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:17.543343 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6158ee9-a729-4d0f-ae84-6ee5c394a9c3 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:17.543580 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6158ee9-a729-4d0f-ae84-6ee5c394a9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:17.583228 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-d6158ee9-a729-4d0f-ae84-6ee5c394a9c3 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:44:17.584899 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d6158ee9-a729-4d0f-ae84-6ee5c394a9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:17.665196 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1170/2341] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:44:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:44:17.667269 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce34b0-89f9-4aea-8ccd-cb0da5a84b5c None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:17.667583 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce34b0-89f9-4aea-8ccd-cb0da5a84b5c None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:17.667867 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce34b0-89f9-4aea-8ccd-cb0da5a84b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:17.690193 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-17ce34b0-89f9-4aea-8ccd-cb0da5a84b5c None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:44:17.692128 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-17ce34b0-89f9-4aea-8ccd-cb0da5a84b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:17.711380 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1172/2342] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:44:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:44:17.715871 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6158ee9-a729-4d0f-ae84-6ee5c394a9c3 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:17.720903 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:44:17.728411 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6158ee9-a729-4d0f-ae84-6ee5c394a9c3 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:17.735982 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b55b52-6d36-471a-b38e-5698c44c9d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:17.737171 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b55b52-6d36-471a-b38e-5698c44c9d6b admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:17.737916 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b55b52-6d36-471a-b38e-5698c44c9d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:17.738200 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b55b52-6d36-471a-b38e-5698c44c9d6b admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:17.739112 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b55b52-6d36-471a-b38e-5698c44c9d6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:44:17.739310 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b55b52-6d36-471a-b38e-5698c44c9d6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:17.741007 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b55b52-6d36-471a-b38e-5698c44c9d6b admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:17.768908 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce34b0-89f9-4aea-8ccd-cb0da5a84b5c None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:17.769994 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1171/2343] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:44:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:44:17.774298 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:44:17.780315 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce34b0-89f9-4aea-8ccd-cb0da5a84b5c None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:17.792854 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46924941-9dc2-4449-90c6-9addc6f51486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:17.793806 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46924941-9dc2-4449-90c6-9addc6f51486 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:17.794363 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46924941-9dc2-4449-90c6-9addc6f51486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:17.795090 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46924941-9dc2-4449-90c6-9addc6f51486 admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:17.795837 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46924941-9dc2-4449-90c6-9addc6f51486 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:17.797753 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46924941-9dc2-4449-90c6-9addc6f51486 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:17.830494 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1173/2344] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:44:17 2022] POST /identity/v3/projects => generated 403 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:44:17.834736 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b55b52-6d36-471a-b38e-5698c44c9d6b admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:17.849675 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b55b52-6d36-471a-b38e-5698c44c9d6b admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:17.919178 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d7da9-84d1-4905-923e-ee560b0d722d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:17.919935 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d7da9-84d1-4905-923e-ee560b0d722d admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:17.920312 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d7da9-84d1-4905-923e-ee560b0d722d admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:17.920697 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d7da9-84d1-4905-923e-ee560b0d722d admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:17.921493 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d7da9-84d1-4905-923e-ee560b0d722d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:17.923586 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d7da9-84d1-4905-923e-ee560b0d722d admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:17.948060 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1172/2345] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:44:17 2022] POST /identity/v3/users => generated 302 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 17:44:17.952580 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46924941-9dc2-4449-90c6-9addc6f51486 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:17.967900 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46924941-9dc2-4449-90c6-9addc6f51486 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:17.974968 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3699555-2c85-498d-8b67-fa49d16be294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:17.975721 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3699555-2c85-498d-8b67-fa49d16be294 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:17.976002 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3699555-2c85-498d-8b67-fa49d16be294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:17.976276 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3699555-2c85-498d-8b67-fa49d16be294 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:17.983950 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3699555-2c85-498d-8b67-fa49d16be294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:17.985607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3699555-2c85-498d-8b67-fa49d16be294 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:17.999488 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1174/2346] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 17:44:18.003756 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d7da9-84d1-4905-923e-ee560b0d722d admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:18.015075 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d7da9-84d1-4905-923e-ee560b0d722d admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:18.020622 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558dee86-7f82-442a-b181-107525052d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:18.021401 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558dee86-7f82-442a-b181-107525052d85 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:18.021772 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558dee86-7f82-442a-b181-107525052d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:18.022143 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558dee86-7f82-442a-b181-107525052d85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:18.022899 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558dee86-7f82-442a-b181-107525052d85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:18.024549 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558dee86-7f82-442a-b181-107525052d85 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:18.035833 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1173/2347] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:44:18.040342 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3699555-2c85-498d-8b67-fa49d16be294 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:18.051256 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3699555-2c85-498d-8b67-fa49d16be294 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:18.056677 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd83fd9-2b83-4783-8318-f85ccc39c645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:18.057623 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd83fd9-2b83-4783-8318-f85ccc39c645 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:18.057924 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd83fd9-2b83-4783-8318-f85ccc39c645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:18.058199 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd83fd9-2b83-4783-8318-f85ccc39c645 admin admin] PATH_INFO: `/v3/projects/328ac20a8f3d4bc8bce2c75a87c7cc5b/users/043b17b0f1b1409192dd7994cd799b1f/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:18.075124 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd83fd9-2b83-4783-8318-f85ccc39c645 admin admin] RBAC: Authorizing `identity:create_grant(project_id=328ac20a8f3d4bc8bce2c75a87c7cc5b, user_id=043b17b0f1b1409192dd7994cd799b1f, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:18.078000 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd83fd9-2b83-4783-8318-f85ccc39c645 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:18.093123 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1175/2348] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:44:18 2022] PUT /identity/v3/projects/328ac20a8f3d4bc8bce2c75a87c7cc5b/users/043b17b0f1b1409192dd7994cd799b1f/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:44:18.103619 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e23ce2-ed4a-49a0-a143-b4e533066750 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:18.103908 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e23ce2-ed4a-49a0-a143-b4e533066750 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:18.104181 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e23ce2-ed4a-49a0-a143-b4e533066750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:18.159738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-33e23ce2-ed4a-49a0-a143-b4e533066750 None None] MFA Rules not processed for user `043b17b0f1b1409192dd7994cd799b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:44:18.161707 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-33e23ce2-ed4a-49a0-a143-b4e533066750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:18.240529 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1174/2349] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:44:18 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:44:18.245278 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd83fd9-2b83-4783-8318-f85ccc39c645 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:18.363862 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8e977-bb9e-47a9-95bf-278dd55e9a2a None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:18.364150 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8e977-bb9e-47a9-95bf-278dd55e9a2a None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:18.364425 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8e977-bb9e-47a9-95bf-278dd55e9a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:18.374108 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd83fd9-2b83-4783-8318-f85ccc39c645 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:18.382572 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a4b87-4907-4c6a-934c-5766db93004b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:18.383599 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a4b87-4907-4c6a-934c-5766db93004b admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:18.383781 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a4b87-4907-4c6a-934c-5766db93004b admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:18.384048 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a4b87-4907-4c6a-934c-5766db93004b admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:18.384831 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a4b87-4907-4c6a-934c-5766db93004b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:18.389674 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-a3c8e977-bb9e-47a9-95bf-278dd55e9a2a None None] MFA Rules not processed for user `9925dde3c53843e48e59cf353a857956`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:44:18.390370 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a4b87-4907-4c6a-934c-5766db93004b admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:18.391115 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a3c8e977-bb9e-47a9-95bf-278dd55e9a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:18.450333 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1176/2350] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:44:18 2022] POST /identity/v3/projects => generated 405 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:44:18.455483 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a4b87-4907-4c6a-934c-5766db93004b admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:18.500638 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1175/2351] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:44:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:44:18.560934 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a4b87-4907-4c6a-934c-5766db93004b admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:18.577765 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e3b2f-ebd5-483f-b318-7cceafa84d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:18.578765 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e3b2f-ebd5-483f-b318-7cceafa84d7e admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:18.579125 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e3b2f-ebd5-483f-b318-7cceafa84d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:18.579473 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e3b2f-ebd5-483f-b318-7cceafa84d7e admin admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:18.580316 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e3b2f-ebd5-483f-b318-7cceafa84d7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:18.582894 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e3b2f-ebd5-483f-b318-7cceafa84d7e admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:18.616464 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1177/2352] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:44:18 2022] POST /identity/v3/users => generated 309 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:44:18.617841 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8e977-bb9e-47a9-95bf-278dd55e9a2a None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:18.623431 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:44:18.640293 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8e977-bb9e-47a9-95bf-278dd55e9a2a None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:18.644867 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a1330-f6fe-47fa-96b1-ae46be074b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:18.645534 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a1330-f6fe-47fa-96b1-ae46be074b04 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:18.645879 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a1330-f6fe-47fa-96b1-ae46be074b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:18.646239 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a1330-f6fe-47fa-96b1-ae46be074b04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:18.646972 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a1330-f6fe-47fa-96b1-ae46be074b04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:18.648610 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a1330-f6fe-47fa-96b1-ae46be074b04 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:18.663479 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1176/2353] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:44:18.664590 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e3b2f-ebd5-483f-b318-7cceafa84d7e admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:18.675654 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e3b2f-ebd5-483f-b318-7cceafa84d7e admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:18.681051 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd3f9e-4578-4692-bd0e-0ba9c8380a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:18.681984 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd3f9e-4578-4692-bd0e-0ba9c8380a2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:18.682262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd3f9e-4578-4692-bd0e-0ba9c8380a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:18.682529 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd3f9e-4578-4692-bd0e-0ba9c8380a2c admin admin] PATH_INFO: `/v3/projects/e293e02fdb944ac4a53b99b4a14aaf85/users/fc2ec6590e9241eeadcaac751718aaf5/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:18.701636 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd3f9e-4578-4692-bd0e-0ba9c8380a2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e293e02fdb944ac4a53b99b4a14aaf85, user_id=fc2ec6590e9241eeadcaac751718aaf5, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:18.704274 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd3f9e-4578-4692-bd0e-0ba9c8380a2c admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:18.709816 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:44:18.727262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1178/2354] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:44:18 2022] PUT /identity/v3/projects/e293e02fdb944ac4a53b99b4a14aaf85/users/fc2ec6590e9241eeadcaac751718aaf5/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:44:18.728340 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a1330-f6fe-47fa-96b1-ae46be074b04 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:18.751307 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a1330-f6fe-47fa-96b1-ae46be074b04 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:18.821369 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de6e49-7ea8-4f08-8b34-ad97a9902860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:18.822150 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de6e49-7ea8-4f08-8b34-ad97a9902860 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:18.822409 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de6e49-7ea8-4f08-8b34-ad97a9902860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:18.822684 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de6e49-7ea8-4f08-8b34-ad97a9902860 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:18.823455 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9de6e49-7ea8-4f08-8b34-ad97a9902860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:18.825172 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9de6e49-7ea8-4f08-8b34-ad97a9902860 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:18.825703 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd3f9e-4578-4692-bd0e-0ba9c8380a2c admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:18.828237 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-68cd3f9e-4578-4692-bd0e-0ba9c8380a2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:18.837972 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1177/2355] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 17:44:18.841734 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de6e49-7ea8-4f08-8b34-ad97a9902860 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:18.852947 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de6e49-7ea8-4f08-8b34-ad97a9902860 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:18.864523 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30838a-3fc7-4c57-ab71-c4912e8b9304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:18.865442 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30838a-3fc7-4c57-ab71-c4912e8b9304 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:18.865727 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30838a-3fc7-4c57-ab71-c4912e8b9304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:18.866056 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30838a-3fc7-4c57-ab71-c4912e8b9304 admin admin] PATH_INFO: `/v3/projects/e293e02fdb944ac4a53b99b4a14aaf85/users/fc2ec6590e9241eeadcaac751718aaf5/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:18.868323 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30838a-3fc7-4c57-ab71-c4912e8b9304 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e293e02fdb944ac4a53b99b4a14aaf85, user_id=fc2ec6590e9241eeadcaac751718aaf5, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:18.871131 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30838a-3fc7-4c57-ab71-c4912e8b9304 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:18.893736 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1178/2356] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:44:18 2022] PUT /identity/v3/projects/e293e02fdb944ac4a53b99b4a14aaf85/users/fc2ec6590e9241eeadcaac751718aaf5/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:44:18.906986 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc2af2-776c-42b2-ae10-f4c04dde49a3 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:18.907344 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc2af2-776c-42b2-ae10-f4c04dde49a3 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:18.907690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc2af2-776c-42b2-ae10-f4c04dde49a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:18.923662 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd3f9e-4578-4692-bd0e-0ba9c8380a2c admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:18.952817 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-7ecc2af2-776c-42b2-ae10-f4c04dde49a3 None None] MFA Rules not processed for user `fc2ec6590e9241eeadcaac751718aaf5`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:44:18.954193 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7ecc2af2-776c-42b2-ae10-f4c04dde49a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:19.015830 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee1bdb-d017-43ef-80ce-6cf7af30836c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96b2105f8d29443383ed51a8fd5cec6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:19.016208 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee1bdb-d017-43ef-80ce-6cf7af30836c service placement] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:19.016722 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee1bdb-d017-43ef-80ce-6cf7af30836c service placement] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:19.016845 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee1bdb-d017-43ef-80ce-6cf7af30836c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:19.020384 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-1dee1bdb-d017-43ef-80ce-6cf7af30836c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:19.038843 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dee1bdb-d017-43ef-80ce-6cf7af30836c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:19.041465 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dee1bdb-d017-43ef-80ce-6cf7af30836c service placement] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:19.057650 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1179/2357] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:44:18 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:44:19.059609 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1179/2358] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:44:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 17:44:19.065220 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc2af2-776c-42b2-ae10-f4c04dde49a3 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:19.066843 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7ecc2af2-776c-42b2-ae10-f4c04dde49a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:19.135027 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc2af2-776c-42b2-ae10-f4c04dde49a3 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:19.139024 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f94c7-6aa1-4256-a6af-196863e8e6ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:19.139694 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f94c7-6aa1-4256-a6af-196863e8e6ff service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:19.139990 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f94c7-6aa1-4256-a6af-196863e8e6ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:19.140246 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f94c7-6aa1-4256-a6af-196863e8e6ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:19.150436 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8f94c7-6aa1-4256-a6af-196863e8e6ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:19.151865 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8f94c7-6aa1-4256-a6af-196863e8e6ff service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:19.162136 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1180/2359] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:44:19 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:44:19.311846 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee1bdb-d017-43ef-80ce-6cf7af30836c service placement] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:19.380918 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee1bdb-d017-43ef-80ce-6cf7af30836c service placement] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:19.385958 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9f631-e5d7-4402-a134-a1dd8b8e1665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:19.386856 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9f631-e5d7-4402-a134-a1dd8b8e1665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:19.387133 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9f631-e5d7-4402-a134-a1dd8b8e1665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:19.387399 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9f631-e5d7-4402-a134-a1dd8b8e1665 admin admin] PATH_INFO: `/v3/users/043b17b0f1b1409192dd7994cd799b1f` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:19.388605 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b9f631-e5d7-4402-a134-a1dd8b8e1665 admin admin] RBAC: Authorizing `identity:delete_user(user_id=043b17b0f1b1409192dd7994cd799b1f)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:19.391890 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b9f631-e5d7-4402-a134-a1dd8b8e1665 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:19.441160 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:44:19.460352 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-16b9f631-e5d7-4402-a134-a1dd8b8e1665 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '043b17b0f1b1409192dd7994cd799b1f'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:19.460963 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-16b9f631-e5d7-4402-a134-a1dd8b8e1665 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '043b17b0f1b1409192dd7994cd799b1f'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:19.470245 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-16b9f631-e5d7-4402-a134-a1dd8b8e1665 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '043b17b0f1b1409192dd7994cd799b1f'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:19.471022 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-16b9f631-e5d7-4402-a134-a1dd8b8e1665 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '043b17b0f1b1409192dd7994cd799b1f'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:19.484234 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-16b9f631-e5d7-4402-a134-a1dd8b8e1665 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '043b17b0f1b1409192dd7994cd799b1f'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:19.504322 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1180/2360] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:44:19 2022] DELETE /identity/v3/users/043b17b0f1b1409192dd7994cd799b1f => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:44:19.508660 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f07a0-d88b-4c43-95a1-0f8d5a0610f6 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:19.508946 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f07a0-d88b-4c43-95a1-0f8d5a0610f6 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:19.509256 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f07a0-d88b-4c43-95a1-0f8d5a0610f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:19.515250 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:44:19.529237 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-415f07a0-d88b-4c43-95a1-0f8d5a0610f6 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:44:19.530490 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-415f07a0-d88b-4c43-95a1-0f8d5a0610f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:19.605303 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1181/2361] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:44:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:44:19.611379 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9f631-e5d7-4402-a134-a1dd8b8e1665 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:19.612823 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-16b9f631-e5d7-4402-a134-a1dd8b8e1665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:19.677250 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9f631-e5d7-4402-a134-a1dd8b8e1665 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:19.681055 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769e21c-988c-458c-bb83-9f1876f4e026 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:19.682083 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769e21c-988c-458c-bb83-9f1876f4e026 service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:19.682083 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769e21c-988c-458c-bb83-9f1876f4e026 service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:19.682346 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769e21c-988c-458c-bb83-9f1876f4e026 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:19.692741 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8769e21c-988c-458c-bb83-9f1876f4e026 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:19.694927 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8769e21c-988c-458c-bb83-9f1876f4e026 service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:19.706791 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1181/2362] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:44:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:44:20.009822 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f07a0-d88b-4c43-95a1-0f8d5a0610f6 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:20.013765 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-415f07a0-d88b-4c43-95a1-0f8d5a0610f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:20.038751 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f07a0-d88b-4c43-95a1-0f8d5a0610f6 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:20.044855 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbee4ce-8087-42c4-af6b-83134f10b861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:20.045844 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbee4ce-8087-42c4-af6b-83134f10b861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:20.046174 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbee4ce-8087-42c4-af6b-83134f10b861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:20.046326 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbee4ce-8087-42c4-af6b-83134f10b861 admin admin] PATH_INFO: `/v3/projects/328ac20a8f3d4bc8bce2c75a87c7cc5b` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:20.048036 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbee4ce-8087-42c4-af6b-83134f10b861 admin admin] RBAC: Authorizing `identity:delete_project(project_id=328ac20a8f3d4bc8bce2c75a87c7cc5b)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:20.050743 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbee4ce-8087-42c4-af6b-83134f10b861 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:20.118993 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-2dbee4ce-8087-42c4-af6b-83134f10b861 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '328ac20a8f3d4bc8bce2c75a87c7cc5b', 'request_id': 'req-2dbee4ce-8087-42c4-af6b-83134f10b861'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:20.132656 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-2dbee4ce-8087-42c4-af6b-83134f10b861 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '328ac20a8f3d4bc8bce2c75a87c7cc5b', 'request_id': 'req-2dbee4ce-8087-42c4-af6b-83134f10b861'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:20.143648 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-2dbee4ce-8087-42c4-af6b-83134f10b861 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '328ac20a8f3d4bc8bce2c75a87c7cc5b', 'request_id': 'req-2dbee4ce-8087-42c4-af6b-83134f10b861'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:20.158627 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-2dbee4ce-8087-42c4-af6b-83134f10b861 admin admin] The token cache is being invalidate because project 328ac20a8f3d4bc8bce2c75a87c7cc5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:44:20.159318 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-2dbee4ce-8087-42c4-af6b-83134f10b861 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:20.159602 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-2dbee4ce-8087-42c4-af6b-83134f10b861 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:20.166596 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1182/2363] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:44:20 2022] DELETE /identity/v3/projects/328ac20a8f3d4bc8bce2c75a87c7cc5b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:44:20.166822 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769e21c-988c-458c-bb83-9f1876f4e026 service neutron] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:20.178399 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769e21c-988c-458c-bb83-9f1876f4e026 service neutron] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:20.235464 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acf2a9-eaaf-4a51-8ef4-4df429eb3183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:20.236734 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acf2a9-eaaf-4a51-8ef4-4df429eb3183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:20.237169 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acf2a9-eaaf-4a51-8ef4-4df429eb3183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:20.237445 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acf2a9-eaaf-4a51-8ef4-4df429eb3183 admin admin] PATH_INFO: `/v3/users/fc2ec6590e9241eeadcaac751718aaf5` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:20.238682 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93acf2a9-eaaf-4a51-8ef4-4df429eb3183 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc2ec6590e9241eeadcaac751718aaf5)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:20.240668 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93acf2a9-eaaf-4a51-8ef4-4df429eb3183 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:20.289816 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-93acf2a9-eaaf-4a51-8ef4-4df429eb3183 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc2ec6590e9241eeadcaac751718aaf5'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:20.290530 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-93acf2a9-eaaf-4a51-8ef4-4df429eb3183 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc2ec6590e9241eeadcaac751718aaf5'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:20.297107 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:44:20.299827 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-93acf2a9-eaaf-4a51-8ef4-4df429eb3183 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc2ec6590e9241eeadcaac751718aaf5'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:20.300992 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-93acf2a9-eaaf-4a51-8ef4-4df429eb3183 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc2ec6590e9241eeadcaac751718aaf5'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:20.325018 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-93acf2a9-eaaf-4a51-8ef4-4df429eb3183 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc2ec6590e9241eeadcaac751718aaf5'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:20.349094 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1182/2364] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:44:20 2022] DELETE /identity/v3/users/fc2ec6590e9241eeadcaac751718aaf5 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:44:20.765763 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbee4ce-8087-42c4-af6b-83134f10b861 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:20.767250 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-2dbee4ce-8087-42c4-af6b-83134f10b861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:20.786856 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbee4ce-8087-42c4-af6b-83134f10b861 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:20.913276 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be2963-1835-4e7d-8a98-f13aa56221e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:20.914433 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be2963-1835-4e7d-8a98-f13aa56221e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:20.914719 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be2963-1835-4e7d-8a98-f13aa56221e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:20.914992 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be2963-1835-4e7d-8a98-f13aa56221e1 admin admin] PATH_INFO: `/v3/projects/e293e02fdb944ac4a53b99b4a14aaf85` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:20.916273 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be2963-1835-4e7d-8a98-f13aa56221e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e293e02fdb944ac4a53b99b4a14aaf85)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:20.918410 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be2963-1835-4e7d-8a98-f13aa56221e1 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:20.967969 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:44:20.990489 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-31be2963-1835-4e7d-8a98-f13aa56221e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e293e02fdb944ac4a53b99b4a14aaf85', 'request_id': 'req-31be2963-1835-4e7d-8a98-f13aa56221e1'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:21.004546 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-31be2963-1835-4e7d-8a98-f13aa56221e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e293e02fdb944ac4a53b99b4a14aaf85', 'request_id': 'req-31be2963-1835-4e7d-8a98-f13aa56221e1'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:21.027221 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-31be2963-1835-4e7d-8a98-f13aa56221e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e293e02fdb944ac4a53b99b4a14aaf85', 'request_id': 'req-31be2963-1835-4e7d-8a98-f13aa56221e1'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:21.040822 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-31be2963-1835-4e7d-8a98-f13aa56221e1 admin admin] The token cache is being invalidate because project e293e02fdb944ac4a53b99b4a14aaf85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:44:21.041168 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-31be2963-1835-4e7d-8a98-f13aa56221e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:21.041854 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-31be2963-1835-4e7d-8a98-f13aa56221e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:21.046981 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1183/2365] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:44:20 2022] DELETE /identity/v3/projects/e293e02fdb944ac4a53b99b4a14aaf85 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:44:21.048799 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076d616-4399-4712-915e-5a4837804204 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:21.049256 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076d616-4399-4712-915e-5a4837804204 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:21.049399 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076d616-4399-4712-915e-5a4837804204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:21.070976 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-3076d616-4399-4712-915e-5a4837804204 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:44:21.072456 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-3076d616-4399-4712-915e-5a4837804204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:21.152178 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1183/2366] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:44:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:44:21.154431 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b6406-2ba3-4758-bc74-81f422087ebc None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:21.154881 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b6406-2ba3-4758-bc74-81f422087ebc None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:21.155172 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b6406-2ba3-4758-bc74-81f422087ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:21.176898 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-bf5b6406-2ba3-4758-bc74-81f422087ebc None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:44:21.178224 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-bf5b6406-2ba3-4758-bc74-81f422087ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:21.190114 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1184/2367] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:44:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:44:21.195347 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076d616-4399-4712-915e-5a4837804204 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:21.207819 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076d616-4399-4712-915e-5a4837804204 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:21.213614 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ede966-3bb6-4252-b519-027659b19e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:21.214378 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ede966-3bb6-4252-b519-027659b19e62 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:21.214711 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ede966-3bb6-4252-b519-027659b19e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:21.214984 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ede966-3bb6-4252-b519-027659b19e62 admin admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:21.215726 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ede966-3bb6-4252-b519-027659b19e62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:44:21.216389 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ede966-3bb6-4252-b519-027659b19e62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:21.218066 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ede966-3bb6-4252-b519-027659b19e62 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:21.232454 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1184/2368] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:44:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:44:21.236466 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b6406-2ba3-4758-bc74-81f422087ebc None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:21.247268 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b6406-2ba3-4758-bc74-81f422087ebc None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:21.253826 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5769e0-d182-4a71-aaa1-47e9608acbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:21.254536 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5769e0-d182-4a71-aaa1-47e9608acbb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:21.254820 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5769e0-d182-4a71-aaa1-47e9608acbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:21.255096 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5769e0-d182-4a71-aaa1-47e9608acbb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:21.255813 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5769e0-d182-4a71-aaa1-47e9608acbb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:21.257743 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5769e0-d182-4a71-aaa1-47e9608acbb6 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:21.296974 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1185/2369] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:44:21 2022] POST /identity/v3/projects => generated 365 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:44:21.298185 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ede966-3bb6-4252-b519-027659b19e62 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:21.316074 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ede966-3bb6-4252-b519-027659b19e62 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:21.378896 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe251e71-17bd-439c-9cb2-27be752cb087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:21.379574 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe251e71-17bd-439c-9cb2-27be752cb087 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:21.379852 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe251e71-17bd-439c-9cb2-27be752cb087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:21.380119 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe251e71-17bd-439c-9cb2-27be752cb087 admin admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:21.380841 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe251e71-17bd-439c-9cb2-27be752cb087 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:21.382822 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe251e71-17bd-439c-9cb2-27be752cb087 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:21.406249 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1185/2370] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:44:21 2022] POST /identity/v3/users => generated 283 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 17:44:21.410291 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5769e0-d182-4a71-aaa1-47e9608acbb6 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:21.421010 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5769e0-d182-4a71-aaa1-47e9608acbb6 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:21.426848 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1201aaa-9e42-4b41-b8d5-156cdbf3dec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:21.427553 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1201aaa-9e42-4b41-b8d5-156cdbf3dec1 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:21.427827 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1201aaa-9e42-4b41-b8d5-156cdbf3dec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:21.428142 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1201aaa-9e42-4b41-b8d5-156cdbf3dec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:21.428874 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1201aaa-9e42-4b41-b8d5-156cdbf3dec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:21.430635 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1201aaa-9e42-4b41-b8d5-156cdbf3dec1 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:21.441981 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1186/2371] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:44:21.446830 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe251e71-17bd-439c-9cb2-27be752cb087 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:21.457324 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe251e71-17bd-439c-9cb2-27be752cb087 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:21.462603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7049a498-30b7-45b1-9409-bc9656f21d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:21.463383 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049a498-30b7-45b1-9409-bc9656f21d80 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:21.463691 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049a498-30b7-45b1-9409-bc9656f21d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:21.463958 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049a498-30b7-45b1-9409-bc9656f21d80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:21.464682 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7049a498-30b7-45b1-9409-bc9656f21d80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:21.466345 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7049a498-30b7-45b1-9409-bc9656f21d80 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:21.479805 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1186/2372] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:44:21.481064 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1201aaa-9e42-4b41-b8d5-156cdbf3dec1 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:21.491377 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1201aaa-9e42-4b41-b8d5-156cdbf3dec1 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:21.498468 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3ee61-a777-4f65-aa82-84c14b121490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:21.499430 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3ee61-a777-4f65-aa82-84c14b121490 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:21.499761 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3ee61-a777-4f65-aa82-84c14b121490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:21.500337 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3ee61-a777-4f65-aa82-84c14b121490 admin admin] PATH_INFO: `/v3/projects/ee1beb3ec6964ab684b326869c7b452e/users/7764549246264f21b828691242ae1e59/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:21.519630 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e3ee61-a777-4f65-aa82-84c14b121490 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee1beb3ec6964ab684b326869c7b452e, user_id=7764549246264f21b828691242ae1e59, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:21.522607 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e3ee61-a777-4f65-aa82-84c14b121490 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:21.537341 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1187/2373] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:44:21 2022] PUT /identity/v3/projects/ee1beb3ec6964ab684b326869c7b452e/users/7764549246264f21b828691242ae1e59/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:44:21.548006 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae9340-4f70-4536-9a98-314a545ebfca None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:21.548299 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae9340-4f70-4536-9a98-314a545ebfca None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:21.548577 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae9340-4f70-4536-9a98-314a545ebfca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:21.576228 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-a0ae9340-4f70-4536-9a98-314a545ebfca None None] MFA Rules not processed for user `7764549246264f21b828691242ae1e59`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:44:21.577493 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-a0ae9340-4f70-4536-9a98-314a545ebfca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:21.609808 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:44:21.666637 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3ee61-a777-4f65-aa82-84c14b121490 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:21.671426 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1187/2374] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:44:21 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:44:21.744076 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3ee61-a777-4f65-aa82-84c14b121490 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:21.749834 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dacae43-4b21-4ca4-b3a7-ea14bfe92cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:21.750627 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dacae43-4b21-4ca4-b3a7-ea14bfe92cf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:21.751506 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dacae43-4b21-4ca4-b3a7-ea14bfe92cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:21.752371 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dacae43-4b21-4ca4-b3a7-ea14bfe92cf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:21.752680 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dacae43-4b21-4ca4-b3a7-ea14bfe92cf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:21.754978 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dacae43-4b21-4ca4-b3a7-ea14bfe92cf9 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:21.791059 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1188/2375] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:44:21 2022] POST /identity/v3/projects => generated 365 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:44:21.795328 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae9340-4f70-4536-9a98-314a545ebfca None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:21.807466 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae9340-4f70-4536-9a98-314a545ebfca None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:21.877728 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de42678a-f1b7-4ee4-8e0c-e303b80c2ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:21.878008 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42678a-f1b7-4ee4-8e0c-e303b80c2ff2 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:21.879721 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42678a-f1b7-4ee4-8e0c-e303b80c2ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:21.879721 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42678a-f1b7-4ee4-8e0c-e303b80c2ff2 admin admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:21.879721 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de42678a-f1b7-4ee4-8e0c-e303b80c2ff2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:21.881176 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de42678a-f1b7-4ee4-8e0c-e303b80c2ff2 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:21.905256 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1188/2376] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:44:21 2022] POST /identity/v3/users => generated 289 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:44:21.909244 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dacae43-4b21-4ca4-b3a7-ea14bfe92cf9 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:21.920357 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dacae43-4b21-4ca4-b3a7-ea14bfe92cf9 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:21.925070 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff5663-e2e3-41ce-bc23-2689a42c5aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:21.925744 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff5663-e2e3-41ce-bc23-2689a42c5aef admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:21.926053 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff5663-e2e3-41ce-bc23-2689a42c5aef admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:21.926327 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff5663-e2e3-41ce-bc23-2689a42c5aef admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:21.927055 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff5663-e2e3-41ce-bc23-2689a42c5aef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:21.928664 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff5663-e2e3-41ce-bc23-2689a42c5aef admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:21.941115 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1189/2377] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:44:21.945557 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de42678a-f1b7-4ee4-8e0c-e303b80c2ff2 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:21.956689 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de42678a-f1b7-4ee4-8e0c-e303b80c2ff2 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:21.963485 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3767e9b-54a5-4370-bd07-a5fde4c8df5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:21.964400 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3767e9b-54a5-4370-bd07-a5fde4c8df5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:21.964659 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3767e9b-54a5-4370-bd07-a5fde4c8df5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:21.964962 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3767e9b-54a5-4370-bd07-a5fde4c8df5e admin admin] PATH_INFO: `/v3/projects/b7f3b51bf7db4d7393b4e5e4cdf2c014/users/4d6e981af51b4150949556d539e915ad/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:21.984914 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3767e9b-54a5-4370-bd07-a5fde4c8df5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7f3b51bf7db4d7393b4e5e4cdf2c014, user_id=4d6e981af51b4150949556d539e915ad, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:21.987726 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3767e9b-54a5-4370-bd07-a5fde4c8df5e admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:22.007771 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1189/2378] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:44:21 2022] PUT /identity/v3/projects/b7f3b51bf7db4d7393b4e5e4cdf2c014/users/4d6e981af51b4150949556d539e915ad/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:44:22.013218 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff5663-e2e3-41ce-bc23-2689a42c5aef admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:22.025267 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff5663-e2e3-41ce-bc23-2689a42c5aef admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:22.055067 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:44:22.103469 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f6bd2d-81dd-40c3-ba82-cd31dde5f805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:22.104359 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6bd2d-81dd-40c3-ba82-cd31dde5f805 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:22.104747 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6bd2d-81dd-40c3-ba82-cd31dde5f805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:22.105091 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6bd2d-81dd-40c3-ba82-cd31dde5f805 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:22.105968 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f6bd2d-81dd-40c3-ba82-cd31dde5f805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:22.107753 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f6bd2d-81dd-40c3-ba82-cd31dde5f805 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:22.120639 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1190/2379] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:44:22.124972 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3767e9b-54a5-4370-bd07-a5fde4c8df5e admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:22.138648 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3767e9b-54a5-4370-bd07-a5fde4c8df5e admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:22.143707 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d503e7-e218-4127-bdfe-db8192e630db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:22.145677 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d503e7-e218-4127-bdfe-db8192e630db admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:22.145677 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d503e7-e218-4127-bdfe-db8192e630db admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:22.145677 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d503e7-e218-4127-bdfe-db8192e630db admin admin] PATH_INFO: `/v3/projects/b7f3b51bf7db4d7393b4e5e4cdf2c014/users/4d6e981af51b4150949556d539e915ad/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:22.147375 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d503e7-e218-4127-bdfe-db8192e630db admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7f3b51bf7db4d7393b4e5e4cdf2c014, user_id=4d6e981af51b4150949556d539e915ad, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:22.151576 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d503e7-e218-4127-bdfe-db8192e630db admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:22.163360 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1190/2380] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:44:22 2022] PUT /identity/v3/projects/b7f3b51bf7db4d7393b4e5e4cdf2c014/users/4d6e981af51b4150949556d539e915ad/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:44:22.175401 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f59f7d-0edb-4eb6-8ebf-9e8928d20ae7 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:22.175691 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f59f7d-0edb-4eb6-8ebf-9e8928d20ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:22.175972 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f59f7d-0edb-4eb6-8ebf-9e8928d20ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:22.207272 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-05f59f7d-0edb-4eb6-8ebf-9e8928d20ae7 None None] MFA Rules not processed for user `4d6e981af51b4150949556d539e915ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:44:22.208542 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-05f59f7d-0edb-4eb6-8ebf-9e8928d20ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:22.308918 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1191/2381] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:44:22 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:44:22.326570 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d503e7-e218-4127-bdfe-db8192e630db admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:22.328545 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-e1d503e7-e218-4127-bdfe-db8192e630db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:22.396754 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d503e7-e218-4127-bdfe-db8192e630db admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:22.400579 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d276eb38-19d4-4118-bbd2-6e3e077f99cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:22.401301 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276eb38-19d4-4118-bbd2-6e3e077f99cb service cinder] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:22.401581 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276eb38-19d4-4118-bbd2-6e3e077f99cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:22.401889 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276eb38-19d4-4118-bbd2-6e3e077f99cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:22.411027 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d276eb38-19d4-4118-bbd2-6e3e077f99cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:22.412451 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d276eb38-19d4-4118-bbd2-6e3e077f99cb service cinder] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:22.422559 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1191/2382] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:44:22 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:44:22.943443 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f59f7d-0edb-4eb6-8ebf-9e8928d20ae7 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:23.063372 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f59f7d-0edb-4eb6-8ebf-9e8928d20ae7 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:23.086616 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421d329-c3ca-452a-84ef-4d104ceb2608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:23.087503 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421d329-c3ca-452a-84ef-4d104ceb2608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:23.087788 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421d329-c3ca-452a-84ef-4d104ceb2608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:23.088065 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421d329-c3ca-452a-84ef-4d104ceb2608 admin admin] PATH_INFO: `/v3/users/7764549246264f21b828691242ae1e59` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:23.089349 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6421d329-c3ca-452a-84ef-4d104ceb2608 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7764549246264f21b828691242ae1e59)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:23.091346 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6421d329-c3ca-452a-84ef-4d104ceb2608 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:23.181734 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6421d329-c3ca-452a-84ef-4d104ceb2608 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7764549246264f21b828691242ae1e59'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:23.182503 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6421d329-c3ca-452a-84ef-4d104ceb2608 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7764549246264f21b828691242ae1e59'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:23.185582 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:44:23.195067 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6421d329-c3ca-452a-84ef-4d104ceb2608 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7764549246264f21b828691242ae1e59'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:23.212050 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6421d329-c3ca-452a-84ef-4d104ceb2608 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7764549246264f21b828691242ae1e59'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:23.224107 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6421d329-c3ca-452a-84ef-4d104ceb2608 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7764549246264f21b828691242ae1e59'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:23.247694 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1192/2383] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:44:22 2022] DELETE /identity/v3/users/7764549246264f21b828691242ae1e59 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:44:23.252303 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29736c-0bb3-4c6d-a6a6-6bea0461ef95 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:23.253328 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29736c-0bb3-4c6d-a6a6-6bea0461ef95 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:23.253832 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29736c-0bb3-4c6d-a6a6-6bea0461ef95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:23.287125 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-1f29736c-0bb3-4c6d-a6a6-6bea0461ef95 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:44:23.288295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-1f29736c-0bb3-4c6d-a6a6-6bea0461ef95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:23.327564 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:44:23.423521 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1192/2384] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:44:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:44:23.452038 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421d329-c3ca-452a-84ef-4d104ceb2608 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:23.453952 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-6421d329-c3ca-452a-84ef-4d104ceb2608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:23.549058 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421d329-c3ca-452a-84ef-4d104ceb2608 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:23.552751 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed550d-9e3d-4e05-86c3-7d141b63dff8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:23.553402 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed550d-9e3d-4e05-86c3-7d141b63dff8 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:23.553680 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed550d-9e3d-4e05-86c3-7d141b63dff8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:23.553973 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed550d-9e3d-4e05-86c3-7d141b63dff8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:23.565170 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed550d-9e3d-4e05-86c3-7d141b63dff8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:23.566757 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed550d-9e3d-4e05-86c3-7d141b63dff8 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:23.597381 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1193/2385] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:44:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:44:23.680257 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29736c-0bb3-4c6d-a6a6-6bea0461ef95 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:23.681720 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-1f29736c-0bb3-4c6d-a6a6-6bea0461ef95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:23.694726 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29736c-0bb3-4c6d-a6a6-6bea0461ef95 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:23.700842 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b2022d-cd54-4aca-a5ff-430a7c5557a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:23.701888 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2022d-cd54-4aca-a5ff-430a7c5557a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:23.702549 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2022d-cd54-4aca-a5ff-430a7c5557a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:23.702549 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2022d-cd54-4aca-a5ff-430a7c5557a6 admin admin] PATH_INFO: `/v3/users/d7bc0d3f472a4c008cc32b4af5d3def8` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:23.703810 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b2022d-cd54-4aca-a5ff-430a7c5557a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7bc0d3f472a4c008cc32b4af5d3def8)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:23.705886 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b2022d-cd54-4aca-a5ff-430a7c5557a6 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:23.779523 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-79b2022d-cd54-4aca-a5ff-430a7c5557a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7bc0d3f472a4c008cc32b4af5d3def8'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:23.780788 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-79b2022d-cd54-4aca-a5ff-430a7c5557a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7bc0d3f472a4c008cc32b4af5d3def8'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:23.790873 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-79b2022d-cd54-4aca-a5ff-430a7c5557a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7bc0d3f472a4c008cc32b4af5d3def8'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:23.791913 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-79b2022d-cd54-4aca-a5ff-430a7c5557a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7bc0d3f472a4c008cc32b4af5d3def8'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:23.808709 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-79b2022d-cd54-4aca-a5ff-430a7c5557a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7bc0d3f472a4c008cc32b4af5d3def8'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:23.826743 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1193/2386] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:44:23 2022] DELETE /identity/v3/users/d7bc0d3f472a4c008cc32b4af5d3def8 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:44:23.974623 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed550d-9e3d-4e05-86c3-7d141b63dff8 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:23.976101 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-34ed550d-9e3d-4e05-86c3-7d141b63dff8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:23.994326 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed550d-9e3d-4e05-86c3-7d141b63dff8 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:24.024545 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b2022d-cd54-4aca-a5ff-430a7c5557a6 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:24.026031 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-79b2022d-cd54-4aca-a5ff-430a7c5557a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:24.064012 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37e303-50e3-4bc0-bc3a-04ba3c59b3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:24.064843 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37e303-50e3-4bc0-bc3a-04ba3c59b3ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:24.065122 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37e303-50e3-4bc0-bc3a-04ba3c59b3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:24.065474 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37e303-50e3-4bc0-bc3a-04ba3c59b3ae admin admin] PATH_INFO: `/v3/projects/ee1beb3ec6964ab684b326869c7b452e` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:24.066628 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37e303-50e3-4bc0-bc3a-04ba3c59b3ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee1beb3ec6964ab684b326869c7b452e)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:24.068905 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37e303-50e3-4bc0-bc3a-04ba3c59b3ae admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:24.100747 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b2022d-cd54-4aca-a5ff-430a7c5557a6 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:24.105318 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b87321-769d-483b-9a1c-2caf76fa767e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:24.106244 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b87321-769d-483b-9a1c-2caf76fa767e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:24.106504 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b87321-769d-483b-9a1c-2caf76fa767e admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:24.106773 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b87321-769d-483b-9a1c-2caf76fa767e admin admin] PATH_INFO: `/v3/projects/bc55fd9d76d34c459e9d023d3851ea99` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:24.107939 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b87321-769d-483b-9a1c-2caf76fa767e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc55fd9d76d34c459e9d023d3851ea99)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:24.110591 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b87321-769d-483b-9a1c-2caf76fa767e admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:24.119258 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-1d37e303-50e3-4bc0-bc3a-04ba3c59b3ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee1beb3ec6964ab684b326869c7b452e', 'request_id': 'req-1d37e303-50e3-4bc0-bc3a-04ba3c59b3ae'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:24.127589 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-1d37e303-50e3-4bc0-bc3a-04ba3c59b3ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee1beb3ec6964ab684b326869c7b452e', 'request_id': 'req-1d37e303-50e3-4bc0-bc3a-04ba3c59b3ae'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:24.133692 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-1d37e303-50e3-4bc0-bc3a-04ba3c59b3ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee1beb3ec6964ab684b326869c7b452e', 'request_id': 'req-1d37e303-50e3-4bc0-bc3a-04ba3c59b3ae'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:24.142202 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:44:24.147477 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-1d37e303-50e3-4bc0-bc3a-04ba3c59b3ae admin admin] The token cache is being invalidate because project ee1beb3ec6964ab684b326869c7b452e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:44:24.147833 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-1d37e303-50e3-4bc0-bc3a-04ba3c59b3ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:24.148538 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-1d37e303-50e3-4bc0-bc3a-04ba3c59b3ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:24.153403 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1194/2387] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:44:23 2022] DELETE /identity/v3/projects/ee1beb3ec6964ab684b326869c7b452e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:44:24.154091 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:44:24.154604 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37e303-50e3-4bc0-bc3a-04ba3c59b3ae admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:24.156110 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1d37e303-50e3-4bc0-bc3a-04ba3c59b3ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:24.162738 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-e9b87321-769d-483b-9a1c-2caf76fa767e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc55fd9d76d34c459e9d023d3851ea99', 'request_id': 'req-e9b87321-769d-483b-9a1c-2caf76fa767e'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:24.176420 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-e9b87321-769d-483b-9a1c-2caf76fa767e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc55fd9d76d34c459e9d023d3851ea99', 'request_id': 'req-e9b87321-769d-483b-9a1c-2caf76fa767e'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:24.186609 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-e9b87321-769d-483b-9a1c-2caf76fa767e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc55fd9d76d34c459e9d023d3851ea99', 'request_id': 'req-e9b87321-769d-483b-9a1c-2caf76fa767e'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:24.202014 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-e9b87321-769d-483b-9a1c-2caf76fa767e admin admin] The token cache is being invalidate because project bc55fd9d76d34c459e9d023d3851ea99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80150) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:44:24.202386 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-e9b87321-769d-483b-9a1c-2caf76fa767e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:24.202970 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-e9b87321-769d-483b-9a1c-2caf76fa767e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:24.204988 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1194/2388] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:44:24 2022] DELETE /identity/v3/projects/bc55fd9d76d34c459e9d023d3851ea99 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:44:24.209080 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b87321-769d-483b-9a1c-2caf76fa767e admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:24.211088 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-e9b87321-769d-483b-9a1c-2caf76fa767e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:24.239180 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37e303-50e3-4bc0-bc3a-04ba3c59b3ae admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:24.281745 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b87321-769d-483b-9a1c-2caf76fa767e admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:24.286554 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66979236-5532-4b00-8be0-ca04775edcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:24.287453 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66979236-5532-4b00-8be0-ca04775edcee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:24.287731 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66979236-5532-4b00-8be0-ca04775edcee admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:24.288001 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66979236-5532-4b00-8be0-ca04775edcee admin admin] PATH_INFO: `/v3/users/52086a5bcecb4a4bb78e68da18f34cdf` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:24.289378 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66979236-5532-4b00-8be0-ca04775edcee admin admin] RBAC: Authorizing `identity:delete_user(user_id=52086a5bcecb4a4bb78e68da18f34cdf)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:24.291473 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66979236-5532-4b00-8be0-ca04775edcee admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:24.302831 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470755f-2087-44f3-8b90-df30f1e1e518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:24.303840 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470755f-2087-44f3-8b90-df30f1e1e518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:24.304190 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470755f-2087-44f3-8b90-df30f1e1e518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:24.304536 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470755f-2087-44f3-8b90-df30f1e1e518 admin admin] PATH_INFO: `/v3/users/4d6e981af51b4150949556d539e915ad` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:24.306931 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8470755f-2087-44f3-8b90-df30f1e1e518 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d6e981af51b4150949556d539e915ad)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:24.309037 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8470755f-2087-44f3-8b90-df30f1e1e518 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:24.369733 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-8470755f-2087-44f3-8b90-df30f1e1e518 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d6e981af51b4150949556d539e915ad'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:24.370535 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-8470755f-2087-44f3-8b90-df30f1e1e518 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d6e981af51b4150949556d539e915ad'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:24.378192 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-8470755f-2087-44f3-8b90-df30f1e1e518 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d6e981af51b4150949556d539e915ad'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:24.392037 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-8470755f-2087-44f3-8b90-df30f1e1e518 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d6e981af51b4150949556d539e915ad'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:24.404089 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-8470755f-2087-44f3-8b90-df30f1e1e518 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d6e981af51b4150949556d539e915ad'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:24.411476 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1195/2389] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:44:24 2022] DELETE /identity/v3/users/4d6e981af51b4150949556d539e915ad => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:44:24.491054 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-66979236-5532-4b00-8be0-ca04775edcee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52086a5bcecb4a4bb78e68da18f34cdf'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:24.491761 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-66979236-5532-4b00-8be0-ca04775edcee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52086a5bcecb4a4bb78e68da18f34cdf'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:24.500634 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-66979236-5532-4b00-8be0-ca04775edcee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52086a5bcecb4a4bb78e68da18f34cdf'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:24.501490 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-66979236-5532-4b00-8be0-ca04775edcee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52086a5bcecb4a4bb78e68da18f34cdf'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:24.513847 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-66979236-5532-4b00-8be0-ca04775edcee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52086a5bcecb4a4bb78e68da18f34cdf'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:24.529931 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1195/2390] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:44:24 2022] DELETE /identity/v3/users/52086a5bcecb4a4bb78e68da18f34cdf => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:44:24.708655 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470755f-2087-44f3-8b90-df30f1e1e518 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:24.710967 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8470755f-2087-44f3-8b90-df30f1e1e518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:24.720838 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66979236-5532-4b00-8be0-ca04775edcee admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:24.722844 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-66979236-5532-4b00-8be0-ca04775edcee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:24.768342 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:44:24.776884 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:44:24.799296 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66979236-5532-4b00-8be0-ca04775edcee admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:24.803913 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b0d0a-c1c1-4bba-a0f2-d6b81b17de88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:24.804836 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b0d0a-c1c1-4bba-a0f2-d6b81b17de88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:24.805219 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b0d0a-c1c1-4bba-a0f2-d6b81b17de88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:24.805503 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b0d0a-c1c1-4bba-a0f2-d6b81b17de88 admin admin] PATH_INFO: `/v3/projects/76e6318ec089406ba70a79a4f3f10926` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:24.805762 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470755f-2087-44f3-8b90-df30f1e1e518 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:24.806705 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b0d0a-c1c1-4bba-a0f2-d6b81b17de88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76e6318ec089406ba70a79a4f3f10926)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:24.808646 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b0d0a-c1c1-4bba-a0f2-d6b81b17de88 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:24.810780 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41cc0f-0d83-43d4-94d2-4e87daebdfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:24.811680 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41cc0f-0d83-43d4-94d2-4e87daebdfe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:24.811961 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41cc0f-0d83-43d4-94d2-4e87daebdfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:24.812233 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41cc0f-0d83-43d4-94d2-4e87daebdfe4 admin admin] PATH_INFO: `/v3/projects/b7f3b51bf7db4d7393b4e5e4cdf2c014` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:24.813524 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df41cc0f-0d83-43d4-94d2-4e87daebdfe4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7f3b51bf7db4d7393b4e5e4cdf2c014)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:24.815482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df41cc0f-0d83-43d4-94d2-4e87daebdfe4 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:24.857351 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-2f0b0d0a-c1c1-4bba-a0f2-d6b81b17de88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76e6318ec089406ba70a79a4f3f10926', 'request_id': 'req-2f0b0d0a-c1c1-4bba-a0f2-d6b81b17de88'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:24.863092 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-df41cc0f-0d83-43d4-94d2-4e87daebdfe4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7f3b51bf7db4d7393b4e5e4cdf2c014', 'request_id': 'req-df41cc0f-0d83-43d4-94d2-4e87daebdfe4'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:24.866535 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-2f0b0d0a-c1c1-4bba-a0f2-d6b81b17de88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76e6318ec089406ba70a79a4f3f10926', 'request_id': 'req-2f0b0d0a-c1c1-4bba-a0f2-d6b81b17de88'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:24.870796 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-df41cc0f-0d83-43d4-94d2-4e87daebdfe4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7f3b51bf7db4d7393b4e5e4cdf2c014', 'request_id': 'req-df41cc0f-0d83-43d4-94d2-4e87daebdfe4'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:24.873051 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-2f0b0d0a-c1c1-4bba-a0f2-d6b81b17de88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76e6318ec089406ba70a79a4f3f10926', 'request_id': 'req-2f0b0d0a-c1c1-4bba-a0f2-d6b81b17de88'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:24.877117 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-df41cc0f-0d83-43d4-94d2-4e87daebdfe4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7f3b51bf7db4d7393b4e5e4cdf2c014', 'request_id': 'req-df41cc0f-0d83-43d4-94d2-4e87daebdfe4'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:24.884934 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-2f0b0d0a-c1c1-4bba-a0f2-d6b81b17de88 admin admin] The token cache is being invalidate because project 76e6318ec089406ba70a79a4f3f10926 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80150) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:44:24.885218 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-2f0b0d0a-c1c1-4bba-a0f2-d6b81b17de88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:24.885878 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-2f0b0d0a-c1c1-4bba-a0f2-d6b81b17de88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:24.887409 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1196/2391] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:44:24 2022] DELETE /identity/v3/projects/76e6318ec089406ba70a79a4f3f10926 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:44:24.888987 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-df41cc0f-0d83-43d4-94d2-4e87daebdfe4 admin admin] The token cache is being invalidate because project b7f3b51bf7db4d7393b4e5e4cdf2c014 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:44:24.889274 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-df41cc0f-0d83-43d4-94d2-4e87daebdfe4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:24.889938 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-df41cc0f-0d83-43d4-94d2-4e87daebdfe4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:24.891610 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1196/2392] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:44:24 2022] DELETE /identity/v3/projects/b7f3b51bf7db4d7393b4e5e4cdf2c014 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:44:24.897651 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b82166-995c-436d-8e2b-a74a48fb768e None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:24.898028 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b82166-995c-436d-8e2b-a74a48fb768e None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:24.898405 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b82166-995c-436d-8e2b-a74a48fb768e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:24.917883 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-26b82166-995c-436d-8e2b-a74a48fb768e None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:44:24.919055 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-26b82166-995c-436d-8e2b-a74a48fb768e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:24.984278 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1197/2393] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:44:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:44:24.992719 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083a609-b790-45d1-ad2c-4467f964966f None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:24.992997 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083a609-b790-45d1-ad2c-4467f964966f None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:24.993278 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083a609-b790-45d1-ad2c-4467f964966f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:25.014128 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-a083a609-b790-45d1-ad2c-4467f964966f None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:44:25.015400 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a083a609-b790-45d1-ad2c-4467f964966f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:25.023538 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1197/2394] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:44:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:44:25.028227 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b82166-995c-436d-8e2b-a74a48fb768e None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:25.039001 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b82166-995c-436d-8e2b-a74a48fb768e None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:25.044737 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20588201-534e-4089-a43e-318f5a3a9fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:25.045438 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20588201-534e-4089-a43e-318f5a3a9fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:25.045701 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20588201-534e-4089-a43e-318f5a3a9fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:25.046001 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20588201-534e-4089-a43e-318f5a3a9fc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:25.046740 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20588201-534e-4089-a43e-318f5a3a9fc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:44:25.047041 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20588201-534e-4089-a43e-318f5a3a9fc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:25.048685 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20588201-534e-4089-a43e-318f5a3a9fc4 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:25.062251 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1198/2395] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:44:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:44:25.067072 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083a609-b790-45d1-ad2c-4467f964966f None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:25.077558 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083a609-b790-45d1-ad2c-4467f964966f None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:25.083023 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4777206e-1063-4a1d-919c-18a918d542ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:25.083711 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777206e-1063-4a1d-919c-18a918d542ef admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:25.083988 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777206e-1063-4a1d-919c-18a918d542ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:25.084259 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777206e-1063-4a1d-919c-18a918d542ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:25.084975 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4777206e-1063-4a1d-919c-18a918d542ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:25.087163 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4777206e-1063-4a1d-919c-18a918d542ef admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:25.117606 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1198/2396] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:44:25 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:44:25.122129 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20588201-534e-4089-a43e-318f5a3a9fc4 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:25.132871 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20588201-534e-4089-a43e-318f5a3a9fc4 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:25.199046 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ac204-1cb8-4b48-9e72-58b40c530928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:25.199723 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ac204-1cb8-4b48-9e72-58b40c530928 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:25.199999 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ac204-1cb8-4b48-9e72-58b40c530928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:25.200308 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ac204-1cb8-4b48-9e72-58b40c530928 admin admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:25.200986 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ac204-1cb8-4b48-9e72-58b40c530928 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:25.202958 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ac204-1cb8-4b48-9e72-58b40c530928 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:25.209672 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:44:25.228177 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1199/2397] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:44:25 2022] POST /identity/v3/users => generated 290 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:44:25.232440 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4777206e-1063-4a1d-919c-18a918d542ef admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:25.243138 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4777206e-1063-4a1d-919c-18a918d542ef admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:25.248059 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b5675-44da-4d01-99bd-bd240de95fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:25.248716 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b5675-44da-4d01-99bd-bd240de95fde admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:25.248999 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b5675-44da-4d01-99bd-bd240de95fde admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:25.249276 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b5675-44da-4d01-99bd-bd240de95fde admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:25.250038 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b5675-44da-4d01-99bd-bd240de95fde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:25.251664 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b5675-44da-4d01-99bd-bd240de95fde admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:25.263153 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1199/2398] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:44:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:44:25.267190 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ac204-1cb8-4b48-9e72-58b40c530928 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:25.277211 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ac204-1cb8-4b48-9e72-58b40c530928 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:25.282157 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7273d1-5ebf-4971-b70f-eb15f78b457b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:25.282891 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7273d1-5ebf-4971-b70f-eb15f78b457b admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:25.283176 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7273d1-5ebf-4971-b70f-eb15f78b457b admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:25.283458 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7273d1-5ebf-4971-b70f-eb15f78b457b admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:25.284196 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7273d1-5ebf-4971-b70f-eb15f78b457b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:25.285811 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7273d1-5ebf-4971-b70f-eb15f78b457b admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:25.296085 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1200/2399] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:44:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:44:25.300184 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b5675-44da-4d01-99bd-bd240de95fde admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:25.311045 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b5675-44da-4d01-99bd-bd240de95fde admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:25.316113 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c510b2b-f681-4744-b865-f273d21c1205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:25.317027 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c510b2b-f681-4744-b865-f273d21c1205 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:25.317312 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c510b2b-f681-4744-b865-f273d21c1205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:25.317584 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c510b2b-f681-4744-b865-f273d21c1205 admin admin] PATH_INFO: `/v3/projects/b13e039c4c484cc996e7319c94a3001d/users/784b2050fb9146fbb559c71318794893/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:25.335959 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c510b2b-f681-4744-b865-f273d21c1205 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b13e039c4c484cc996e7319c94a3001d, user_id=784b2050fb9146fbb559c71318794893, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:25.340934 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c510b2b-f681-4744-b865-f273d21c1205 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:25.361864 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1200/2400] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:44:25 2022] PUT /identity/v3/projects/b13e039c4c484cc996e7319c94a3001d/users/784b2050fb9146fbb559c71318794893/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:44:25.373275 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39546f26-b156-4cb6-9659-fbb105a07dd1 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:25.373567 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39546f26-b156-4cb6-9659-fbb105a07dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:25.374118 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39546f26-b156-4cb6-9659-fbb105a07dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:25.401575 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-39546f26-b156-4cb6-9659-fbb105a07dd1 None None] MFA Rules not processed for user `784b2050fb9146fbb559c71318794893`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:44:25.402784 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-39546f26-b156-4cb6-9659-fbb105a07dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:25.470099 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1201/2401] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:44:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:44:25.474647 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c510b2b-f681-4744-b865-f273d21c1205 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:25.529972 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:44:25.543997 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c510b2b-f681-4744-b865-f273d21c1205 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:25.549444 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e15a32-f322-4cb8-b8a3-d55cf436bd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:25.550134 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e15a32-f322-4cb8-b8a3-d55cf436bd82 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:25.550441 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e15a32-f322-4cb8-b8a3-d55cf436bd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:25.550714 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e15a32-f322-4cb8-b8a3-d55cf436bd82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:25.551421 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e15a32-f322-4cb8-b8a3-d55cf436bd82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:25.553329 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e15a32-f322-4cb8-b8a3-d55cf436bd82 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:25.584421 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1201/2402] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:44:25 2022] POST /identity/v3/projects => generated 381 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:44:25.589472 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39546f26-b156-4cb6-9659-fbb105a07dd1 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:25.601123 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39546f26-b156-4cb6-9659-fbb105a07dd1 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:25.664866 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5867ae0a-8615-4c22-ba90-84f57609d877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:25.665436 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867ae0a-8615-4c22-ba90-84f57609d877 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:25.665709 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867ae0a-8615-4c22-ba90-84f57609d877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:25.666009 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867ae0a-8615-4c22-ba90-84f57609d877 admin admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:25.666702 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5867ae0a-8615-4c22-ba90-84f57609d877 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:25.668613 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5867ae0a-8615-4c22-ba90-84f57609d877 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:25.690684 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1202/2403] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:44:25 2022] POST /identity/v3/users => generated 297 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:44:25.695194 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e15a32-f322-4cb8-b8a3-d55cf436bd82 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:25.706143 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e15a32-f322-4cb8-b8a3-d55cf436bd82 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:25.711296 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9cf42-1d0a-4f8a-b6f5-15b25638441d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:25.712138 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9cf42-1d0a-4f8a-b6f5-15b25638441d admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:25.712499 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9cf42-1d0a-4f8a-b6f5-15b25638441d admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:25.712914 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9cf42-1d0a-4f8a-b6f5-15b25638441d admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:25.713651 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d9cf42-1d0a-4f8a-b6f5-15b25638441d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:25.715295 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d9cf42-1d0a-4f8a-b6f5-15b25638441d admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:25.728558 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1202/2404] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:44:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:44:25.733334 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5867ae0a-8615-4c22-ba90-84f57609d877 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:25.747793 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5867ae0a-8615-4c22-ba90-84f57609d877 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:25.752993 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e256c-86e4-4bdb-bec8-6e30eeb6d8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:25.753923 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e256c-86e4-4bdb-bec8-6e30eeb6d8be admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:25.754203 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e256c-86e4-4bdb-bec8-6e30eeb6d8be admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:25.754479 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e256c-86e4-4bdb-bec8-6e30eeb6d8be admin admin] PATH_INFO: `/v3/projects/9b9ec419c4cb4fccb914febc8cd7e7b4/users/88b59de2644342fca6b02d20503259e0/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:25.770282 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7e256c-86e4-4bdb-bec8-6e30eeb6d8be admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b9ec419c4cb4fccb914febc8cd7e7b4, user_id=88b59de2644342fca6b02d20503259e0, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:25.773016 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7e256c-86e4-4bdb-bec8-6e30eeb6d8be admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:25.787770 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1203/2405] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:44:25 2022] PUT /identity/v3/projects/9b9ec419c4cb4fccb914febc8cd7e7b4/users/88b59de2644342fca6b02d20503259e0/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:44:25.791919 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9cf42-1d0a-4f8a-b6f5-15b25638441d admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:25.801941 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9cf42-1d0a-4f8a-b6f5-15b25638441d admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:25.864172 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4dad6a-ede1-4f12-a4e7-0d96a5df699d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:25.864844 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4dad6a-ede1-4f12-a4e7-0d96a5df699d admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:25.865127 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4dad6a-ede1-4f12-a4e7-0d96a5df699d admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:25.865397 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4dad6a-ede1-4f12-a4e7-0d96a5df699d admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:25.866154 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4dad6a-ede1-4f12-a4e7-0d96a5df699d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:25.867749 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4dad6a-ede1-4f12-a4e7-0d96a5df699d admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:25.877809 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1203/2406] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:44:25 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:44:25.882301 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e256c-86e4-4bdb-bec8-6e30eeb6d8be admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:25.893449 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e256c-86e4-4bdb-bec8-6e30eeb6d8be admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:25.898415 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e5034-ee3f-404f-8d27-64421502692c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:25.899437 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e5034-ee3f-404f-8d27-64421502692c admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:25.900164 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e5034-ee3f-404f-8d27-64421502692c admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:25.900453 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e5034-ee3f-404f-8d27-64421502692c admin admin] PATH_INFO: `/v3/projects/9b9ec419c4cb4fccb914febc8cd7e7b4/users/88b59de2644342fca6b02d20503259e0/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:25.902562 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e5034-ee3f-404f-8d27-64421502692c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b9ec419c4cb4fccb914febc8cd7e7b4, user_id=88b59de2644342fca6b02d20503259e0, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:25.905216 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e5034-ee3f-404f-8d27-64421502692c admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:25.916217 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1204/2407] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:44:25 2022] PUT /identity/v3/projects/9b9ec419c4cb4fccb914febc8cd7e7b4/users/88b59de2644342fca6b02d20503259e0/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:44:25.933854 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d54a28-314e-4014-b6b3-1411689cb6ed None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:25.934258 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d54a28-314e-4014-b6b3-1411689cb6ed None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:25.934648 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d54a28-314e-4014-b6b3-1411689cb6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:25.971857 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-03d54a28-314e-4014-b6b3-1411689cb6ed None None] MFA Rules not processed for user `88b59de2644342fca6b02d20503259e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:44:25.973578 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-03d54a28-314e-4014-b6b3-1411689cb6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:26.048363 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1204/2408] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:44:25 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:44:26.072119 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e5034-ee3f-404f-8d27-64421502692c admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:26.074085 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-381e5034-ee3f-404f-8d27-64421502692c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:26.098859 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:44:26.136411 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e5034-ee3f-404f-8d27-64421502692c admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:26.140057 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459cd66-ee52-4c98-b347-8431581ce935 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:26.140704 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459cd66-ee52-4c98-b347-8431581ce935 service cinder] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:26.140976 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459cd66-ee52-4c98-b347-8431581ce935 service cinder] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:26.141240 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459cd66-ee52-4c98-b347-8431581ce935 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:26.151000 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c459cd66-ee52-4c98-b347-8431581ce935 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:26.152116 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c459cd66-ee52-4c98-b347-8431581ce935 service cinder] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:26.162468 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1205/2409] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:44:26 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:44:26.508392 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d54a28-314e-4014-b6b3-1411689cb6ed None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:26.518087 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d54a28-314e-4014-b6b3-1411689cb6ed None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:26.522735 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ed122-a0bf-4f27-8941-05b86944a7e5 tempest-VolumeQuotaClassesTest-2069800622 tempest-VolumeQuotaClassesTest-2069800622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88b59de2644342fca6b02d20503259e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b9ec419c4cb4fccb914febc8cd7e7b4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:26.523513 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ed122-a0bf-4f27-8941-05b86944a7e5 tempest-VolumeQuotaClassesTest-2069800622 tempest-VolumeQuotaClassesTest-2069800622-project-admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:26.523804 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ed122-a0bf-4f27-8941-05b86944a7e5 tempest-VolumeQuotaClassesTest-2069800622 tempest-VolumeQuotaClassesTest-2069800622-project-admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:26.524081 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ed122-a0bf-4f27-8941-05b86944a7e5 tempest-VolumeQuotaClassesTest-2069800622 tempest-VolumeQuotaClassesTest-2069800622-project-admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:26.525150 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46ed122-a0bf-4f27-8941-05b86944a7e5 tempest-VolumeQuotaClassesTest-2069800622 tempest-VolumeQuotaClassesTest-2069800622-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:44:26.525294 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46ed122-a0bf-4f27-8941-05b86944a7e5 tempest-VolumeQuotaClassesTest-2069800622 tempest-VolumeQuotaClassesTest-2069800622-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:26.526877 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46ed122-a0bf-4f27-8941-05b86944a7e5 tempest-VolumeQuotaClassesTest-2069800622 tempest-VolumeQuotaClassesTest-2069800622-project-admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:26.539236 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1205/2410] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:44:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:44:26.544327 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459cd66-ee52-4c98-b347-8431581ce935 service cinder] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:26.553977 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459cd66-ee52-4c98-b347-8431581ce935 service cinder] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:26.559427 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e020d-7d4c-4035-b2c4-e751e65cc937 tempest-VolumeQuotaClassesTest-2069800622 tempest-VolumeQuotaClassesTest-2069800622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88b59de2644342fca6b02d20503259e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b9ec419c4cb4fccb914febc8cd7e7b4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:26.560445 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e020d-7d4c-4035-b2c4-e751e65cc937 tempest-VolumeQuotaClassesTest-2069800622 tempest-VolumeQuotaClassesTest-2069800622-project-admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:26.560819 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e020d-7d4c-4035-b2c4-e751e65cc937 tempest-VolumeQuotaClassesTest-2069800622 tempest-VolumeQuotaClassesTest-2069800622-project-admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:26.561186 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e020d-7d4c-4035-b2c4-e751e65cc937 tempest-VolumeQuotaClassesTest-2069800622 tempest-VolumeQuotaClassesTest-2069800622-project-admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:26.563211 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04e020d-7d4c-4035-b2c4-e751e65cc937 tempest-VolumeQuotaClassesTest-2069800622 tempest-VolumeQuotaClassesTest-2069800622-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:26.564218 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04e020d-7d4c-4035-b2c4-e751e65cc937 tempest-VolumeQuotaClassesTest-2069800622 tempest-VolumeQuotaClassesTest-2069800622-project-admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:26.594180 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1206/2411] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:44:26 2022] POST /identity/v3/projects => generated 354 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:44:26.598400 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ed122-a0bf-4f27-8941-05b86944a7e5 tempest-VolumeQuotaClassesTest-2069800622 tempest-VolumeQuotaClassesTest-2069800622-project-admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:26.610498 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ed122-a0bf-4f27-8941-05b86944a7e5 tempest-VolumeQuotaClassesTest-2069800622 tempest-VolumeQuotaClassesTest-2069800622-project-admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:26.646672 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:44:26.673270 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf4dad-411c-4536-a6f9-012eed4fa2b1 tempest-VolumeQuotaClassesTest-2069800622 tempest-VolumeQuotaClassesTest-2069800622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88b59de2644342fca6b02d20503259e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b9ec419c4cb4fccb914febc8cd7e7b4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:26.673980 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf4dad-411c-4536-a6f9-012eed4fa2b1 tempest-VolumeQuotaClassesTest-2069800622 tempest-VolumeQuotaClassesTest-2069800622-project-admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:26.674270 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf4dad-411c-4536-a6f9-012eed4fa2b1 tempest-VolumeQuotaClassesTest-2069800622 tempest-VolumeQuotaClassesTest-2069800622-project-admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:26.674550 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf4dad-411c-4536-a6f9-012eed4fa2b1 tempest-VolumeQuotaClassesTest-2069800622 tempest-VolumeQuotaClassesTest-2069800622-project-admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:26.675281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf4dad-411c-4536-a6f9-012eed4fa2b1 tempest-VolumeQuotaClassesTest-2069800622 tempest-VolumeQuotaClassesTest-2069800622-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:44:26.675588 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf4dad-411c-4536-a6f9-012eed4fa2b1 tempest-VolumeQuotaClassesTest-2069800622 tempest-VolumeQuotaClassesTest-2069800622-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:26.677192 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf4dad-411c-4536-a6f9-012eed4fa2b1 tempest-VolumeQuotaClassesTest-2069800622 tempest-VolumeQuotaClassesTest-2069800622-project-admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:26.689162 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1206/2412] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:44:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:44:26.727488 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e020d-7d4c-4035-b2c4-e751e65cc937 tempest-VolumeQuotaClassesTest-2069800622 tempest-VolumeQuotaClassesTest-2069800622-project-admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:26.743292 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e020d-7d4c-4035-b2c4-e751e65cc937 tempest-VolumeQuotaClassesTest-2069800622 tempest-VolumeQuotaClassesTest-2069800622-project-admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:26.747969 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f7a3d-9ee3-487f-881a-d59e29474141 tempest-VolumeQuotaClassesTest-2069800622 tempest-VolumeQuotaClassesTest-2069800622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88b59de2644342fca6b02d20503259e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b9ec419c4cb4fccb914febc8cd7e7b4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:26.748827 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f7a3d-9ee3-487f-881a-d59e29474141 tempest-VolumeQuotaClassesTest-2069800622 tempest-VolumeQuotaClassesTest-2069800622-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:26.749103 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f7a3d-9ee3-487f-881a-d59e29474141 tempest-VolumeQuotaClassesTest-2069800622 tempest-VolumeQuotaClassesTest-2069800622-project-admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:26.749367 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f7a3d-9ee3-487f-881a-d59e29474141 tempest-VolumeQuotaClassesTest-2069800622 tempest-VolumeQuotaClassesTest-2069800622-project-admin] PATH_INFO: `/v3/projects/7333624d9fb146139513d3f7b6f76767` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:26.750618 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f7a3d-9ee3-487f-881a-d59e29474141 tempest-VolumeQuotaClassesTest-2069800622 tempest-VolumeQuotaClassesTest-2069800622-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7333624d9fb146139513d3f7b6f76767)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:26.752496 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f7a3d-9ee3-487f-881a-d59e29474141 tempest-VolumeQuotaClassesTest-2069800622 tempest-VolumeQuotaClassesTest-2069800622-project-admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:26.799928 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-183f7a3d-9ee3-487f-881a-d59e29474141 tempest-VolumeQuotaClassesTest-2069800622 tempest-VolumeQuotaClassesTest-2069800622-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7333624d9fb146139513d3f7b6f76767', 'request_id': 'req-183f7a3d-9ee3-487f-881a-d59e29474141'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:26.809287 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-183f7a3d-9ee3-487f-881a-d59e29474141 tempest-VolumeQuotaClassesTest-2069800622 tempest-VolumeQuotaClassesTest-2069800622-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7333624d9fb146139513d3f7b6f76767', 'request_id': 'req-183f7a3d-9ee3-487f-881a-d59e29474141'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:26.815686 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-183f7a3d-9ee3-487f-881a-d59e29474141 tempest-VolumeQuotaClassesTest-2069800622 tempest-VolumeQuotaClassesTest-2069800622-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7333624d9fb146139513d3f7b6f76767', 'request_id': 'req-183f7a3d-9ee3-487f-881a-d59e29474141'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:26.828603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-183f7a3d-9ee3-487f-881a-d59e29474141 tempest-VolumeQuotaClassesTest-2069800622 tempest-VolumeQuotaClassesTest-2069800622-project-admin] The token cache is being invalidate because project 7333624d9fb146139513d3f7b6f76767 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80150) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:44:26.828889 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-183f7a3d-9ee3-487f-881a-d59e29474141 tempest-VolumeQuotaClassesTest-2069800622 tempest-VolumeQuotaClassesTest-2069800622-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:26.829621 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-183f7a3d-9ee3-487f-881a-d59e29474141 tempest-VolumeQuotaClassesTest-2069800622 tempest-VolumeQuotaClassesTest-2069800622-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:26.831291 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1207/2413] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:44:26 2022] DELETE /identity/v3/projects/7333624d9fb146139513d3f7b6f76767 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:44:27.034839 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf4dad-411c-4536-a6f9-012eed4fa2b1 tempest-VolumeQuotaClassesTest-2069800622 tempest-VolumeQuotaClassesTest-2069800622-project-admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:27.036772 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7fcf4dad-411c-4536-a6f9-012eed4fa2b1 tempest-VolumeQuotaClassesTest-2069800622 tempest-VolumeQuotaClassesTest-2069800622-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:27.104274 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf4dad-411c-4536-a6f9-012eed4fa2b1 tempest-VolumeQuotaClassesTest-2069800622 tempest-VolumeQuotaClassesTest-2069800622-project-admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:27.164069 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f8802-375d-4716-b9d4-97dbbeafec8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:27.165033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f8802-375d-4716-b9d4-97dbbeafec8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:27.165311 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f8802-375d-4716-b9d4-97dbbeafec8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:27.165585 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f8802-375d-4716-b9d4-97dbbeafec8d admin admin] PATH_INFO: `/v3/users/784b2050fb9146fbb559c71318794893` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:27.166926 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f8802-375d-4716-b9d4-97dbbeafec8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=784b2050fb9146fbb559c71318794893)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:27.168876 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f8802-375d-4716-b9d4-97dbbeafec8d admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:27.217938 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-cc5f8802-375d-4716-b9d4-97dbbeafec8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '784b2050fb9146fbb559c71318794893'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:27.218594 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-cc5f8802-375d-4716-b9d4-97dbbeafec8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '784b2050fb9146fbb559c71318794893'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:27.226035 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-cc5f8802-375d-4716-b9d4-97dbbeafec8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '784b2050fb9146fbb559c71318794893'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:27.239105 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-cc5f8802-375d-4716-b9d4-97dbbeafec8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '784b2050fb9146fbb559c71318794893'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:27.243050 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:44:27.250712 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-cc5f8802-375d-4716-b9d4-97dbbeafec8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '784b2050fb9146fbb559c71318794893'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:27.260422 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1207/2414] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:44:27 2022] DELETE /identity/v3/users/784b2050fb9146fbb559c71318794893 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:44:27.265109 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d76283-246b-4c9b-8204-2c0b27808fd0 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:27.265335 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d76283-246b-4c9b-8204-2c0b27808fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:27.265609 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d76283-246b-4c9b-8204-2c0b27808fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:27.283348 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-01d76283-246b-4c9b-8204-2c0b27808fd0 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:44:27.284548 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-01d76283-246b-4c9b-8204-2c0b27808fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:27.348849 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1208/2415] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:44:27.358964 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f8802-375d-4716-b9d4-97dbbeafec8d admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:27.360735 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-cc5f8802-375d-4716-b9d4-97dbbeafec8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:27.422712 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f8802-375d-4716-b9d4-97dbbeafec8d admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:27.426755 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c302d-65b8-431a-a639-ca2aba31561b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:27.427410 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c302d-65b8-431a-a639-ca2aba31561b service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:27.427697 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c302d-65b8-431a-a639-ca2aba31561b service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:27.427970 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c302d-65b8-431a-a639-ca2aba31561b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:27.437807 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c302d-65b8-431a-a639-ca2aba31561b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:27.439288 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c302d-65b8-431a-a639-ca2aba31561b service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:27.449336 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1208/2416] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:44:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:44:27.725761 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d76283-246b-4c9b-8204-2c0b27808fd0 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:27.727624 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-01d76283-246b-4c9b-8204-2c0b27808fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:27.744562 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d76283-246b-4c9b-8204-2c0b27808fd0 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:27.749889 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec3b41-6f7c-4996-b7c6-b99f49ced7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:27.750805 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec3b41-6f7c-4996-b7c6-b99f49ced7cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:27.751084 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec3b41-6f7c-4996-b7c6-b99f49ced7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:27.751441 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec3b41-6f7c-4996-b7c6-b99f49ced7cb admin admin] PATH_INFO: `/v3/projects/b13e039c4c484cc996e7319c94a3001d` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:27.752534 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec3b41-6f7c-4996-b7c6-b99f49ced7cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b13e039c4c484cc996e7319c94a3001d)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:27.754518 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec3b41-6f7c-4996-b7c6-b99f49ced7cb admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:27.780277 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:44:27.812432 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-b9ec3b41-6f7c-4996-b7c6-b99f49ced7cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b13e039c4c484cc996e7319c94a3001d', 'request_id': 'req-b9ec3b41-6f7c-4996-b7c6-b99f49ced7cb'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:27.821531 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-b9ec3b41-6f7c-4996-b7c6-b99f49ced7cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b13e039c4c484cc996e7319c94a3001d', 'request_id': 'req-b9ec3b41-6f7c-4996-b7c6-b99f49ced7cb'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:27.827128 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-b9ec3b41-6f7c-4996-b7c6-b99f49ced7cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b13e039c4c484cc996e7319c94a3001d', 'request_id': 'req-b9ec3b41-6f7c-4996-b7c6-b99f49ced7cb'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:27.841515 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-b9ec3b41-6f7c-4996-b7c6-b99f49ced7cb admin admin] The token cache is being invalidate because project b13e039c4c484cc996e7319c94a3001d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80150) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:44:27.841834 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-b9ec3b41-6f7c-4996-b7c6-b99f49ced7cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:27.843522 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-b9ec3b41-6f7c-4996-b7c6-b99f49ced7cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:27.845521 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1209/2417] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:44:27 2022] DELETE /identity/v3/projects/b13e039c4c484cc996e7319c94a3001d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:44:27.849573 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c302d-65b8-431a-a639-ca2aba31561b service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:27.860557 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c302d-65b8-431a-a639-ca2aba31561b service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:27.918367 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e8a86-34a0-47d0-ba41-a08fbb7ecf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:27.919253 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e8a86-34a0-47d0-ba41-a08fbb7ecf8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:27.919537 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e8a86-34a0-47d0-ba41-a08fbb7ecf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:27.919813 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e8a86-34a0-47d0-ba41-a08fbb7ecf8d admin admin] PATH_INFO: `/v3/users/88b59de2644342fca6b02d20503259e0` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:27.921000 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e8a86-34a0-47d0-ba41-a08fbb7ecf8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=88b59de2644342fca6b02d20503259e0)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:27.923055 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e8a86-34a0-47d0-ba41-a08fbb7ecf8d admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:27.977447 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-301e8a86-34a0-47d0-ba41-a08fbb7ecf8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88b59de2644342fca6b02d20503259e0'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:27.978138 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-301e8a86-34a0-47d0-ba41-a08fbb7ecf8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88b59de2644342fca6b02d20503259e0'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:27.985008 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-301e8a86-34a0-47d0-ba41-a08fbb7ecf8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88b59de2644342fca6b02d20503259e0'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:27.997184 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-301e8a86-34a0-47d0-ba41-a08fbb7ecf8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88b59de2644342fca6b02d20503259e0'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:28.005977 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-301e8a86-34a0-47d0-ba41-a08fbb7ecf8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88b59de2644342fca6b02d20503259e0'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:28.012256 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1209/2418] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:44:27 2022] DELETE /identity/v3/users/88b59de2644342fca6b02d20503259e0 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:44:28.304755 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec3b41-6f7c-4996-b7c6-b99f49ced7cb admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:28.306503 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-b9ec3b41-6f7c-4996-b7c6-b99f49ced7cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:28.320392 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec3b41-6f7c-4996-b7c6-b99f49ced7cb admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:28.378880 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475f0b4-66a0-4e29-8f6b-2353d14305a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:28.379679 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475f0b4-66a0-4e29-8f6b-2353d14305a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:28.379957 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475f0b4-66a0-4e29-8f6b-2353d14305a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:28.380341 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475f0b4-66a0-4e29-8f6b-2353d14305a2 admin admin] PATH_INFO: `/v3/projects/9b9ec419c4cb4fccb914febc8cd7e7b4` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:28.381547 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4475f0b4-66a0-4e29-8f6b-2353d14305a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b9ec419c4cb4fccb914febc8cd7e7b4)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:28.383544 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4475f0b4-66a0-4e29-8f6b-2353d14305a2 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:28.432551 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-4475f0b4-66a0-4e29-8f6b-2353d14305a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b9ec419c4cb4fccb914febc8cd7e7b4', 'request_id': 'req-4475f0b4-66a0-4e29-8f6b-2353d14305a2'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:28.441112 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-4475f0b4-66a0-4e29-8f6b-2353d14305a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b9ec419c4cb4fccb914febc8cd7e7b4', 'request_id': 'req-4475f0b4-66a0-4e29-8f6b-2353d14305a2'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:28.447492 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-4475f0b4-66a0-4e29-8f6b-2353d14305a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b9ec419c4cb4fccb914febc8cd7e7b4', 'request_id': 'req-4475f0b4-66a0-4e29-8f6b-2353d14305a2'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:28.458309 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-4475f0b4-66a0-4e29-8f6b-2353d14305a2 admin admin] The token cache is being invalidate because project 9b9ec419c4cb4fccb914febc8cd7e7b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80150) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:44:28.458589 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-4475f0b4-66a0-4e29-8f6b-2353d14305a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:28.459205 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-4475f0b4-66a0-4e29-8f6b-2353d14305a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:28.461023 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1210/2419] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:44:28 2022] DELETE /identity/v3/projects/9b9ec419c4cb4fccb914febc8cd7e7b4 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:44:28.467909 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15601948-0dee-4c12-9ae4-a269ce7287bf None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:28.468192 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15601948-0dee-4c12-9ae4-a269ce7287bf None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:28.468477 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15601948-0dee-4c12-9ae4-a269ce7287bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:28.486661 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-15601948-0dee-4c12-9ae4-a269ce7287bf None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:44:28.487864 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-15601948-0dee-4c12-9ae4-a269ce7287bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:28.500331 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:44:28.557411 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1210/2420] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:44:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:44:28.565332 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038dafc8-3816-4515-b321-6ba8db8930ed None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:28.565616 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038dafc8-3816-4515-b321-6ba8db8930ed None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:28.565911 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038dafc8-3816-4515-b321-6ba8db8930ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:28.585375 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-038dafc8-3816-4515-b321-6ba8db8930ed None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:44:28.586819 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-038dafc8-3816-4515-b321-6ba8db8930ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:28.596266 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1211/2421] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:44:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:44:28.600741 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15601948-0dee-4c12-9ae4-a269ce7287bf None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:28.611812 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15601948-0dee-4c12-9ae4-a269ce7287bf None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:28.617838 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68580319-6609-49b6-8b6d-328a10ad4302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:28.619839 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68580319-6609-49b6-8b6d-328a10ad4302 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:28.620121 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68580319-6609-49b6-8b6d-328a10ad4302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:28.620388 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68580319-6609-49b6-8b6d-328a10ad4302 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:28.621129 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68580319-6609-49b6-8b6d-328a10ad4302 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:44:28.621440 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68580319-6609-49b6-8b6d-328a10ad4302 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:28.623158 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68580319-6609-49b6-8b6d-328a10ad4302 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:28.636974 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1211/2422] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:44:28.642696 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038dafc8-3816-4515-b321-6ba8db8930ed None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:28.656343 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038dafc8-3816-4515-b321-6ba8db8930ed None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:28.662699 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c005b5c-b268-4a39-bc9b-988a5871f40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:28.663362 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c005b5c-b268-4a39-bc9b-988a5871f40b admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:28.663639 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c005b5c-b268-4a39-bc9b-988a5871f40b admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:28.663924 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c005b5c-b268-4a39-bc9b-988a5871f40b admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:28.664620 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c005b5c-b268-4a39-bc9b-988a5871f40b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:28.666698 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c005b5c-b268-4a39-bc9b-988a5871f40b admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:28.702871 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1212/2423] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:44:28 2022] POST /identity/v3/projects => generated 381 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:44:28.708666 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68580319-6609-49b6-8b6d-328a10ad4302 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:28.721120 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68580319-6609-49b6-8b6d-328a10ad4302 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:28.781352 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7f535-2f16-4f9a-8806-72d80c290af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:28.782057 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7f535-2f16-4f9a-8806-72d80c290af3 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:28.782343 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7f535-2f16-4f9a-8806-72d80c290af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:28.782617 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7f535-2f16-4f9a-8806-72d80c290af3 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:28.783322 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf7f535-2f16-4f9a-8806-72d80c290af3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:28.785273 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf7f535-2f16-4f9a-8806-72d80c290af3 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:28.807584 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1212/2424] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:44:28 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:44:28.812075 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c005b5c-b268-4a39-bc9b-988a5871f40b admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:28.822979 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c005b5c-b268-4a39-bc9b-988a5871f40b admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:28.829042 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b01e8-9094-4221-ae88-1da4f8949c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:28.829701 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b01e8-9094-4221-ae88-1da4f8949c85 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:28.830007 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b01e8-9094-4221-ae88-1da4f8949c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:28.830275 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b01e8-9094-4221-ae88-1da4f8949c85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:28.830983 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b01e8-9094-4221-ae88-1da4f8949c85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:28.832591 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b01e8-9094-4221-ae88-1da4f8949c85 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:28.834824 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:44:28.846266 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1213/2425] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:44:28.850862 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7f535-2f16-4f9a-8806-72d80c290af3 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:28.861655 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7f535-2f16-4f9a-8806-72d80c290af3 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:28.872968 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854854c-5d8c-44bc-aff0-b304e94611f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:28.873666 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854854c-5d8c-44bc-aff0-b304e94611f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:28.873978 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854854c-5d8c-44bc-aff0-b304e94611f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:28.874256 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854854c-5d8c-44bc-aff0-b304e94611f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:28.875000 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9854854c-5d8c-44bc-aff0-b304e94611f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:28.876659 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9854854c-5d8c-44bc-aff0-b304e94611f7 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:28.888057 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1213/2426] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:44:28.892759 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b01e8-9094-4221-ae88-1da4f8949c85 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:28.903224 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b01e8-9094-4221-ae88-1da4f8949c85 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:28.908321 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca685f-96aa-40c0-8f38-a7eb3738457a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:28.909203 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca685f-96aa-40c0-8f38-a7eb3738457a admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:28.909479 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca685f-96aa-40c0-8f38-a7eb3738457a admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:28.909746 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca685f-96aa-40c0-8f38-a7eb3738457a admin admin] PATH_INFO: `/v3/projects/2d0359b6e4524b21b883a05f67c27e05/users/a661742ab5e2488a8757e04724a549cd/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:28.924902 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca685f-96aa-40c0-8f38-a7eb3738457a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d0359b6e4524b21b883a05f67c27e05, user_id=a661742ab5e2488a8757e04724a549cd, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:28.927565 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca685f-96aa-40c0-8f38-a7eb3738457a admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:28.943087 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1214/2427] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:44:28 2022] PUT /identity/v3/projects/2d0359b6e4524b21b883a05f67c27e05/users/a661742ab5e2488a8757e04724a549cd/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:44:28.953639 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d8550-3a3f-4ee4-8f42-2ee662af4545 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:28.953966 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d8550-3a3f-4ee4-8f42-2ee662af4545 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:28.954247 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d8550-3a3f-4ee4-8f42-2ee662af4545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:28.982718 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-8c0d8550-3a3f-4ee4-8f42-2ee662af4545 None None] MFA Rules not processed for user `a661742ab5e2488a8757e04724a549cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:44:28.984034 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8c0d8550-3a3f-4ee4-8f42-2ee662af4545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:29.056507 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1214/2428] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:44:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:44:29.061285 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca685f-96aa-40c0-8f38-a7eb3738457a admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:29.130986 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca685f-96aa-40c0-8f38-a7eb3738457a admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:29.136152 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df9b71d-a29b-4325-b5e7-2bfd157dd6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:29.136816 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9b71d-a29b-4325-b5e7-2bfd157dd6e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:29.137095 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9b71d-a29b-4325-b5e7-2bfd157dd6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:29.137366 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9b71d-a29b-4325-b5e7-2bfd157dd6e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:29.138143 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df9b71d-a29b-4325-b5e7-2bfd157dd6e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:29.140441 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df9b71d-a29b-4325-b5e7-2bfd157dd6e5 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:29.174902 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1215/2429] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:44:29 2022] POST /identity/v3/projects => generated 387 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:44:29.178875 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d8550-3a3f-4ee4-8f42-2ee662af4545 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:29.196919 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d8550-3a3f-4ee4-8f42-2ee662af4545 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:29.212584 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:44:29.267293 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e14087-2127-4f47-9632-853eb26bec6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:29.267958 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e14087-2127-4f47-9632-853eb26bec6c admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:29.268240 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e14087-2127-4f47-9632-853eb26bec6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:29.268514 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e14087-2127-4f47-9632-853eb26bec6c admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:29.269227 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e14087-2127-4f47-9632-853eb26bec6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:29.271159 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e14087-2127-4f47-9632-853eb26bec6c admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:29.292528 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1215/2430] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:44:29 2022] POST /identity/v3/users => generated 294 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:44:29.296735 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df9b71d-a29b-4325-b5e7-2bfd157dd6e5 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:29.307580 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df9b71d-a29b-4325-b5e7-2bfd157dd6e5 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:29.312317 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df07125-9cc0-4df2-81f1-8849419e10a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:29.313020 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df07125-9cc0-4df2-81f1-8849419e10a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:29.313295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df07125-9cc0-4df2-81f1-8849419e10a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:29.313559 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df07125-9cc0-4df2-81f1-8849419e10a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:29.314313 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df07125-9cc0-4df2-81f1-8849419e10a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:29.315909 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df07125-9cc0-4df2-81f1-8849419e10a1 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:29.327692 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1216/2431] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:44:29.331846 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e14087-2127-4f47-9632-853eb26bec6c admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:29.342329 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e14087-2127-4f47-9632-853eb26bec6c admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:29.347972 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a3eb5-4bea-45d4-99e2-24f7bd285906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:29.348642 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a3eb5-4bea-45d4-99e2-24f7bd285906 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:29.348926 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a3eb5-4bea-45d4-99e2-24f7bd285906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:29.349205 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a3eb5-4bea-45d4-99e2-24f7bd285906 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:29.349962 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a3eb5-4bea-45d4-99e2-24f7bd285906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:29.351577 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a3eb5-4bea-45d4-99e2-24f7bd285906 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:29.362676 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1216/2432] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:44:29.370732 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df07125-9cc0-4df2-81f1-8849419e10a1 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:29.380605 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df07125-9cc0-4df2-81f1-8849419e10a1 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:29.385542 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9783d90-4722-4903-8b0c-ff09bc4a547c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:29.386476 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9783d90-4722-4903-8b0c-ff09bc4a547c admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:29.386732 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9783d90-4722-4903-8b0c-ff09bc4a547c admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:29.386995 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9783d90-4722-4903-8b0c-ff09bc4a547c admin admin] PATH_INFO: `/v3/projects/e50c1e9b9d2e4427bbed79e7735b922d/users/d3d1257d2d6c468daa29d6f8fa647199/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:29.401686 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9783d90-4722-4903-8b0c-ff09bc4a547c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e50c1e9b9d2e4427bbed79e7735b922d, user_id=d3d1257d2d6c468daa29d6f8fa647199, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:29.404265 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9783d90-4722-4903-8b0c-ff09bc4a547c admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:29.418486 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1217/2433] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:44:29 2022] PUT /identity/v3/projects/e50c1e9b9d2e4427bbed79e7735b922d/users/d3d1257d2d6c468daa29d6f8fa647199/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:44:29.486141 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6b5c5-e4cd-4601-a3da-2b2fae927dba None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:29.486476 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6b5c5-e4cd-4601-a3da-2b2fae927dba None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:29.486757 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6b5c5-e4cd-4601-a3da-2b2fae927dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:29.516617 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-58f6b5c5-e4cd-4601-a3da-2b2fae927dba None None] MFA Rules not processed for user `d3d1257d2d6c468daa29d6f8fa647199`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:44:29.518184 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-58f6b5c5-e4cd-4601-a3da-2b2fae927dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:29.590777 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1217/2434] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:44:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:44:29.595687 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9783d90-4722-4903-8b0c-ff09bc4a547c admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:29.669251 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9783d90-4722-4903-8b0c-ff09bc4a547c admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:29.675218 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522b3e1-c5be-4a71-95ba-f2b3f2ec9b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:29.675888 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522b3e1-c5be-4a71-95ba-f2b3f2ec9b03 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:29.676166 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522b3e1-c5be-4a71-95ba-f2b3f2ec9b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:29.676437 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522b3e1-c5be-4a71-95ba-f2b3f2ec9b03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:29.677113 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a522b3e1-c5be-4a71-95ba-f2b3f2ec9b03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:29.679067 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a522b3e1-c5be-4a71-95ba-f2b3f2ec9b03 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:29.707972 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1218/2435] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:44:29 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:44:29.712396 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6b5c5-e4cd-4601-a3da-2b2fae927dba None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:29.723478 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6b5c5-e4cd-4601-a3da-2b2fae927dba None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:29.784213 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93abda34-e707-4271-8801-d796346aec38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:29.784896 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abda34-e707-4271-8801-d796346aec38 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:29.785174 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abda34-e707-4271-8801-d796346aec38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:29.785443 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abda34-e707-4271-8801-d796346aec38 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:29.786179 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93abda34-e707-4271-8801-d796346aec38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:29.788102 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93abda34-e707-4271-8801-d796346aec38 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:29.810139 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1218/2436] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:44:29 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:44:29.814366 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522b3e1-c5be-4a71-95ba-f2b3f2ec9b03 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:29.826284 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522b3e1-c5be-4a71-95ba-f2b3f2ec9b03 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:29.831483 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae3b7a-660b-4ed9-84c4-9c8a077910a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:29.832150 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae3b7a-660b-4ed9-84c4-9c8a077910a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:29.832430 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae3b7a-660b-4ed9-84c4-9c8a077910a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:29.832703 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae3b7a-660b-4ed9-84c4-9c8a077910a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:29.833543 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ae3b7a-660b-4ed9-84c4-9c8a077910a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:29.835179 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ae3b7a-660b-4ed9-84c4-9c8a077910a7 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:29.837531 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:44:29.847619 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1219/2437] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:44:29.853814 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93abda34-e707-4271-8801-d796346aec38 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:29.869055 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93abda34-e707-4271-8801-d796346aec38 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:29.874759 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f452409-50fd-4eb6-8a89-1a0bc50f44df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:29.875657 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f452409-50fd-4eb6-8a89-1a0bc50f44df admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:29.875941 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f452409-50fd-4eb6-8a89-1a0bc50f44df admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:29.876214 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f452409-50fd-4eb6-8a89-1a0bc50f44df admin admin] PATH_INFO: `/v3/projects/03615275d92f4c91b18791f10d0e0e80/users/ad26a1845fbe4c1fa690e85860da0b12/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:29.885333 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:44:29.893518 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f452409-50fd-4eb6-8a89-1a0bc50f44df admin admin] RBAC: Authorizing `identity:create_grant(project_id=03615275d92f4c91b18791f10d0e0e80, user_id=ad26a1845fbe4c1fa690e85860da0b12, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:29.896243 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f452409-50fd-4eb6-8a89-1a0bc50f44df admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:29.911165 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1219/2438] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:44:29 2022] PUT /identity/v3/projects/03615275d92f4c91b18791f10d0e0e80/users/ad26a1845fbe4c1fa690e85860da0b12/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:44:29.915380 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae3b7a-660b-4ed9-84c4-9c8a077910a7 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:29.926142 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae3b7a-660b-4ed9-84c4-9c8a077910a7 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:29.988711 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4272853b-57a2-48b0-82f8-59d8cb195040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:29.989457 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4272853b-57a2-48b0-82f8-59d8cb195040 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:29.989715 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4272853b-57a2-48b0-82f8-59d8cb195040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:29.990042 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4272853b-57a2-48b0-82f8-59d8cb195040 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:29.991012 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4272853b-57a2-48b0-82f8-59d8cb195040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:29.992631 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4272853b-57a2-48b0-82f8-59d8cb195040 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:30.003002 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1220/2439] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 17:44:30.007601 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f452409-50fd-4eb6-8a89-1a0bc50f44df admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:30.018848 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f452409-50fd-4eb6-8a89-1a0bc50f44df admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:30.024042 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e6434-cb45-4550-8453-897de534d002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:30.024932 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e6434-cb45-4550-8453-897de534d002 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:30.025213 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e6434-cb45-4550-8453-897de534d002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:30.025586 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e6434-cb45-4550-8453-897de534d002 admin admin] PATH_INFO: `/v3/projects/03615275d92f4c91b18791f10d0e0e80/users/ad26a1845fbe4c1fa690e85860da0b12/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:30.028337 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e6434-cb45-4550-8453-897de534d002 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03615275d92f4c91b18791f10d0e0e80, user_id=ad26a1845fbe4c1fa690e85860da0b12, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:30.031065 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e6434-cb45-4550-8453-897de534d002 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:30.041927 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1220/2440] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:44:30 2022] PUT /identity/v3/projects/03615275d92f4c91b18791f10d0e0e80/users/ad26a1845fbe4c1fa690e85860da0b12/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:44:30.057688 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121852f-9c68-4093-971b-9e0173f13245 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:30.058034 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121852f-9c68-4093-971b-9e0173f13245 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:30.058340 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121852f-9c68-4093-971b-9e0173f13245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:30.093168 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-a121852f-9c68-4093-971b-9e0173f13245 None None] MFA Rules not processed for user `ad26a1845fbe4c1fa690e85860da0b12`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:44:30.094583 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-a121852f-9c68-4093-971b-9e0173f13245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:30.169407 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1221/2441] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:44:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:44:30.180602 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e6434-cb45-4550-8453-897de534d002 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:30.182808 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c54e6434-cb45-4550-8453-897de534d002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:30.245337 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e6434-cb45-4550-8453-897de534d002 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:30.249400 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50ff85-6b6a-4936-92ae-a661ce53bb9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:30.250083 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50ff85-6b6a-4936-92ae-a661ce53bb9e service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:30.250368 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50ff85-6b6a-4936-92ae-a661ce53bb9e service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:30.250640 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50ff85-6b6a-4936-92ae-a661ce53bb9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:30.261354 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50ff85-6b6a-4936-92ae-a661ce53bb9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:30.262810 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50ff85-6b6a-4936-92ae-a661ce53bb9e service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:30.272443 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1221/2442] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:44:30 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:44:30.780978 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a121852f-9c68-4093-971b-9e0173f13245 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:30.782551 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-a121852f-9c68-4093-971b-9e0173f13245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:30.795528 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a121852f-9c68-4093-971b-9e0173f13245 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:30.799397 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde84c98-47f7-4b01-a946-328dc2ae1cd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:30.800074 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde84c98-47f7-4b01-a946-328dc2ae1cd2 service cinder] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:30.800355 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde84c98-47f7-4b01-a946-328dc2ae1cd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:30.800629 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde84c98-47f7-4b01-a946-328dc2ae1cd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:30.860986 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde84c98-47f7-4b01-a946-328dc2ae1cd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:30.862457 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde84c98-47f7-4b01-a946-328dc2ae1cd2 service cinder] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:30.871516 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1222/2443] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:44:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:44:34.937948 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50ff85-6b6a-4936-92ae-a661ce53bb9e service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:34.947034 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50ff85-6b6a-4936-92ae-a661ce53bb9e service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:34.951232 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab21f2-9543-490d-ba2b-6d8941616d34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:34.951862 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab21f2-9543-490d-ba2b-6d8941616d34 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:34.952138 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab21f2-9543-490d-ba2b-6d8941616d34 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:34.952411 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab21f2-9543-490d-ba2b-6d8941616d34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:35.011647 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab21f2-9543-490d-ba2b-6d8941616d34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:35.013102 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab21f2-9543-490d-ba2b-6d8941616d34 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:35.022115 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1222/2444] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:44:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:44:37.181196 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde84c98-47f7-4b01-a946-328dc2ae1cd2 service cinder] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:37.203209 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:44:37.250267 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde84c98-47f7-4b01-a946-328dc2ae1cd2 service cinder] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:37.255542 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd18ae-e539-494a-89c8-f12e4cf90382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:37.256466 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd18ae-e539-494a-89c8-f12e4cf90382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:37.256768 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd18ae-e539-494a-89c8-f12e4cf90382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:37.257043 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd18ae-e539-494a-89c8-f12e4cf90382 admin admin] PATH_INFO: `/v3/users/a661742ab5e2488a8757e04724a549cd` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:37.258288 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd18ae-e539-494a-89c8-f12e4cf90382 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a661742ab5e2488a8757e04724a549cd)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:37.260203 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd18ae-e539-494a-89c8-f12e4cf90382 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:37.308539 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-aefd18ae-e539-494a-89c8-f12e4cf90382 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a661742ab5e2488a8757e04724a549cd'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:37.309186 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-aefd18ae-e539-494a-89c8-f12e4cf90382 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a661742ab5e2488a8757e04724a549cd'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:37.316964 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-aefd18ae-e539-494a-89c8-f12e4cf90382 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a661742ab5e2488a8757e04724a549cd'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:37.318080 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-aefd18ae-e539-494a-89c8-f12e4cf90382 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a661742ab5e2488a8757e04724a549cd'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:37.332131 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-aefd18ae-e539-494a-89c8-f12e4cf90382 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a661742ab5e2488a8757e04724a549cd'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:37.348227 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1223/2445] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:44:37 2022] DELETE /identity/v3/users/a661742ab5e2488a8757e04724a549cd => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:44:37.353077 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329cf33-3e30-4e86-86e4-a6001b1fcc4a None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:37.353558 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329cf33-3e30-4e86-86e4-a6001b1fcc4a None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:37.353653 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329cf33-3e30-4e86-86e4-a6001b1fcc4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:37.373052 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-d329cf33-3e30-4e86-86e4-a6001b1fcc4a None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:44:37.374306 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d329cf33-3e30-4e86-86e4-a6001b1fcc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:37.436998 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1223/2446] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:44:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:44:37.447468 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd18ae-e539-494a-89c8-f12e4cf90382 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:37.449059 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-aefd18ae-e539-494a-89c8-f12e4cf90382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:37.512732 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd18ae-e539-494a-89c8-f12e4cf90382 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:37.517174 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c867c7d-2957-4d43-a60e-876381e25959 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:37.517901 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c867c7d-2957-4d43-a60e-876381e25959 service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:37.518179 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c867c7d-2957-4d43-a60e-876381e25959 service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:37.518454 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c867c7d-2957-4d43-a60e-876381e25959 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:37.528318 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c867c7d-2957-4d43-a60e-876381e25959 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:37.529825 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c867c7d-2957-4d43-a60e-876381e25959 service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:37.539328 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1224/2447] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:44:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:44:37.816911 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d329cf33-3e30-4e86-86e4-a6001b1fcc4a None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:37.818787 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d329cf33-3e30-4e86-86e4-a6001b1fcc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:37.834867 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d329cf33-3e30-4e86-86e4-a6001b1fcc4a None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:37.841056 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72544e0-f094-4741-8b33-ad236dbf83d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:37.842060 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72544e0-f094-4741-8b33-ad236dbf83d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:37.842268 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72544e0-f094-4741-8b33-ad236dbf83d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:37.842574 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72544e0-f094-4741-8b33-ad236dbf83d1 admin admin] PATH_INFO: `/v3/projects/2d0359b6e4524b21b883a05f67c27e05` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:37.843933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72544e0-f094-4741-8b33-ad236dbf83d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d0359b6e4524b21b883a05f67c27e05)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:37.845861 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72544e0-f094-4741-8b33-ad236dbf83d1 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:37.857694 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:44:37.901358 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c72544e0-f094-4741-8b33-ad236dbf83d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d0359b6e4524b21b883a05f67c27e05', 'request_id': 'req-c72544e0-f094-4741-8b33-ad236dbf83d1'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:37.910768 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c72544e0-f094-4741-8b33-ad236dbf83d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d0359b6e4524b21b883a05f67c27e05', 'request_id': 'req-c72544e0-f094-4741-8b33-ad236dbf83d1'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:37.922289 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c72544e0-f094-4741-8b33-ad236dbf83d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d0359b6e4524b21b883a05f67c27e05', 'request_id': 'req-c72544e0-f094-4741-8b33-ad236dbf83d1'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:37.936301 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c72544e0-f094-4741-8b33-ad236dbf83d1 admin admin] The token cache is being invalidate because project 2d0359b6e4524b21b883a05f67c27e05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:44:37.936584 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c72544e0-f094-4741-8b33-ad236dbf83d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:37.937273 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c72544e0-f094-4741-8b33-ad236dbf83d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:37.938987 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1224/2448] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:44:37 2022] DELETE /identity/v3/projects/2d0359b6e4524b21b883a05f67c27e05 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:44:37.943656 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c867c7d-2957-4d43-a60e-876381e25959 service neutron] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:37.954739 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c867c7d-2957-4d43-a60e-876381e25959 service neutron] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:37.998590 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:44:38.019066 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205000b-b320-4286-944a-b7180b2d7bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:38.019850 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205000b-b320-4286-944a-b7180b2d7bd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:38.020121 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205000b-b320-4286-944a-b7180b2d7bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:38.020390 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205000b-b320-4286-944a-b7180b2d7bd0 admin admin] PATH_INFO: `/v3/users/d3d1257d2d6c468daa29d6f8fa647199` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:38.021551 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4205000b-b320-4286-944a-b7180b2d7bd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3d1257d2d6c468daa29d6f8fa647199)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:38.023516 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4205000b-b320-4286-944a-b7180b2d7bd0 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:38.080203 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-4205000b-b320-4286-944a-b7180b2d7bd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3d1257d2d6c468daa29d6f8fa647199'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:38.080899 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-4205000b-b320-4286-944a-b7180b2d7bd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3d1257d2d6c468daa29d6f8fa647199'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:38.088917 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-4205000b-b320-4286-944a-b7180b2d7bd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3d1257d2d6c468daa29d6f8fa647199'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:38.089675 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-4205000b-b320-4286-944a-b7180b2d7bd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3d1257d2d6c468daa29d6f8fa647199'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:38.101959 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-4205000b-b320-4286-944a-b7180b2d7bd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3d1257d2d6c468daa29d6f8fa647199'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:38.118933 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1225/2449] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:44:37 2022] DELETE /identity/v3/users/d3d1257d2d6c468daa29d6f8fa647199 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:44:38.424597 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72544e0-f094-4741-8b33-ad236dbf83d1 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:38.427126 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c72544e0-f094-4741-8b33-ad236dbf83d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:38.460872 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72544e0-f094-4741-8b33-ad236dbf83d1 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:38.522887 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe12bf-345e-438c-a44b-ee8fc798f688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:38.523762 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe12bf-345e-438c-a44b-ee8fc798f688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:38.524069 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe12bf-345e-438c-a44b-ee8fc798f688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:38.524335 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe12bf-345e-438c-a44b-ee8fc798f688 admin admin] PATH_INFO: `/v3/projects/e50c1e9b9d2e4427bbed79e7735b922d` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:38.525521 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe12bf-345e-438c-a44b-ee8fc798f688 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e50c1e9b9d2e4427bbed79e7735b922d)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:38.527591 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe12bf-345e-438c-a44b-ee8fc798f688 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:38.576448 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-2cbe12bf-345e-438c-a44b-ee8fc798f688 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e50c1e9b9d2e4427bbed79e7735b922d', 'request_id': 'req-2cbe12bf-345e-438c-a44b-ee8fc798f688'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:38.584765 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-2cbe12bf-345e-438c-a44b-ee8fc798f688 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e50c1e9b9d2e4427bbed79e7735b922d', 'request_id': 'req-2cbe12bf-345e-438c-a44b-ee8fc798f688'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:38.590220 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-2cbe12bf-345e-438c-a44b-ee8fc798f688 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e50c1e9b9d2e4427bbed79e7735b922d', 'request_id': 'req-2cbe12bf-345e-438c-a44b-ee8fc798f688'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:38.600920 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-2cbe12bf-345e-438c-a44b-ee8fc798f688 admin admin] The token cache is being invalidate because project e50c1e9b9d2e4427bbed79e7735b922d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:44:38.601202 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-2cbe12bf-345e-438c-a44b-ee8fc798f688 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:38.601837 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-2cbe12bf-345e-438c-a44b-ee8fc798f688 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:38.603378 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1225/2450] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:44:38 2022] DELETE /identity/v3/projects/e50c1e9b9d2e4427bbed79e7735b922d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:44:38.607514 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205000b-b320-4286-944a-b7180b2d7bd0 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:38.608911 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-4205000b-b320-4286-944a-b7180b2d7bd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:38.621331 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205000b-b320-4286-944a-b7180b2d7bd0 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:38.681279 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84b9ff-c6a4-4632-bbe3-b75584ace616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:38.682567 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84b9ff-c6a4-4632-bbe3-b75584ace616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:38.682948 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84b9ff-c6a4-4632-bbe3-b75584ace616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:38.683333 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84b9ff-c6a4-4632-bbe3-b75584ace616 admin admin] PATH_INFO: `/v3/users/ad26a1845fbe4c1fa690e85860da0b12` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:38.685203 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84b9ff-c6a4-4632-bbe3-b75584ace616 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad26a1845fbe4c1fa690e85860da0b12)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:38.687290 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84b9ff-c6a4-4632-bbe3-b75584ace616 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:38.743450 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-3a84b9ff-c6a4-4632-bbe3-b75584ace616 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad26a1845fbe4c1fa690e85860da0b12'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:38.744201 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-3a84b9ff-c6a4-4632-bbe3-b75584ace616 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad26a1845fbe4c1fa690e85860da0b12'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:38.751367 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-3a84b9ff-c6a4-4632-bbe3-b75584ace616 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad26a1845fbe4c1fa690e85860da0b12'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:38.752025 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-3a84b9ff-c6a4-4632-bbe3-b75584ace616 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad26a1845fbe4c1fa690e85860da0b12'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:38.756471 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:44:38.767845 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-3a84b9ff-c6a4-4632-bbe3-b75584ace616 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad26a1845fbe4c1fa690e85860da0b12'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:38.783080 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1226/2451] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:44:38 2022] DELETE /identity/v3/users/ad26a1845fbe4c1fa690e85860da0b12 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:44:39.069003 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe12bf-345e-438c-a44b-ee8fc798f688 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:39.070503 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-2cbe12bf-345e-438c-a44b-ee8fc798f688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:39.084545 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe12bf-345e-438c-a44b-ee8fc798f688 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:39.113417 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:44:39.145236 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074ddd6-25ca-452e-b90a-0aad7a66f386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:39.146151 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074ddd6-25ca-452e-b90a-0aad7a66f386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:39.146437 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074ddd6-25ca-452e-b90a-0aad7a66f386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:39.146712 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074ddd6-25ca-452e-b90a-0aad7a66f386 admin admin] PATH_INFO: `/v3/projects/03615275d92f4c91b18791f10d0e0e80` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:39.147920 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c074ddd6-25ca-452e-b90a-0aad7a66f386 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03615275d92f4c91b18791f10d0e0e80)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:39.149839 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c074ddd6-25ca-452e-b90a-0aad7a66f386 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:39.201536 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c074ddd6-25ca-452e-b90a-0aad7a66f386 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03615275d92f4c91b18791f10d0e0e80', 'request_id': 'req-c074ddd6-25ca-452e-b90a-0aad7a66f386'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:39.210482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c074ddd6-25ca-452e-b90a-0aad7a66f386 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03615275d92f4c91b18791f10d0e0e80', 'request_id': 'req-c074ddd6-25ca-452e-b90a-0aad7a66f386'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:39.216235 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c074ddd6-25ca-452e-b90a-0aad7a66f386 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03615275d92f4c91b18791f10d0e0e80', 'request_id': 'req-c074ddd6-25ca-452e-b90a-0aad7a66f386'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:39.227823 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c074ddd6-25ca-452e-b90a-0aad7a66f386 admin admin] The token cache is being invalidate because project 03615275d92f4c91b18791f10d0e0e80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:44:39.228111 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c074ddd6-25ca-452e-b90a-0aad7a66f386 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:39.228759 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c074ddd6-25ca-452e-b90a-0aad7a66f386 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:39.230381 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1226/2452] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:44:39 2022] DELETE /identity/v3/projects/03615275d92f4c91b18791f10d0e0e80 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:44:39.242162 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217f5eb-e7ab-4b94-a420-cca507bba611 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:39.242559 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217f5eb-e7ab-4b94-a420-cca507bba611 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:39.242837 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217f5eb-e7ab-4b94-a420-cca507bba611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:39.262178 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-6217f5eb-e7ab-4b94-a420-cca507bba611 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:44:39.263375 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-6217f5eb-e7ab-4b94-a420-cca507bba611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:39.328166 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1227/2453] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:44:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:44:39.337949 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b1c84-eab5-4b04-b6a3-01c0a01ec78b None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:39.338241 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b1c84-eab5-4b04-b6a3-01c0a01ec78b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:39.338519 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b1c84-eab5-4b04-b6a3-01c0a01ec78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:39.363300 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-f87b1c84-eab5-4b04-b6a3-01c0a01ec78b None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:44:39.365039 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f87b1c84-eab5-4b04-b6a3-01c0a01ec78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:39.377307 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1227/2454] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:44:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:44:39.381824 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6217f5eb-e7ab-4b94-a420-cca507bba611 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:39.392293 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6217f5eb-e7ab-4b94-a420-cca507bba611 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:39.398198 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767d77a-15ae-454f-9b79-265d7d64f75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:39.398909 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767d77a-15ae-454f-9b79-265d7d64f75e admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:39.399184 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767d77a-15ae-454f-9b79-265d7d64f75e admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:39.399474 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767d77a-15ae-454f-9b79-265d7d64f75e admin admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:39.400196 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c767d77a-15ae-454f-9b79-265d7d64f75e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:44:39.400496 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c767d77a-15ae-454f-9b79-265d7d64f75e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:39.402155 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c767d77a-15ae-454f-9b79-265d7d64f75e admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:39.414715 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1228/2455] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:44:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:44:39.419330 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b1c84-eab5-4b04-b6a3-01c0a01ec78b None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:39.429718 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b1c84-eab5-4b04-b6a3-01c0a01ec78b None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:39.435568 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e94300-074f-493b-b3cb-19d7103ac6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:39.436238 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e94300-074f-493b-b3cb-19d7103ac6c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:39.436519 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e94300-074f-493b-b3cb-19d7103ac6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:39.436789 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e94300-074f-493b-b3cb-19d7103ac6c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:39.437482 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e94300-074f-493b-b3cb-19d7103ac6c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:39.439477 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e94300-074f-493b-b3cb-19d7103ac6c3 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:39.469568 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1228/2456] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:44:39 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:44:39.474355 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767d77a-15ae-454f-9b79-265d7d64f75e admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:39.484526 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767d77a-15ae-454f-9b79-265d7d64f75e admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:39.542705 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8eda83-80b6-4510-927a-166346233277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:39.543370 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8eda83-80b6-4510-927a-166346233277 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:39.543645 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8eda83-80b6-4510-927a-166346233277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:39.543917 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8eda83-80b6-4510-927a-166346233277 admin admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:39.544590 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8eda83-80b6-4510-927a-166346233277 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:39.546554 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8eda83-80b6-4510-927a-166346233277 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:39.575062 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1229/2457] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:44:39 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:44:39.579947 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e94300-074f-493b-b3cb-19d7103ac6c3 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:39.591327 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e94300-074f-493b-b3cb-19d7103ac6c3 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:39.596665 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5b3cc-d18b-4ce6-807c-ca773e9c2d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:39.597338 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5b3cc-d18b-4ce6-807c-ca773e9c2d53 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:39.597655 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5b3cc-d18b-4ce6-807c-ca773e9c2d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:39.597964 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5b3cc-d18b-4ce6-807c-ca773e9c2d53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:39.598705 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e5b3cc-d18b-4ce6-807c-ca773e9c2d53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:39.600341 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e5b3cc-d18b-4ce6-807c-ca773e9c2d53 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:39.611099 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1229/2458] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:44:39.615088 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8eda83-80b6-4510-927a-166346233277 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:39.626201 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8eda83-80b6-4510-927a-166346233277 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:39.631310 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d3f97f-7742-40fb-9a5a-ae0c5a7535a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:39.631970 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3f97f-7742-40fb-9a5a-ae0c5a7535a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:39.632251 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3f97f-7742-40fb-9a5a-ae0c5a7535a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:39.632529 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3f97f-7742-40fb-9a5a-ae0c5a7535a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:39.633264 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d3f97f-7742-40fb-9a5a-ae0c5a7535a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:39.634916 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d3f97f-7742-40fb-9a5a-ae0c5a7535a2 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:39.645256 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1230/2459] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:44:39.649419 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5b3cc-d18b-4ce6-807c-ca773e9c2d53 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:39.660168 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5b3cc-d18b-4ce6-807c-ca773e9c2d53 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:39.665667 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f58e17-ff6f-4b7c-a6eb-42a0c563293b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:39.666655 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f58e17-ff6f-4b7c-a6eb-42a0c563293b admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:39.666935 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f58e17-ff6f-4b7c-a6eb-42a0c563293b admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:39.667210 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f58e17-ff6f-4b7c-a6eb-42a0c563293b admin admin] PATH_INFO: `/v3/projects/a82b6b14ce154effb99966910eaf3fdb/users/5ce986d5cf85455b8071663ef4dc2ec6/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:39.682865 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f58e17-ff6f-4b7c-a6eb-42a0c563293b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a82b6b14ce154effb99966910eaf3fdb, user_id=5ce986d5cf85455b8071663ef4dc2ec6, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:39.685565 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f58e17-ff6f-4b7c-a6eb-42a0c563293b admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:39.702322 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1230/2460] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:44:39 2022] PUT /identity/v3/projects/a82b6b14ce154effb99966910eaf3fdb/users/5ce986d5cf85455b8071663ef4dc2ec6/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:44:39.714081 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716e837-e912-4879-b43d-d49ac74d47d6 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:39.714376 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716e837-e912-4879-b43d-d49ac74d47d6 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:39.714658 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716e837-e912-4879-b43d-d49ac74d47d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:39.741175 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-f716e837-e912-4879-b43d-d49ac74d47d6 None None] MFA Rules not processed for user `5ce986d5cf85455b8071663ef4dc2ec6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:44:39.742403 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-f716e837-e912-4879-b43d-d49ac74d47d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:39.774843 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:44:39.813021 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1231/2461] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:44:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:44:39.818470 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f58e17-ff6f-4b7c-a6eb-42a0c563293b admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:39.876706 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:44:39.882586 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f58e17-ff6f-4b7c-a6eb-42a0c563293b admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:39.888272 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9453262-b6d7-4d17-b56e-5f7980e1d0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:39.889000 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9453262-b6d7-4d17-b56e-5f7980e1d0a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:39.889275 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9453262-b6d7-4d17-b56e-5f7980e1d0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:39.889550 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9453262-b6d7-4d17-b56e-5f7980e1d0a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:39.890345 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9453262-b6d7-4d17-b56e-5f7980e1d0a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:39.892239 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9453262-b6d7-4d17-b56e-5f7980e1d0a9 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:39.920940 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1231/2462] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:44:39 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:44:39.925085 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716e837-e912-4879-b43d-d49ac74d47d6 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:39.936586 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716e837-e912-4879-b43d-d49ac74d47d6 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:39.996354 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139a919-05e2-49b5-a863-969c29f5f982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:39.997396 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139a919-05e2-49b5-a863-969c29f5f982 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:39.997856 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139a919-05e2-49b5-a863-969c29f5f982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:39.998730 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139a919-05e2-49b5-a863-969c29f5f982 admin admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:40.000316 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139a919-05e2-49b5-a863-969c29f5f982 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:40.003459 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139a919-05e2-49b5-a863-969c29f5f982 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:40.030046 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1232/2463] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:44:39 2022] POST /identity/v3/users => generated 298 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:44:40.034490 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9453262-b6d7-4d17-b56e-5f7980e1d0a9 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:40.045761 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9453262-b6d7-4d17-b56e-5f7980e1d0a9 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:40.051700 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc5cfb-e64d-4d49-aa7b-357422d43ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:40.052367 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc5cfb-e64d-4d49-aa7b-357422d43ab3 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:40.052638 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc5cfb-e64d-4d49-aa7b-357422d43ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:40.052918 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc5cfb-e64d-4d49-aa7b-357422d43ab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:40.053641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fc5cfb-e64d-4d49-aa7b-357422d43ab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:40.055334 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fc5cfb-e64d-4d49-aa7b-357422d43ab3 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:40.066258 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1232/2464] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:44:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 17:44:40.072316 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139a919-05e2-49b5-a863-969c29f5f982 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:40.087199 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139a919-05e2-49b5-a863-969c29f5f982 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:40.094863 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962dbe31-b9ad-4402-82ed-f483eabb58d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:40.095753 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962dbe31-b9ad-4402-82ed-f483eabb58d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:40.096053 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962dbe31-b9ad-4402-82ed-f483eabb58d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:40.096327 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962dbe31-b9ad-4402-82ed-f483eabb58d9 admin admin] PATH_INFO: `/v3/projects/e77f64f4eb7f4121a63cf592faad4d0e/users/05159461f85c45268c356b427e5570fd/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:40.111573 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962dbe31-b9ad-4402-82ed-f483eabb58d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e77f64f4eb7f4121a63cf592faad4d0e, user_id=05159461f85c45268c356b427e5570fd, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:40.114264 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962dbe31-b9ad-4402-82ed-f483eabb58d9 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:40.130638 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1233/2465] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:44:40 2022] PUT /identity/v3/projects/e77f64f4eb7f4121a63cf592faad4d0e/users/05159461f85c45268c356b427e5570fd/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:44:40.134723 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc5cfb-e64d-4d49-aa7b-357422d43ab3 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:40.144919 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc5cfb-e64d-4d49-aa7b-357422d43ab3 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:40.201793 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d499d366-478b-46f1-8e6b-91e3e36eabe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:40.202513 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499d366-478b-46f1-8e6b-91e3e36eabe9 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:40.202798 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499d366-478b-46f1-8e6b-91e3e36eabe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:40.203112 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499d366-478b-46f1-8e6b-91e3e36eabe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:40.203832 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d499d366-478b-46f1-8e6b-91e3e36eabe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:40.205489 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d499d366-478b-46f1-8e6b-91e3e36eabe9 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:40.215324 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1233/2466] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:44:40 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:44:40.219703 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962dbe31-b9ad-4402-82ed-f483eabb58d9 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:40.230229 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962dbe31-b9ad-4402-82ed-f483eabb58d9 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:40.236044 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993430b3-0522-410b-a9a3-88209a711d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:40.236977 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993430b3-0522-410b-a9a3-88209a711d4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:40.237284 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993430b3-0522-410b-a9a3-88209a711d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:40.237618 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993430b3-0522-410b-a9a3-88209a711d4c admin admin] PATH_INFO: `/v3/projects/e77f64f4eb7f4121a63cf592faad4d0e/users/05159461f85c45268c356b427e5570fd/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:40.239922 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993430b3-0522-410b-a9a3-88209a711d4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e77f64f4eb7f4121a63cf592faad4d0e, user_id=05159461f85c45268c356b427e5570fd, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:40.242690 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993430b3-0522-410b-a9a3-88209a711d4c admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:40.253593 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1234/2467] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:44:40 2022] PUT /identity/v3/projects/e77f64f4eb7f4121a63cf592faad4d0e/users/05159461f85c45268c356b427e5570fd/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:44:40.263940 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a503e9-1ab5-4bd5-b94d-be111dd681d3 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:40.264230 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a503e9-1ab5-4bd5-b94d-be111dd681d3 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:40.264499 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a503e9-1ab5-4bd5-b94d-be111dd681d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:40.293496 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-20a503e9-1ab5-4bd5-b94d-be111dd681d3 None None] MFA Rules not processed for user `05159461f85c45268c356b427e5570fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:44:40.294859 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-20a503e9-1ab5-4bd5-b94d-be111dd681d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:40.366131 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1234/2468] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:44:40 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:44:40.377703 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993430b3-0522-410b-a9a3-88209a711d4c admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:40.379747 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-993430b3-0522-410b-a9a3-88209a711d4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:40.440810 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993430b3-0522-410b-a9a3-88209a711d4c admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:40.447087 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a375c16d-3459-4f33-8aeb-e22db84d05cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:40.447921 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375c16d-3459-4f33-8aeb-e22db84d05cd service cinder] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:40.448235 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375c16d-3459-4f33-8aeb-e22db84d05cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:40.448525 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375c16d-3459-4f33-8aeb-e22db84d05cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:40.490377 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:44:40.513804 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a375c16d-3459-4f33-8aeb-e22db84d05cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:40.515548 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a375c16d-3459-4f33-8aeb-e22db84d05cd service cinder] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:40.525393 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1235/2469] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:44:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:44:44.960026 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a503e9-1ab5-4bd5-b94d-be111dd681d3 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:44.962756 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-20a503e9-1ab5-4bd5-b94d-be111dd681d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:44.979631 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a503e9-1ab5-4bd5-b94d-be111dd681d3 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:44.987668 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec0ceb-4511-4d7a-869d-00251bc4410f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:44.988792 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec0ceb-4511-4d7a-869d-00251bc4410f service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:44.989219 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec0ceb-4511-4d7a-869d-00251bc4410f service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:44.989498 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec0ceb-4511-4d7a-869d-00251bc4410f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:45.002628 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec0ceb-4511-4d7a-869d-00251bc4410f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:45.004046 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec0ceb-4511-4d7a-869d-00251bc4410f service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:45.015975 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1235/2470] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:44:44 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:44:50.021594 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a375c16d-3459-4f33-8aeb-e22db84d05cd service cinder] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:50.114074 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a375c16d-3459-4f33-8aeb-e22db84d05cd service cinder] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:50.119549 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef67b2-d1bd-4d5e-a08c-383ce588c9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:50.120481 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef67b2-d1bd-4d5e-a08c-383ce588c9cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:50.120748 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef67b2-d1bd-4d5e-a08c-383ce588c9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:50.121011 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef67b2-d1bd-4d5e-a08c-383ce588c9cf admin admin] PATH_INFO: `/v3/users/5ce986d5cf85455b8071663ef4dc2ec6` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:50.122381 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fef67b2-d1bd-4d5e-a08c-383ce588c9cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ce986d5cf85455b8071663ef4dc2ec6)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:50.124297 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fef67b2-d1bd-4d5e-a08c-383ce588c9cf admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:50.179181 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-1fef67b2-d1bd-4d5e-a08c-383ce588c9cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ce986d5cf85455b8071663ef4dc2ec6'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:50.179898 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-1fef67b2-d1bd-4d5e-a08c-383ce588c9cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ce986d5cf85455b8071663ef4dc2ec6'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:50.186669 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-1fef67b2-d1bd-4d5e-a08c-383ce588c9cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ce986d5cf85455b8071663ef4dc2ec6'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:50.187359 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-1fef67b2-d1bd-4d5e-a08c-383ce588c9cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ce986d5cf85455b8071663ef4dc2ec6'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:50.202114 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-1fef67b2-d1bd-4d5e-a08c-383ce588c9cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ce986d5cf85455b8071663ef4dc2ec6'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:50.217435 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1236/2471] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:44:50 2022] DELETE /identity/v3/users/5ce986d5cf85455b8071663ef4dc2ec6 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:44:50.222101 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ee961-bff1-4e0e-8499-9c7d8ba738a3 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:50.222613 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ee961-bff1-4e0e-8499-9c7d8ba738a3 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:50.222911 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ee961-bff1-4e0e-8499-9c7d8ba738a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:50.242796 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-fb2ee961-bff1-4e0e-8499-9c7d8ba738a3 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:44:50.243934 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-fb2ee961-bff1-4e0e-8499-9c7d8ba738a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:50.277652 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:44:50.309196 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1236/2472] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:44:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:44:50.319800 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef67b2-d1bd-4d5e-a08c-383ce588c9cf admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:50.321412 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-1fef67b2-d1bd-4d5e-a08c-383ce588c9cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:50.382918 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef67b2-d1bd-4d5e-a08c-383ce588c9cf admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:50.388541 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4c46f-f9f5-4fba-a3e8-effa2c8abd5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:50.389195 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4c46f-f9f5-4fba-a3e8-effa2c8abd5c service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:50.389470 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4c46f-f9f5-4fba-a3e8-effa2c8abd5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:50.389737 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4c46f-f9f5-4fba-a3e8-effa2c8abd5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:50.400506 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b4c46f-f9f5-4fba-a3e8-effa2c8abd5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:50.402077 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b4c46f-f9f5-4fba-a3e8-effa2c8abd5c service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:50.412311 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1237/2473] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:44:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:44:50.709305 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ee961-bff1-4e0e-8499-9c7d8ba738a3 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:50.711393 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-fb2ee961-bff1-4e0e-8499-9c7d8ba738a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:50.726798 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ee961-bff1-4e0e-8499-9c7d8ba738a3 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:50.732194 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d137c-bcdd-4ca1-8b4e-06c746055226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:50.733115 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d137c-bcdd-4ca1-8b4e-06c746055226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:50.733398 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d137c-bcdd-4ca1-8b4e-06c746055226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:50.733667 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d137c-bcdd-4ca1-8b4e-06c746055226 admin admin] PATH_INFO: `/v3/projects/a82b6b14ce154effb99966910eaf3fdb` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:50.734988 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d137c-bcdd-4ca1-8b4e-06c746055226 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a82b6b14ce154effb99966910eaf3fdb)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:50.737036 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d137c-bcdd-4ca1-8b4e-06c746055226 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:50.787084 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-db6d137c-bcdd-4ca1-8b4e-06c746055226 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a82b6b14ce154effb99966910eaf3fdb', 'request_id': 'req-db6d137c-bcdd-4ca1-8b4e-06c746055226'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:50.796912 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-db6d137c-bcdd-4ca1-8b4e-06c746055226 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a82b6b14ce154effb99966910eaf3fdb', 'request_id': 'req-db6d137c-bcdd-4ca1-8b4e-06c746055226'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:50.803406 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-db6d137c-bcdd-4ca1-8b4e-06c746055226 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a82b6b14ce154effb99966910eaf3fdb', 'request_id': 'req-db6d137c-bcdd-4ca1-8b4e-06c746055226'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:50.814552 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-db6d137c-bcdd-4ca1-8b4e-06c746055226 admin admin] The token cache is being invalidate because project a82b6b14ce154effb99966910eaf3fdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:44:50.814835 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-db6d137c-bcdd-4ca1-8b4e-06c746055226 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:50.815454 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-db6d137c-bcdd-4ca1-8b4e-06c746055226 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:50.817425 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1237/2474] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:44:50 2022] DELETE /identity/v3/projects/a82b6b14ce154effb99966910eaf3fdb => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:44:50.821448 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4c46f-f9f5-4fba-a3e8-effa2c8abd5c service neutron] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:50.826273 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:44:50.832205 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4c46f-f9f5-4fba-a3e8-effa2c8abd5c service neutron] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:50.889955 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ba70a-3167-49f1-af0e-a380f41122b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:50.890842 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ba70a-3167-49f1-af0e-a380f41122b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:50.891120 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ba70a-3167-49f1-af0e-a380f41122b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:50.891404 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ba70a-3167-49f1-af0e-a380f41122b6 admin admin] PATH_INFO: `/v3/users/05159461f85c45268c356b427e5570fd` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:50.892602 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5ba70a-3167-49f1-af0e-a380f41122b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05159461f85c45268c356b427e5570fd)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:50.894678 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5ba70a-3167-49f1-af0e-a380f41122b6 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:50.942445 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-2b5ba70a-3167-49f1-af0e-a380f41122b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05159461f85c45268c356b427e5570fd'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:50.943142 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-2b5ba70a-3167-49f1-af0e-a380f41122b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05159461f85c45268c356b427e5570fd'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:50.950068 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-2b5ba70a-3167-49f1-af0e-a380f41122b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05159461f85c45268c356b427e5570fd'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:50.950718 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-2b5ba70a-3167-49f1-af0e-a380f41122b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05159461f85c45268c356b427e5570fd'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:50.964230 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-2b5ba70a-3167-49f1-af0e-a380f41122b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05159461f85c45268c356b427e5570fd'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:50.978975 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1238/2475] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:44:50 2022] DELETE /identity/v3/users/05159461f85c45268c356b427e5570fd => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:44:51.254391 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d137c-bcdd-4ca1-8b4e-06c746055226 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:44:51.255874 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-db6d137c-bcdd-4ca1-8b4e-06c746055226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:44:51.269305 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d137c-bcdd-4ca1-8b4e-06c746055226 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:44:51.338268 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb563d-1704-4b83-abd0-f83d9155a380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:44:51.339064 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb563d-1704-4b83-abd0-f83d9155a380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:44:51.339345 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb563d-1704-4b83-abd0-f83d9155a380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:44:51.339609 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb563d-1704-4b83-abd0-f83d9155a380 admin admin] PATH_INFO: `/v3/projects/e77f64f4eb7f4121a63cf592faad4d0e` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:44:51.340849 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb563d-1704-4b83-abd0-f83d9155a380 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e77f64f4eb7f4121a63cf592faad4d0e)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:44:51.342797 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb563d-1704-4b83-abd0-f83d9155a380 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:44:51.391390 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-bbcb563d-1704-4b83-abd0-f83d9155a380 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e77f64f4eb7f4121a63cf592faad4d0e', 'request_id': 'req-bbcb563d-1704-4b83-abd0-f83d9155a380'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:51.399600 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-bbcb563d-1704-4b83-abd0-f83d9155a380 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e77f64f4eb7f4121a63cf592faad4d0e', 'request_id': 'req-bbcb563d-1704-4b83-abd0-f83d9155a380'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:51.404504 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:44:51.405664 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-bbcb563d-1704-4b83-abd0-f83d9155a380 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e77f64f4eb7f4121a63cf592faad4d0e', 'request_id': 'req-bbcb563d-1704-4b83-abd0-f83d9155a380'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:51.420217 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-bbcb563d-1704-4b83-abd0-f83d9155a380 admin admin] The token cache is being invalidate because project e77f64f4eb7f4121a63cf592faad4d0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:44:51.420502 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-bbcb563d-1704-4b83-abd0-f83d9155a380 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:51.421219 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-bbcb563d-1704-4b83-abd0-f83d9155a380 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:44:51.422925 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1238/2476] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:44:51 2022] DELETE /identity/v3/projects/e77f64f4eb7f4121a63cf592faad4d0e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:45:00.975437 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=52,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:45:01.419606 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=4 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:45:18.570382 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3534f94-257e-48eb-b334-524a41dc21f4 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:45:18.570899 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3534f94-257e-48eb-b334-524a41dc21f4 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:45:18.570899 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3534f94-257e-48eb-b334-524a41dc21f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:45:18.589271 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-c3534f94-257e-48eb-b334-524a41dc21f4 None None] MFA Rules not processed for user `1332dc25fb5c4d5b8ed7bd0bd77243d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:45:18.590503 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-c3534f94-257e-48eb-b334-524a41dc21f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:45:18.647532 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1239/2477] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:45:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:45:28.640772 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=25 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:45:43.743306 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d76c87-1356-4cb4-a73b-1a373b9fd94b None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:45:43.743861 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d76c87-1356-4cb4-a73b-1a373b9fd94b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:45:43.743861 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d76c87-1356-4cb4-a73b-1a373b9fd94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:45:43.785564 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-59d76c87-1356-4cb4-a73b-1a373b9fd94b None None] MFA Rules not processed for user `b73d09bd7c1e4753a45cfdb00cc5abe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:45:43.786816 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-59d76c87-1356-4cb4-a73b-1a373b9fd94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:45:43.878748 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1239/2478] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Jul 15 17:45:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:45:43.936247 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3534f94-257e-48eb-b334-524a41dc21f4 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:45:43.938423 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-c3534f94-257e-48eb-b334-524a41dc21f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:45:44.044260 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3534f94-257e-48eb-b334-524a41dc21f4 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:45:44.049872 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ed61e-9c68-404a-a01d-792a0d28e43f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dea565b75784465a8ea073883261d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:45:44.050520 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ed61e-9c68-404a-a01d-792a0d28e43f service swift] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:45:44.050799 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ed61e-9c68-404a-a01d-792a0d28e43f service swift] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:45:44.051072 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ed61e-9c68-404a-a01d-792a0d28e43f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:45:44.060132 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ed61e-9c68-404a-a01d-792a0d28e43f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:45:44.061714 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ed61e-9c68-404a-a01d-792a0d28e43f service swift] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:45:44.070390 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1240/2479] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Jul 15 17:45:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 17:45:45.211340 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d76c87-1356-4cb4-a73b-1a373b9fd94b None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:45:45.212999 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-59d76c87-1356-4cb4-a73b-1a373b9fd94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:45:45.333644 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d76c87-1356-4cb4-a73b-1a373b9fd94b None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:45:45.346357 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f29ed4-3bdd-44b9-9fcb-b2a5eb14b84b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96b2105f8d29443383ed51a8fd5cec6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:45:45.347577 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f29ed4-3bdd-44b9-9fcb-b2a5eb14b84b service placement] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:45:45.347854 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f29ed4-3bdd-44b9-9fcb-b2a5eb14b84b service placement] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:45:45.348126 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f29ed4-3bdd-44b9-9fcb-b2a5eb14b84b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:45:45.350009 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-43f29ed4-3bdd-44b9-9fcb-b2a5eb14b84b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:45:45.366031 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f29ed4-3bdd-44b9-9fcb-b2a5eb14b84b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:45:45.367652 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f29ed4-3bdd-44b9-9fcb-b2a5eb14b84b service placement] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:45:45.383740 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1240/2480] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:45:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:45:54.067034 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=47 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:45:55.375194 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=86 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:45:58.390002 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b40253-da85-4056-a4fb-dbc76952c9d9 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:45:58.390571 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b40253-da85-4056-a4fb-dbc76952c9d9 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:45:58.390571 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b40253-da85-4056-a4fb-dbc76952c9d9 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:45:58.391965 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1241/2481] 10.222.0.27 () {54 vars in 921 bytes} [Fri Jul 15 17:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:45:58.398076 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf71b48-bdd3-4920-9ace-dcb24c6253b4 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:45:58.398630 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf71b48-bdd3-4920-9ace-dcb24c6253b4 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:45:58.398827 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf71b48-bdd3-4920-9ace-dcb24c6253b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:45:58.442211 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-5cf71b48-bdd3-4920-9ace-dcb24c6253b4 None None] MFA Rules not processed for user `f9d548c8199e4fdbbce7597bebd63421`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:45:58.443704 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5cf71b48-bdd3-4920-9ace-dcb24c6253b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:45:58.523166 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1241/2482] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Jul 15 17:45:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:45:58.534463 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b40253-da85-4056-a4fb-dbc76952c9d9 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:45:58.536259 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-66b40253-da85-4056-a4fb-dbc76952c9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:45:58.599594 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b40253-da85-4056-a4fb-dbc76952c9d9 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:45:58.603529 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432d2a3-7767-4188-9f44-9d94eb83f508 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14775984c9d4463a8e8848dcf189714b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:45:58.604176 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432d2a3-7767-4188-9f44-9d94eb83f508 service glance] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:45:58.604454 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432d2a3-7767-4188-9f44-9d94eb83f508 service glance] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:45:58.604723 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432d2a3-7767-4188-9f44-9d94eb83f508 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:45:58.622443 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8432d2a3-7767-4188-9f44-9d94eb83f508 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:45:58.624613 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8432d2a3-7767-4188-9f44-9d94eb83f508 service glance] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:45:58.637547 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1242/2483] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:45:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:45:58.715646 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d119a-c30a-4a79-a55c-a0fdbbbada2e None None] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:45:58.715898 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d119a-c30a-4a79-a55c-a0fdbbbada2e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:45:58.716198 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d119a-c30a-4a79-a55c-a0fdbbbada2e None None] PATH_INFO: `/` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:45:58.717622 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1242/2484] 10.222.0.27 () {54 vars in 921 bytes} [Fri Jul 15 17:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 17:45:58.722473 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc7d62-de6a-4b0e-8f94-20cc3bea206d None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:45:58.722765 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc7d62-de6a-4b0e-8f94-20cc3bea206d None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:45:58.723046 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc7d62-de6a-4b0e-8f94-20cc3bea206d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:45:58.756199 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-d2cc7d62-de6a-4b0e-8f94-20cc3bea206d None None] MFA Rules not processed for user `989272e5e803405d87d0833d503bb572`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:45:58.757398 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-d2cc7d62-de6a-4b0e-8f94-20cc3bea206d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:45:58.825543 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1243/2485] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Jul 15 17:45:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:45:58.837564 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d119a-c30a-4a79-a55c-a0fdbbbada2e None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:45:58.839530 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-471d119a-c30a-4a79-a55c-a0fdbbbada2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:45:58.854466 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d119a-c30a-4a79-a55c-a0fdbbbada2e None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:45:58.858258 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e00795-c791-4893-9192-854abda0f8f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:45:58.858904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e00795-c791-4893-9192-854abda0f8f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:45:58.859185 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e00795-c791-4893-9192-854abda0f8f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:45:58.859457 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e00795-c791-4893-9192-854abda0f8f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:45:58.866848 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e00795-c791-4893-9192-854abda0f8f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:45:58.868368 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e00795-c791-4893-9192-854abda0f8f9 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:45:58.876552 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1243/2486] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:45:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:45:58.964909 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa387208-a69c-41c6-81f8-9017754219a2 None None] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:45:58.965217 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa387208-a69c-41c6-81f8-9017754219a2 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:45:58.965609 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa387208-a69c-41c6-81f8-9017754219a2 None None] PATH_INFO: `/` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:45:58.967712 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1244/2487] 10.222.0.27 () {54 vars in 921 bytes} [Fri Jul 15 17:45:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 17:45:58.973608 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3c513-cccd-4af7-950c-32543b9996c9 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:45:58.974220 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3c513-cccd-4af7-950c-32543b9996c9 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:45:58.974220 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3c513-cccd-4af7-950c-32543b9996c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:45:58.994561 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-d2a3c513-cccd-4af7-950c-32543b9996c9 None None] MFA Rules not processed for user `f9d548c8199e4fdbbce7597bebd63421`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:45:58.995773 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d2a3c513-cccd-4af7-950c-32543b9996c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:45:59.005881 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1244/2488] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Jul 15 17:45:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:45:59.017324 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa387208-a69c-41c6-81f8-9017754219a2 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:45:59.019399 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-fa387208-a69c-41c6-81f8-9017754219a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:45:59.035203 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa387208-a69c-41c6-81f8-9017754219a2 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:45:59.039496 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e119ba-0dd0-4e2d-a351-48c23f63a542 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:45:59.040130 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e119ba-0dd0-4e2d-a351-48c23f63a542 service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:45:59.040404 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e119ba-0dd0-4e2d-a351-48c23f63a542 service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:45:59.040672 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e119ba-0dd0-4e2d-a351-48c23f63a542 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:45:59.051777 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e119ba-0dd0-4e2d-a351-48c23f63a542 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:45:59.053043 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e119ba-0dd0-4e2d-a351-48c23f63a542 service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:45:59.063697 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1245/2489] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:45:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:46:00.983036 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa4e64-cbde-4ff1-b435-22cd44b14fad None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:00.983506 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa4e64-cbde-4ff1-b435-22cd44b14fad None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:00.983682 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa4e64-cbde-4ff1-b435-22cd44b14fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:01.002547 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-b9aa4e64-cbde-4ff1-b435-22cd44b14fad None None] MFA Rules not processed for user `b73d09bd7c1e4753a45cfdb00cc5abe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:46:01.003754 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b9aa4e64-cbde-4ff1-b435-22cd44b14fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:46:01.011752 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1245/2490] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Jul 15 17:46:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:46:01.024482 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e119ba-0dd0-4e2d-a351-48c23f63a542 service neutron] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:01.037244 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e119ba-0dd0-4e2d-a351-48c23f63a542 service neutron] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:01.042653 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a576d4-5ece-43c8-a5fd-4b9187459c7f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dea565b75784465a8ea073883261d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:01.043307 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a576d4-5ece-43c8-a5fd-4b9187459c7f service swift] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:01.043584 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a576d4-5ece-43c8-a5fd-4b9187459c7f service swift] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:01.043853 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a576d4-5ece-43c8-a5fd-4b9187459c7f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:01.052667 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a576d4-5ece-43c8-a5fd-4b9187459c7f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:01.054336 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a576d4-5ece-43c8-a5fd-4b9187459c7f service swift] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:01.063188 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1246/2491] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Jul 15 17:46:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 17:46:10.997311 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=56 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:46:11.059594 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=70 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:46:22.146088 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615efae9-b823-4a8f-82a1-aebf0c908497 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:22.146690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615efae9-b823-4a8f-82a1-aebf0c908497 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:22.146690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615efae9-b823-4a8f-82a1-aebf0c908497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:22.166587 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-615efae9-b823-4a8f-82a1-aebf0c908497 None None] MFA Rules not processed for user `b73d09bd7c1e4753a45cfdb00cc5abe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:46:22.167926 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-615efae9-b823-4a8f-82a1-aebf0c908497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:46:22.176245 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1246/2492] 10.222.0.27 () {58 vars in 967 bytes} [Fri Jul 15 17:46:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:46:22.188683 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a576d4-5ece-43c8-a5fd-4b9187459c7f service swift] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:22.200247 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a576d4-5ece-43c8-a5fd-4b9187459c7f service swift] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:22.206466 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaab135-0664-4af5-9e04-91e06c9f11f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dea565b75784465a8ea073883261d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:22.207268 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaab135-0664-4af5-9e04-91e06c9f11f7 service swift] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:22.207549 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaab135-0664-4af5-9e04-91e06c9f11f7 service swift] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:22.207822 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaab135-0664-4af5-9e04-91e06c9f11f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:22.216479 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaab135-0664-4af5-9e04-91e06c9f11f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:22.218154 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaab135-0664-4af5-9e04-91e06c9f11f7 service swift] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:22.227410 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1247/2493] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Jul 15 17:46:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 17:46:32.160794 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:46:32.223982 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=6 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:46:33.395194 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615efae9-b823-4a8f-82a1-aebf0c908497 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:33.405923 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615efae9-b823-4a8f-82a1-aebf0c908497 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:33.409710 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74137f5c-cbe6-4efb-8b54-1cecb0d3007e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:33.410416 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74137f5c-cbe6-4efb-8b54-1cecb0d3007e service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:33.410676 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74137f5c-cbe6-4efb-8b54-1cecb0d3007e service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:33.410963 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74137f5c-cbe6-4efb-8b54-1cecb0d3007e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:33.413009 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-74137f5c-cbe6-4efb-8b54-1cecb0d3007e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:46:33.513734 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74137f5c-cbe6-4efb-8b54-1cecb0d3007e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:33.515200 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74137f5c-cbe6-4efb-8b54-1cecb0d3007e service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:33.535442 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1247/2494] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:46:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:46:36.717302 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaab135-0664-4af5-9e04-91e06c9f11f7 service swift] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:36.718914 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-ebaab135-0664-4af5-9e04-91e06c9f11f7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:46:36.733816 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaab135-0664-4af5-9e04-91e06c9f11f7 service swift] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:36.738633 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d68aa-3c98-476d-9516-5c9c660b419e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:36.739527 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d68aa-3c98-476d-9516-5c9c660b419e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:36.739807 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d68aa-3c98-476d-9516-5c9c660b419e admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:36.740081 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d68aa-3c98-476d-9516-5c9c660b419e admin admin] PATH_INFO: `/v3/users/9925dde3c53843e48e59cf353a857956` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:36.741288 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702d68aa-3c98-476d-9516-5c9c660b419e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9925dde3c53843e48e59cf353a857956)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:36.743792 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702d68aa-3c98-476d-9516-5c9c660b419e admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:36.792880 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-702d68aa-3c98-476d-9516-5c9c660b419e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9925dde3c53843e48e59cf353a857956'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:36.793556 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-702d68aa-3c98-476d-9516-5c9c660b419e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9925dde3c53843e48e59cf353a857956'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:36.800862 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-702d68aa-3c98-476d-9516-5c9c660b419e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9925dde3c53843e48e59cf353a857956'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:36.801517 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-702d68aa-3c98-476d-9516-5c9c660b419e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9925dde3c53843e48e59cf353a857956'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:36.813761 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-702d68aa-3c98-476d-9516-5c9c660b419e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9925dde3c53843e48e59cf353a857956'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:36.828895 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1248/2495] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:46:36 2022] DELETE /identity/v3/users/9925dde3c53843e48e59cf353a857956 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:46:37.008867 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74137f5c-cbe6-4efb-8b54-1cecb0d3007e service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:37.019232 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74137f5c-cbe6-4efb-8b54-1cecb0d3007e service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:37.091695 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e156694d-c207-4426-961d-7614a2d37b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:37.092578 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156694d-c207-4426-961d-7614a2d37b11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:37.092856 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156694d-c207-4426-961d-7614a2d37b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:37.093116 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156694d-c207-4426-961d-7614a2d37b11 admin admin] PATH_INFO: `/v3/projects/b74558f098234027b1d9067e7132b258` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:37.094468 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e156694d-c207-4426-961d-7614a2d37b11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b74558f098234027b1d9067e7132b258)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:37.096377 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e156694d-c207-4426-961d-7614a2d37b11 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:37.146335 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e156694d-c207-4426-961d-7614a2d37b11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b74558f098234027b1d9067e7132b258', 'request_id': 'req-e156694d-c207-4426-961d-7614a2d37b11'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:37.155906 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e156694d-c207-4426-961d-7614a2d37b11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b74558f098234027b1d9067e7132b258', 'request_id': 'req-e156694d-c207-4426-961d-7614a2d37b11'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:37.161528 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e156694d-c207-4426-961d-7614a2d37b11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b74558f098234027b1d9067e7132b258', 'request_id': 'req-e156694d-c207-4426-961d-7614a2d37b11'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:37.163406 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:46:37.174643 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e156694d-c207-4426-961d-7614a2d37b11 admin admin] The token cache is being invalidate because project b74558f098234027b1d9067e7132b258 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:46:37.174971 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e156694d-c207-4426-961d-7614a2d37b11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:37.176104 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-e156694d-c207-4426-961d-7614a2d37b11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:37.177709 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1248/2496] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:46:37 2022] DELETE /identity/v3/projects/b74558f098234027b1d9067e7132b258 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:46:37.183177 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345bd3c1-50d7-46c1-b575-d0dfcdb6cc46 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:37.183462 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345bd3c1-50d7-46c1-b575-d0dfcdb6cc46 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:37.183731 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345bd3c1-50d7-46c1-b575-d0dfcdb6cc46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:37.232723 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-345bd3c1-50d7-46c1-b575-d0dfcdb6cc46 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:46:37.234012 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-345bd3c1-50d7-46c1-b575-d0dfcdb6cc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:46:37.296629 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1249/2497] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:46:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:46:37.305880 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9b961-df20-49f9-a521-c3a1a033fa12 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:37.305880 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9b961-df20-49f9-a521-c3a1a033fa12 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:37.306166 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9b961-df20-49f9-a521-c3a1a033fa12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:37.325614 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-fff9b961-df20-49f9-a521-c3a1a033fa12 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:46:37.326871 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-fff9b961-df20-49f9-a521-c3a1a033fa12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:46:37.335769 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1249/2498] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:46:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:46:37.340430 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345bd3c1-50d7-46c1-b575-d0dfcdb6cc46 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:37.350323 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345bd3c1-50d7-46c1-b575-d0dfcdb6cc46 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:37.355949 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ae452-8fa5-4270-b917-10080d719ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:37.356611 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ae452-8fa5-4270-b917-10080d719ede admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:37.356900 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ae452-8fa5-4270-b917-10080d719ede admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:37.357168 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ae452-8fa5-4270-b917-10080d719ede admin admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:37.357923 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ae452-8fa5-4270-b917-10080d719ede admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:46:37.358506 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ae452-8fa5-4270-b917-10080d719ede admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:37.360105 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ae452-8fa5-4270-b917-10080d719ede admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:37.372957 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1250/2499] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:46:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:46:37.377389 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9b961-df20-49f9-a521-c3a1a033fa12 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:37.387497 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9b961-df20-49f9-a521-c3a1a033fa12 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:37.393152 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293cca57-1a9b-47b0-8177-cce53ca9fa5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:37.393874 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293cca57-1a9b-47b0-8177-cce53ca9fa5a admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:37.394162 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293cca57-1a9b-47b0-8177-cce53ca9fa5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:37.394433 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293cca57-1a9b-47b0-8177-cce53ca9fa5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:37.395125 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293cca57-1a9b-47b0-8177-cce53ca9fa5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:37.397028 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293cca57-1a9b-47b0-8177-cce53ca9fa5a admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:37.426494 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1250/2500] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:46:37 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:46:37.430927 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ae452-8fa5-4270-b917-10080d719ede admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:37.444445 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ae452-8fa5-4270-b917-10080d719ede admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:37.479497 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:46:37.513649 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c941e1-c4fb-42e5-81c0-711e6aca843a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:37.514409 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c941e1-c4fb-42e5-81c0-711e6aca843a admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:37.514688 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c941e1-c4fb-42e5-81c0-711e6aca843a admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:37.514958 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c941e1-c4fb-42e5-81c0-711e6aca843a admin admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:37.515659 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c941e1-c4fb-42e5-81c0-711e6aca843a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:37.517603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c941e1-c4fb-42e5-81c0-711e6aca843a admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:37.541541 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1251/2501] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:46:37 2022] POST /identity/v3/users => generated 283 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:46:37.547762 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293cca57-1a9b-47b0-8177-cce53ca9fa5a admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:37.558735 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293cca57-1a9b-47b0-8177-cce53ca9fa5a admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:37.563996 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3d847-4e2a-4e8f-ab72-eab7456e7ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:37.564660 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3d847-4e2a-4e8f-ab72-eab7456e7ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:37.565387 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3d847-4e2a-4e8f-ab72-eab7456e7ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:37.565667 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3d847-4e2a-4e8f-ab72-eab7456e7ba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:37.566434 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e3d847-4e2a-4e8f-ab72-eab7456e7ba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:37.568043 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e3d847-4e2a-4e8f-ab72-eab7456e7ba2 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:37.578657 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1251/2502] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 17:46:37.582654 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c941e1-c4fb-42e5-81c0-711e6aca843a admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:37.592818 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c941e1-c4fb-42e5-81c0-711e6aca843a admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:37.597911 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae65b8f-54a6-4085-80d7-5d731246f78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:37.598568 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae65b8f-54a6-4085-80d7-5d731246f78b admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:37.598844 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae65b8f-54a6-4085-80d7-5d731246f78b admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:37.599115 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae65b8f-54a6-4085-80d7-5d731246f78b admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:37.599827 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae65b8f-54a6-4085-80d7-5d731246f78b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:37.601416 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae65b8f-54a6-4085-80d7-5d731246f78b admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:37.614467 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1252/2503] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:46:37.619309 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3d847-4e2a-4e8f-ab72-eab7456e7ba2 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:37.634443 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3d847-4e2a-4e8f-ab72-eab7456e7ba2 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:37.641839 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7dfe69-8a3b-4cdc-ae0e-d0e9f97403d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:37.643148 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7dfe69-8a3b-4cdc-ae0e-d0e9f97403d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:37.643446 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7dfe69-8a3b-4cdc-ae0e-d0e9f97403d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:37.643689 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7dfe69-8a3b-4cdc-ae0e-d0e9f97403d0 admin admin] PATH_INFO: `/v3/projects/3433aa62f0ed4a6785ce861cc5e83684/users/9792bb28a12f46e2bf5d9073216b8f30/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:37.662297 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7dfe69-8a3b-4cdc-ae0e-d0e9f97403d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3433aa62f0ed4a6785ce861cc5e83684, user_id=9792bb28a12f46e2bf5d9073216b8f30, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:37.665162 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7dfe69-8a3b-4cdc-ae0e-d0e9f97403d0 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:37.682499 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1252/2504] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:46:37 2022] PUT /identity/v3/projects/3433aa62f0ed4a6785ce861cc5e83684/users/9792bb28a12f46e2bf5d9073216b8f30/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:46:37.693360 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f0eea-3b96-41af-bbe1-85031e886b37 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:37.693642 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f0eea-3b96-41af-bbe1-85031e886b37 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:37.693950 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f0eea-3b96-41af-bbe1-85031e886b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:37.723599 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-c03f0eea-3b96-41af-bbe1-85031e886b37 None None] MFA Rules not processed for user `9792bb28a12f46e2bf5d9073216b8f30`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:46:37.725011 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-c03f0eea-3b96-41af-bbe1-85031e886b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:46:37.796962 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1253/2505] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:46:37 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:46:37.801815 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7dfe69-8a3b-4cdc-ae0e-d0e9f97403d0 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:37.866641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7dfe69-8a3b-4cdc-ae0e-d0e9f97403d0 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:37.871676 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9afeb-557c-493d-b9be-fbad4ff63add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:37.872344 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9afeb-557c-493d-b9be-fbad4ff63add admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:37.872624 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9afeb-557c-493d-b9be-fbad4ff63add admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:37.872898 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9afeb-557c-493d-b9be-fbad4ff63add admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:37.873584 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9afeb-557c-493d-b9be-fbad4ff63add admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:37.875604 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9afeb-557c-493d-b9be-fbad4ff63add admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:37.903515 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1253/2506] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:46:37 2022] POST /identity/v3/projects => generated 365 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:46:37.907787 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f0eea-3b96-41af-bbe1-85031e886b37 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:37.919667 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f0eea-3b96-41af-bbe1-85031e886b37 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:37.982445 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b096d-0e49-47cc-bd67-7730409b911e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:37.983164 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b096d-0e49-47cc-bd67-7730409b911e admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:37.983447 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b096d-0e49-47cc-bd67-7730409b911e admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:37.983717 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b096d-0e49-47cc-bd67-7730409b911e admin admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:37.984402 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0b096d-0e49-47cc-bd67-7730409b911e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:37.986365 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0b096d-0e49-47cc-bd67-7730409b911e admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:38.013520 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1254/2507] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:46:37 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:46:38.018392 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9afeb-557c-493d-b9be-fbad4ff63add admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:38.036109 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9afeb-557c-493d-b9be-fbad4ff63add admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:38.046967 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149e093-b49b-4ec2-9524-c08fcaf4aab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:38.047732 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149e093-b49b-4ec2-9524-c08fcaf4aab0 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:38.047976 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149e093-b49b-4ec2-9524-c08fcaf4aab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:38.048882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149e093-b49b-4ec2-9524-c08fcaf4aab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:38.049624 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b149e093-b49b-4ec2-9524-c08fcaf4aab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:38.052496 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b149e093-b49b-4ec2-9524-c08fcaf4aab0 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:38.064230 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1254/2508] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:46:38.069002 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b096d-0e49-47cc-bd67-7730409b911e admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:38.079016 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b096d-0e49-47cc-bd67-7730409b911e admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:38.084179 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a83c79-d70e-4070-aa89-9c70ad288839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:38.085065 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a83c79-d70e-4070-aa89-9c70ad288839 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:38.085342 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a83c79-d70e-4070-aa89-9c70ad288839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:38.085611 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a83c79-d70e-4070-aa89-9c70ad288839 admin admin] PATH_INFO: `/v3/projects/f771a036c0c846e6af5ba21cd636ef67/users/e8116f06500b40ec91632e9a977b47e7/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:38.100194 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a83c79-d70e-4070-aa89-9c70ad288839 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f771a036c0c846e6af5ba21cd636ef67, user_id=e8116f06500b40ec91632e9a977b47e7, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:38.103105 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a83c79-d70e-4070-aa89-9c70ad288839 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:38.121706 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1255/2509] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:46:38 2022] PUT /identity/v3/projects/f771a036c0c846e6af5ba21cd636ef67/users/e8116f06500b40ec91632e9a977b47e7/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:46:38.125962 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149e093-b49b-4ec2-9524-c08fcaf4aab0 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:38.137306 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149e093-b49b-4ec2-9524-c08fcaf4aab0 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:38.194890 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f50e15-a533-4bd2-b7f5-d7c079fb15fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:38.195562 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f50e15-a533-4bd2-b7f5-d7c079fb15fc admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:38.195876 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f50e15-a533-4bd2-b7f5-d7c079fb15fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:38.196656 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f50e15-a533-4bd2-b7f5-d7c079fb15fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:38.197391 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f50e15-a533-4bd2-b7f5-d7c079fb15fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:38.199025 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f50e15-a533-4bd2-b7f5-d7c079fb15fc admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:38.209169 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1255/2510] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:46:38.216131 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a83c79-d70e-4070-aa89-9c70ad288839 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:38.231558 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a83c79-d70e-4070-aa89-9c70ad288839 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:38.237562 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813cac17-42c7-4b75-9b4d-795ab804f64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:38.238485 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813cac17-42c7-4b75-9b4d-795ab804f64e admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:38.238768 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813cac17-42c7-4b75-9b4d-795ab804f64e admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:38.239040 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813cac17-42c7-4b75-9b4d-795ab804f64e admin admin] PATH_INFO: `/v3/projects/f771a036c0c846e6af5ba21cd636ef67/users/e8116f06500b40ec91632e9a977b47e7/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:38.241288 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813cac17-42c7-4b75-9b4d-795ab804f64e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f771a036c0c846e6af5ba21cd636ef67, user_id=e8116f06500b40ec91632e9a977b47e7, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:38.244044 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813cac17-42c7-4b75-9b4d-795ab804f64e admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:38.250029 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:46:38.256674 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1256/2511] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:46:38 2022] PUT /identity/v3/projects/f771a036c0c846e6af5ba21cd636ef67/users/e8116f06500b40ec91632e9a977b47e7/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:46:38.267564 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0914400-4692-4061-9bb9-2ff4bc890f98 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:38.267852 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0914400-4692-4061-9bb9-2ff4bc890f98 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:38.268126 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0914400-4692-4061-9bb9-2ff4bc890f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:38.274575 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:46:38.297032 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-a0914400-4692-4061-9bb9-2ff4bc890f98 None None] MFA Rules not processed for user `e8116f06500b40ec91632e9a977b47e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:46:38.298278 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a0914400-4692-4061-9bb9-2ff4bc890f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:46:38.369923 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1256/2512] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:46:38 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:46:38.381968 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813cac17-42c7-4b75-9b4d-795ab804f64e admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:38.383888 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-813cac17-42c7-4b75-9b4d-795ab804f64e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:46:38.471700 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813cac17-42c7-4b75-9b4d-795ab804f64e admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:38.476260 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101b3d8-4399-4a46-b1a9-581ab1dd710d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:38.476918 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101b3d8-4399-4a46-b1a9-581ab1dd710d service cinder] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:38.477226 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101b3d8-4399-4a46-b1a9-581ab1dd710d service cinder] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:38.477492 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101b3d8-4399-4a46-b1a9-581ab1dd710d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:38.487109 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101b3d8-4399-4a46-b1a9-581ab1dd710d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:38.488537 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101b3d8-4399-4a46-b1a9-581ab1dd710d service cinder] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:38.498448 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1257/2513] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:46:38 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:46:38.583959 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0914400-4692-4061-9bb9-2ff4bc890f98 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:38.594464 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0914400-4692-4061-9bb9-2ff4bc890f98 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:38.598927 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acbb988-b6ec-4072-a73b-6c81494fe3b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:38.599882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbb988-b6ec-4072-a73b-6c81494fe3b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:38.600162 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbb988-b6ec-4072-a73b-6c81494fe3b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:38.600439 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbb988-b6ec-4072-a73b-6c81494fe3b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:38.661614 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acbb988-b6ec-4072-a73b-6c81494fe3b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:38.663075 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acbb988-b6ec-4072-a73b-6c81494fe3b4 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:38.672095 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1257/2514] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:46:38 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:46:43.564488 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101b3d8-4399-4a46-b1a9-581ab1dd710d service cinder] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:43.629141 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101b3d8-4399-4a46-b1a9-581ab1dd710d service cinder] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:43.633930 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556dab83-daf0-4e78-b605-e9832e52e73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:43.634814 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556dab83-daf0-4e78-b605-e9832e52e73e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:43.635093 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556dab83-daf0-4e78-b605-e9832e52e73e admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:43.635365 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556dab83-daf0-4e78-b605-e9832e52e73e admin admin] PATH_INFO: `/v3/users/9792bb28a12f46e2bf5d9073216b8f30` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:43.636567 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556dab83-daf0-4e78-b605-e9832e52e73e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9792bb28a12f46e2bf5d9073216b8f30)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:43.638523 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556dab83-daf0-4e78-b605-e9832e52e73e admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:43.691012 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-556dab83-daf0-4e78-b605-e9832e52e73e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9792bb28a12f46e2bf5d9073216b8f30'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:43.691678 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-556dab83-daf0-4e78-b605-e9832e52e73e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9792bb28a12f46e2bf5d9073216b8f30'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:43.698560 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-556dab83-daf0-4e78-b605-e9832e52e73e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9792bb28a12f46e2bf5d9073216b8f30'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:43.699192 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-556dab83-daf0-4e78-b605-e9832e52e73e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9792bb28a12f46e2bf5d9073216b8f30'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:43.711619 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-556dab83-daf0-4e78-b605-e9832e52e73e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9792bb28a12f46e2bf5d9073216b8f30'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:43.722778 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:46:43.729101 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1258/2515] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:46:43 2022] DELETE /identity/v3/users/9792bb28a12f46e2bf5d9073216b8f30 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:46:43.734152 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc859b-496c-4e5e-b439-dbc4d4885efd None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:43.734712 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc859b-496c-4e5e-b439-dbc4d4885efd None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:43.734818 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc859b-496c-4e5e-b439-dbc4d4885efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:43.753442 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-8bfc859b-496c-4e5e-b439-dbc4d4885efd None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:46:43.754677 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8bfc859b-496c-4e5e-b439-dbc4d4885efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:46:43.813952 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1258/2516] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:46:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:46:43.828441 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556dab83-daf0-4e78-b605-e9832e52e73e admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:43.830824 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-556dab83-daf0-4e78-b605-e9832e52e73e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:46:43.892659 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556dab83-daf0-4e78-b605-e9832e52e73e admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:43.897178 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d5d40-5790-4d05-aadf-d66c3690268c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:43.897831 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d5d40-5790-4d05-aadf-d66c3690268c service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:43.898138 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d5d40-5790-4d05-aadf-d66c3690268c service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:43.898411 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d5d40-5790-4d05-aadf-d66c3690268c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:43.908612 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d5d40-5790-4d05-aadf-d66c3690268c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:43.910057 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d5d40-5790-4d05-aadf-d66c3690268c service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:43.922522 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1259/2517] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:46:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 17:46:44.195416 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc859b-496c-4e5e-b439-dbc4d4885efd None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:44.196888 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8bfc859b-496c-4e5e-b439-dbc4d4885efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:46:44.212047 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc859b-496c-4e5e-b439-dbc4d4885efd None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:44.218941 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29253564-f155-4a6d-a3e3-98a3857955c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:44.219836 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29253564-f155-4a6d-a3e3-98a3857955c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:44.220125 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29253564-f155-4a6d-a3e3-98a3857955c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:44.220398 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29253564-f155-4a6d-a3e3-98a3857955c0 admin admin] PATH_INFO: `/v3/projects/3433aa62f0ed4a6785ce861cc5e83684` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:44.221756 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29253564-f155-4a6d-a3e3-98a3857955c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3433aa62f0ed4a6785ce861cc5e83684)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:44.223653 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29253564-f155-4a6d-a3e3-98a3857955c0 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:44.246371 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:46:44.269752 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-29253564-f155-4a6d-a3e3-98a3857955c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3433aa62f0ed4a6785ce861cc5e83684', 'request_id': 'req-29253564-f155-4a6d-a3e3-98a3857955c0'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:44.279215 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-29253564-f155-4a6d-a3e3-98a3857955c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3433aa62f0ed4a6785ce861cc5e83684', 'request_id': 'req-29253564-f155-4a6d-a3e3-98a3857955c0'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:44.285232 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-29253564-f155-4a6d-a3e3-98a3857955c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3433aa62f0ed4a6785ce861cc5e83684', 'request_id': 'req-29253564-f155-4a6d-a3e3-98a3857955c0'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:44.296213 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-29253564-f155-4a6d-a3e3-98a3857955c0 admin admin] The token cache is being invalidate because project 3433aa62f0ed4a6785ce861cc5e83684 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:46:44.296499 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-29253564-f155-4a6d-a3e3-98a3857955c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:44.297235 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-29253564-f155-4a6d-a3e3-98a3857955c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:44.298957 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1259/2518] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:46:44 2022] DELETE /identity/v3/projects/3433aa62f0ed4a6785ce861cc5e83684 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:46:44.303485 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d5d40-5790-4d05-aadf-d66c3690268c service neutron] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:44.313909 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d5d40-5790-4d05-aadf-d66c3690268c service neutron] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:44.371991 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344382a-0240-4fe3-a3de-bcb21a95db95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:44.372909 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344382a-0240-4fe3-a3de-bcb21a95db95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:44.373317 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344382a-0240-4fe3-a3de-bcb21a95db95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:44.373650 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344382a-0240-4fe3-a3de-bcb21a95db95 admin admin] PATH_INFO: `/v3/users/e8116f06500b40ec91632e9a977b47e7` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:44.374833 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344382a-0240-4fe3-a3de-bcb21a95db95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8116f06500b40ec91632e9a977b47e7)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:44.376758 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344382a-0240-4fe3-a3de-bcb21a95db95 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:44.428844 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-c344382a-0240-4fe3-a3de-bcb21a95db95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8116f06500b40ec91632e9a977b47e7'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:44.429530 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-c344382a-0240-4fe3-a3de-bcb21a95db95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8116f06500b40ec91632e9a977b47e7'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:44.436845 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-c344382a-0240-4fe3-a3de-bcb21a95db95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8116f06500b40ec91632e9a977b47e7'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:44.437532 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-c344382a-0240-4fe3-a3de-bcb21a95db95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8116f06500b40ec91632e9a977b47e7'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:44.449813 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-c344382a-0240-4fe3-a3de-bcb21a95db95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8116f06500b40ec91632e9a977b47e7'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:44.464053 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1260/2519] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:46:44 2022] DELETE /identity/v3/users/e8116f06500b40ec91632e9a977b47e7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:46:44.747233 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29253564-f155-4a6d-a3e3-98a3857955c0 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:44.748873 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-29253564-f155-4a6d-a3e3-98a3857955c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:46:44.764918 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29253564-f155-4a6d-a3e3-98a3857955c0 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:44.823676 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c689c30-abc8-48c3-b34e-c12092cc0870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:44.824557 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c689c30-abc8-48c3-b34e-c12092cc0870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:44.824837 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c689c30-abc8-48c3-b34e-c12092cc0870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:44.825108 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c689c30-abc8-48c3-b34e-c12092cc0870 admin admin] PATH_INFO: `/v3/projects/f771a036c0c846e6af5ba21cd636ef67` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:44.826585 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c689c30-abc8-48c3-b34e-c12092cc0870 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f771a036c0c846e6af5ba21cd636ef67)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:44.828869 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c689c30-abc8-48c3-b34e-c12092cc0870 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:44.877554 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0c689c30-abc8-48c3-b34e-c12092cc0870 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f771a036c0c846e6af5ba21cd636ef67', 'request_id': 'req-0c689c30-abc8-48c3-b34e-c12092cc0870'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:44.887246 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0c689c30-abc8-48c3-b34e-c12092cc0870 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f771a036c0c846e6af5ba21cd636ef67', 'request_id': 'req-0c689c30-abc8-48c3-b34e-c12092cc0870'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:44.893501 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0c689c30-abc8-48c3-b34e-c12092cc0870 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f771a036c0c846e6af5ba21cd636ef67', 'request_id': 'req-0c689c30-abc8-48c3-b34e-c12092cc0870'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:44.904200 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0c689c30-abc8-48c3-b34e-c12092cc0870 admin admin] The token cache is being invalidate because project f771a036c0c846e6af5ba21cd636ef67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:46:44.905078 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0c689c30-abc8-48c3-b34e-c12092cc0870 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:44.905832 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0c689c30-abc8-48c3-b34e-c12092cc0870 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:44.907514 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1260/2520] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:46:44 2022] DELETE /identity/v3/projects/f771a036c0c846e6af5ba21cd636ef67 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:46:44.913405 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb9b77-e11d-4d27-bdf6-a6671e0d430f None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:44.913949 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb9b77-e11d-4d27-bdf6-a6671e0d430f None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:44.914055 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb9b77-e11d-4d27-bdf6-a6671e0d430f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:44.940658 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-a3fb9b77-e11d-4d27-bdf6-a6671e0d430f None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:46:44.941822 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-a3fb9b77-e11d-4d27-bdf6-a6671e0d430f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:46:44.960491 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:46:45.009119 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1261/2521] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:46:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:46:45.021389 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2a7ed-bd9c-450e-9df1-b80267de3a51 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:45.021696 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2a7ed-bd9c-450e-9df1-b80267de3a51 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:45.022079 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2a7ed-bd9c-450e-9df1-b80267de3a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:45.045160 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-98d2a7ed-bd9c-450e-9df1-b80267de3a51 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:46:45.046415 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-98d2a7ed-bd9c-450e-9df1-b80267de3a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:46:45.056696 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1261/2522] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:46:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:46:45.061809 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb9b77-e11d-4d27-bdf6-a6671e0d430f None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:45.072108 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb9b77-e11d-4d27-bdf6-a6671e0d430f None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:45.077600 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dc8b2c-1ace-43c5-921f-3aa2db29ed8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:45.078277 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc8b2c-1ace-43c5-921f-3aa2db29ed8b admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:45.078556 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc8b2c-1ace-43c5-921f-3aa2db29ed8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:45.078823 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc8b2c-1ace-43c5-921f-3aa2db29ed8b admin admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:45.079549 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dc8b2c-1ace-43c5-921f-3aa2db29ed8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:46:45.079852 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dc8b2c-1ace-43c5-921f-3aa2db29ed8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:45.081450 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dc8b2c-1ace-43c5-921f-3aa2db29ed8b admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:45.093334 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1262/2523] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:46:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:46:45.097923 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2a7ed-bd9c-450e-9df1-b80267de3a51 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:45.109803 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2a7ed-bd9c-450e-9df1-b80267de3a51 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:45.116555 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695cc765-2628-4cbf-b62c-8b6bd76eae61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:45.117220 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695cc765-2628-4cbf-b62c-8b6bd76eae61 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:45.117506 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695cc765-2628-4cbf-b62c-8b6bd76eae61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:45.117805 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695cc765-2628-4cbf-b62c-8b6bd76eae61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:45.118517 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695cc765-2628-4cbf-b62c-8b6bd76eae61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:45.120444 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695cc765-2628-4cbf-b62c-8b6bd76eae61 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:45.150917 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1262/2524] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:46:45 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:46:45.156553 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dc8b2c-1ace-43c5-921f-3aa2db29ed8b admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:45.166742 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dc8b2c-1ace-43c5-921f-3aa2db29ed8b admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:45.224400 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84efc7-e085-408c-be0c-8a5efbe4d753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:45.224983 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84efc7-e085-408c-be0c-8a5efbe4d753 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:45.225256 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84efc7-e085-408c-be0c-8a5efbe4d753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:45.225528 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84efc7-e085-408c-be0c-8a5efbe4d753 admin admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:45.226240 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84efc7-e085-408c-be0c-8a5efbe4d753 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:45.228142 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84efc7-e085-408c-be0c-8a5efbe4d753 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:45.252127 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1263/2525] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:46:45 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:46:45.256615 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695cc765-2628-4cbf-b62c-8b6bd76eae61 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:45.267601 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695cc765-2628-4cbf-b62c-8b6bd76eae61 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:45.273612 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f794b7-b93b-484f-96a8-a71de8bc0170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:45.274315 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f794b7-b93b-484f-96a8-a71de8bc0170 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:45.274597 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f794b7-b93b-484f-96a8-a71de8bc0170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:45.274870 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f794b7-b93b-484f-96a8-a71de8bc0170 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:45.275589 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f794b7-b93b-484f-96a8-a71de8bc0170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:45.277188 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f794b7-b93b-484f-96a8-a71de8bc0170 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:45.282953 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:46:45.290546 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1263/2526] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:46:45.295770 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84efc7-e085-408c-be0c-8a5efbe4d753 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:45.306144 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84efc7-e085-408c-be0c-8a5efbe4d753 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:45.310913 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae77c00-606d-48de-aebb-42c42be78b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:45.311709 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae77c00-606d-48de-aebb-42c42be78b67 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:45.311993 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae77c00-606d-48de-aebb-42c42be78b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:45.312274 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae77c00-606d-48de-aebb-42c42be78b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:45.313011 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae77c00-606d-48de-aebb-42c42be78b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:45.315014 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae77c00-606d-48de-aebb-42c42be78b67 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:45.325655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1264/2527] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:46:45.330121 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f794b7-b93b-484f-96a8-a71de8bc0170 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:45.340792 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f794b7-b93b-484f-96a8-a71de8bc0170 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:45.346906 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44259a1-c547-477b-bad9-cb20b6f1453e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:45.347800 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44259a1-c547-477b-bad9-cb20b6f1453e admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:45.348076 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44259a1-c547-477b-bad9-cb20b6f1453e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:45.348346 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44259a1-c547-477b-bad9-cb20b6f1453e admin admin] PATH_INFO: `/v3/projects/6ec922a96b8b4441abd2119c8a75a404/users/1bbc4581a7974e4a9fbe90f35182c303/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:45.363412 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44259a1-c547-477b-bad9-cb20b6f1453e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ec922a96b8b4441abd2119c8a75a404, user_id=1bbc4581a7974e4a9fbe90f35182c303, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:45.366141 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44259a1-c547-477b-bad9-cb20b6f1453e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:45.381733 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1264/2528] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:46:45 2022] PUT /identity/v3/projects/6ec922a96b8b4441abd2119c8a75a404/users/1bbc4581a7974e4a9fbe90f35182c303/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:46:45.392348 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b90d7-4c5d-4b15-b252-79ded9768248 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:45.392639 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b90d7-4c5d-4b15-b252-79ded9768248 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:45.392920 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b90d7-4c5d-4b15-b252-79ded9768248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:45.419817 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-810b90d7-4c5d-4b15-b252-79ded9768248 None None] MFA Rules not processed for user `1bbc4581a7974e4a9fbe90f35182c303`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:46:45.421127 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-810b90d7-4c5d-4b15-b252-79ded9768248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:46:45.496701 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1265/2529] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:46:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:46:45.501406 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44259a1-c547-477b-bad9-cb20b6f1453e admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:45.581202 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44259a1-c547-477b-bad9-cb20b6f1453e admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:45.587330 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f335f-60c9-402e-9b1e-521bad3aabc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:45.588005 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f335f-60c9-402e-9b1e-521bad3aabc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:45.588315 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f335f-60c9-402e-9b1e-521bad3aabc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:45.588592 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f335f-60c9-402e-9b1e-521bad3aabc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:45.589288 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f335f-60c9-402e-9b1e-521bad3aabc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:45.591257 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f335f-60c9-402e-9b1e-521bad3aabc1 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:45.621837 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1265/2530] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:46:45 2022] POST /identity/v3/projects => generated 379 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:46:45.626331 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b90d7-4c5d-4b15-b252-79ded9768248 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:45.637346 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b90d7-4c5d-4b15-b252-79ded9768248 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:45.650426 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:46:45.710979 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753c179-d8d6-463a-b925-d070d34d91d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:45.711657 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753c179-d8d6-463a-b925-d070d34d91d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:45.711938 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753c179-d8d6-463a-b925-d070d34d91d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:45.712246 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753c179-d8d6-463a-b925-d070d34d91d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:45.712975 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3753c179-d8d6-463a-b925-d070d34d91d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:45.714978 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3753c179-d8d6-463a-b925-d070d34d91d8 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:45.740659 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1266/2531] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:46:45 2022] POST /identity/v3/users => generated 296 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:46:45.746172 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f335f-60c9-402e-9b1e-521bad3aabc1 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:45.757254 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f335f-60c9-402e-9b1e-521bad3aabc1 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:45.762595 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbcec12-c31e-4921-8b19-917d03e50c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:45.763280 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbcec12-c31e-4921-8b19-917d03e50c68 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:45.763581 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbcec12-c31e-4921-8b19-917d03e50c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:45.764004 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbcec12-c31e-4921-8b19-917d03e50c68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:45.765199 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbcec12-c31e-4921-8b19-917d03e50c68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:45.766889 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbcec12-c31e-4921-8b19-917d03e50c68 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:45.779579 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1266/2532] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:46:45.784184 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753c179-d8d6-463a-b925-d070d34d91d8 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:45.794606 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753c179-d8d6-463a-b925-d070d34d91d8 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:45.801123 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f62901b-9ce7-49e5-9dca-00b23608aad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:45.802057 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62901b-9ce7-49e5-9dca-00b23608aad3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:45.802330 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62901b-9ce7-49e5-9dca-00b23608aad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:45.802597 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62901b-9ce7-49e5-9dca-00b23608aad3 admin admin] PATH_INFO: `/v3/projects/59e23bf640bf43f2aed633fc4ec87899/users/dc80f243164e4312bff2b4d5773475c9/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:45.823469 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f62901b-9ce7-49e5-9dca-00b23608aad3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59e23bf640bf43f2aed633fc4ec87899, user_id=dc80f243164e4312bff2b4d5773475c9, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:45.828631 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f62901b-9ce7-49e5-9dca-00b23608aad3 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:45.855232 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1267/2533] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:46:45 2022] PUT /identity/v3/projects/59e23bf640bf43f2aed633fc4ec87899/users/dc80f243164e4312bff2b4d5773475c9/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:46:45.860117 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbcec12-c31e-4921-8b19-917d03e50c68 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:45.871931 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbcec12-c31e-4921-8b19-917d03e50c68 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:45.954776 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da78e2-3a4f-4f88-944d-c20273df5728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:45.955462 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da78e2-3a4f-4f88-944d-c20273df5728 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:45.955743 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da78e2-3a4f-4f88-944d-c20273df5728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:45.956015 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da78e2-3a4f-4f88-944d-c20273df5728 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:45.956719 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da78e2-3a4f-4f88-944d-c20273df5728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:45.959107 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da78e2-3a4f-4f88-944d-c20273df5728 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:45.978305 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1267/2534] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:46:45.982775 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f62901b-9ce7-49e5-9dca-00b23608aad3 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:45.993748 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f62901b-9ce7-49e5-9dca-00b23608aad3 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:45.998978 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931d79e-bb00-47a6-af1b-a83f62e5c362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:45.999909 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931d79e-bb00-47a6-af1b-a83f62e5c362 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:46.000194 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931d79e-bb00-47a6-af1b-a83f62e5c362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:46.000473 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931d79e-bb00-47a6-af1b-a83f62e5c362 admin admin] PATH_INFO: `/v3/projects/59e23bf640bf43f2aed633fc4ec87899/users/dc80f243164e4312bff2b4d5773475c9/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:46.002590 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5931d79e-bb00-47a6-af1b-a83f62e5c362 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59e23bf640bf43f2aed633fc4ec87899, user_id=dc80f243164e4312bff2b4d5773475c9, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:46.006386 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5931d79e-bb00-47a6-af1b-a83f62e5c362 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:46.019712 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1268/2535] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:46:45 2022] PUT /identity/v3/projects/59e23bf640bf43f2aed633fc4ec87899/users/dc80f243164e4312bff2b4d5773475c9/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:46:46.035452 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd9dd9-1da2-405c-bd20-dd8bbd395f9c None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:46.035717 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd9dd9-1da2-405c-bd20-dd8bbd395f9c None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:46.036020 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd9dd9-1da2-405c-bd20-dd8bbd395f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:46.066727 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-83cd9dd9-1da2-405c-bd20-dd8bbd395f9c None None] MFA Rules not processed for user `dc80f243164e4312bff2b4d5773475c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:46:46.068674 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-83cd9dd9-1da2-405c-bd20-dd8bbd395f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:46:46.249974 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:46:46.302346 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1268/2536] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:46:46 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:46:46.316196 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931d79e-bb00-47a6-af1b-a83f62e5c362 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:46.317850 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-5931d79e-bb00-47a6-af1b-a83f62e5c362 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:46:46.385191 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931d79e-bb00-47a6-af1b-a83f62e5c362 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:46.390657 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd59206-c2cc-43e8-9cb4-c53b7cba53a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:46.391428 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd59206-c2cc-43e8-9cb4-c53b7cba53a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:46.391733 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd59206-c2cc-43e8-9cb4-c53b7cba53a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:46.392010 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd59206-c2cc-43e8-9cb4-c53b7cba53a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:46.402867 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd59206-c2cc-43e8-9cb4-c53b7cba53a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:46.404669 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd59206-c2cc-43e8-9cb4-c53b7cba53a6 service cinder] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:46.416005 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1269/2537] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:46:46 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:46:46.867646 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd9dd9-1da2-405c-bd20-dd8bbd395f9c None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:46.935885 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd9dd9-1da2-405c-bd20-dd8bbd395f9c None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:46.940925 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141cd58-9950-442c-9985-8f404eabfbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:46.941832 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141cd58-9950-442c-9985-8f404eabfbef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:46.942134 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141cd58-9950-442c-9985-8f404eabfbef admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:46.942406 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141cd58-9950-442c-9985-8f404eabfbef admin admin] PATH_INFO: `/v3/users/1bbc4581a7974e4a9fbe90f35182c303` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:46.943626 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9141cd58-9950-442c-9985-8f404eabfbef admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bbc4581a7974e4a9fbe90f35182c303)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:46.945547 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9141cd58-9950-442c-9985-8f404eabfbef admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:46.996567 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9141cd58-9950-442c-9985-8f404eabfbef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bbc4581a7974e4a9fbe90f35182c303'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:46.997220 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9141cd58-9950-442c-9985-8f404eabfbef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bbc4581a7974e4a9fbe90f35182c303'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:47.004283 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9141cd58-9950-442c-9985-8f404eabfbef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bbc4581a7974e4a9fbe90f35182c303'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:47.016400 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9141cd58-9950-442c-9985-8f404eabfbef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bbc4581a7974e4a9fbe90f35182c303'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:47.026554 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-9141cd58-9950-442c-9985-8f404eabfbef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bbc4581a7974e4a9fbe90f35182c303'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:47.033103 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1269/2538] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:46:46 2022] DELETE /identity/v3/users/1bbc4581a7974e4a9fbe90f35182c303 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:46:47.038770 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533ae1d-8f09-4eab-8dc5-f936496c2247 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:47.039496 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533ae1d-8f09-4eab-8dc5-f936496c2247 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:47.039641 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533ae1d-8f09-4eab-8dc5-f936496c2247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:47.060156 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-7533ae1d-8f09-4eab-8dc5-f936496c2247 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:46:47.061757 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-7533ae1d-8f09-4eab-8dc5-f936496c2247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:46:47.126805 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1270/2539] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:46:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:46:47.146231 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141cd58-9950-442c-9985-8f404eabfbef admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:47.147908 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-9141cd58-9950-442c-9985-8f404eabfbef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:46:47.210323 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141cd58-9950-442c-9985-8f404eabfbef admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:47.214302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d6aa0-c7db-4009-942a-b76737c07f01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:47.214955 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d6aa0-c7db-4009-942a-b76737c07f01 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:47.215233 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d6aa0-c7db-4009-942a-b76737c07f01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:47.215504 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d6aa0-c7db-4009-942a-b76737c07f01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:47.223311 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:46:47.227566 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855d6aa0-c7db-4009-942a-b76737c07f01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:47.229444 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855d6aa0-c7db-4009-942a-b76737c07f01 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:47.240019 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1270/2540] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:46:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:46:47.525337 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7533ae1d-8f09-4eab-8dc5-f936496c2247 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:47.526805 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-7533ae1d-8f09-4eab-8dc5-f936496c2247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:46:47.544433 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7533ae1d-8f09-4eab-8dc5-f936496c2247 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:47.549608 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b3d16-318d-4eee-bb84-f57730d1632b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:47.550557 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b3d16-318d-4eee-bb84-f57730d1632b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:47.550852 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b3d16-318d-4eee-bb84-f57730d1632b admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:47.551122 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b3d16-318d-4eee-bb84-f57730d1632b admin admin] PATH_INFO: `/v3/projects/6ec922a96b8b4441abd2119c8a75a404` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:47.552352 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b3d16-318d-4eee-bb84-f57730d1632b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ec922a96b8b4441abd2119c8a75a404)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:47.554295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b3d16-318d-4eee-bb84-f57730d1632b admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:47.563309 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:46:47.609884 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-f68b3d16-318d-4eee-bb84-f57730d1632b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ec922a96b8b4441abd2119c8a75a404', 'request_id': 'req-f68b3d16-318d-4eee-bb84-f57730d1632b'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:47.618494 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-f68b3d16-318d-4eee-bb84-f57730d1632b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ec922a96b8b4441abd2119c8a75a404', 'request_id': 'req-f68b3d16-318d-4eee-bb84-f57730d1632b'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:47.624447 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-f68b3d16-318d-4eee-bb84-f57730d1632b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ec922a96b8b4441abd2119c8a75a404', 'request_id': 'req-f68b3d16-318d-4eee-bb84-f57730d1632b'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:47.635363 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-f68b3d16-318d-4eee-bb84-f57730d1632b admin admin] The token cache is being invalidate because project 6ec922a96b8b4441abd2119c8a75a404 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80150) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:46:47.635564 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-f68b3d16-318d-4eee-bb84-f57730d1632b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:47.636197 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-f68b3d16-318d-4eee-bb84-f57730d1632b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:47.637742 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1271/2541] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:46:47 2022] DELETE /identity/v3/projects/6ec922a96b8b4441abd2119c8a75a404 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:46:47.642203 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d6aa0-c7db-4009-942a-b76737c07f01 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:47.652174 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d6aa0-c7db-4009-942a-b76737c07f01 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:47.711994 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f499cc-d255-453b-8ee3-8a2ff08a4820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:47.712877 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f499cc-d255-453b-8ee3-8a2ff08a4820 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:47.713154 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f499cc-d255-453b-8ee3-8a2ff08a4820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:47.713435 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f499cc-d255-453b-8ee3-8a2ff08a4820 admin admin] PATH_INFO: `/v3/users/dc80f243164e4312bff2b4d5773475c9` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:47.714873 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f499cc-d255-453b-8ee3-8a2ff08a4820 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc80f243164e4312bff2b4d5773475c9)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:47.716827 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f499cc-d255-453b-8ee3-8a2ff08a4820 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:47.776207 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-88f499cc-d255-453b-8ee3-8a2ff08a4820 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc80f243164e4312bff2b4d5773475c9'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:47.776933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-88f499cc-d255-453b-8ee3-8a2ff08a4820 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc80f243164e4312bff2b4d5773475c9'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:47.784642 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-88f499cc-d255-453b-8ee3-8a2ff08a4820 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc80f243164e4312bff2b4d5773475c9'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:47.797193 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-88f499cc-d255-453b-8ee3-8a2ff08a4820 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc80f243164e4312bff2b4d5773475c9'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:47.806851 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-88f499cc-d255-453b-8ee3-8a2ff08a4820 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc80f243164e4312bff2b4d5773475c9'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:47.813135 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1271/2542] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:46:47 2022] DELETE /identity/v3/users/dc80f243164e4312bff2b4d5773475c9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:46:48.108928 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b3d16-318d-4eee-bb84-f57730d1632b admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:48.110518 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-f68b3d16-318d-4eee-bb84-f57730d1632b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:46:48.124233 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b3d16-318d-4eee-bb84-f57730d1632b admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:48.196321 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ec6c2-95f6-45ad-b957-3badb7203f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:48.197117 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ec6c2-95f6-45ad-b957-3badb7203f70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:48.197393 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ec6c2-95f6-45ad-b957-3badb7203f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:48.197662 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ec6c2-95f6-45ad-b957-3badb7203f70 admin admin] PATH_INFO: `/v3/projects/59e23bf640bf43f2aed633fc4ec87899` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:48.199025 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94ec6c2-95f6-45ad-b957-3badb7203f70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59e23bf640bf43f2aed633fc4ec87899)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:48.201003 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94ec6c2-95f6-45ad-b957-3badb7203f70 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:48.253220 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-f94ec6c2-95f6-45ad-b957-3badb7203f70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59e23bf640bf43f2aed633fc4ec87899', 'request_id': 'req-f94ec6c2-95f6-45ad-b957-3badb7203f70'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:48.261122 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-f94ec6c2-95f6-45ad-b957-3badb7203f70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59e23bf640bf43f2aed633fc4ec87899', 'request_id': 'req-f94ec6c2-95f6-45ad-b957-3badb7203f70'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:48.267301 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-f94ec6c2-95f6-45ad-b957-3badb7203f70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59e23bf640bf43f2aed633fc4ec87899', 'request_id': 'req-f94ec6c2-95f6-45ad-b957-3badb7203f70'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:48.278573 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-f94ec6c2-95f6-45ad-b957-3badb7203f70 admin admin] The token cache is being invalidate because project 59e23bf640bf43f2aed633fc4ec87899 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80150) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:46:48.278860 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-f94ec6c2-95f6-45ad-b957-3badb7203f70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:48.279493 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-f94ec6c2-95f6-45ad-b957-3badb7203f70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:48.281172 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1272/2543] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:46:48 2022] DELETE /identity/v3/projects/59e23bf640bf43f2aed633fc4ec87899 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:46:48.286764 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652d053-3961-48dd-8a5e-aded2880a2a0 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:48.287241 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652d053-3961-48dd-8a5e-aded2880a2a0 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:48.287348 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652d053-3961-48dd-8a5e-aded2880a2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:48.307049 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-1652d053-3961-48dd-8a5e-aded2880a2a0 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:46:48.308311 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1652d053-3961-48dd-8a5e-aded2880a2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:46:48.373649 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1272/2544] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:46:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:46:48.382722 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee95ab1-44fb-4d75-8384-145699fb1828 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:48.383087 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee95ab1-44fb-4d75-8384-145699fb1828 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:48.383404 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee95ab1-44fb-4d75-8384-145699fb1828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:48.403911 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-2ee95ab1-44fb-4d75-8384-145699fb1828 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:46:48.405695 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-2ee95ab1-44fb-4d75-8384-145699fb1828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:46:48.414815 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1273/2545] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:46:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:46:48.419976 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652d053-3961-48dd-8a5e-aded2880a2a0 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:48.430291 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652d053-3961-48dd-8a5e-aded2880a2a0 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:48.436221 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1604a8b-2fb3-4af0-bf47-1067892757c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:48.437018 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1604a8b-2fb3-4af0-bf47-1067892757c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:48.437301 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1604a8b-2fb3-4af0-bf47-1067892757c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:48.437586 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1604a8b-2fb3-4af0-bf47-1067892757c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:48.438354 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1604a8b-2fb3-4af0-bf47-1067892757c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:46:48.438659 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1604a8b-2fb3-4af0-bf47-1067892757c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:48.440664 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1604a8b-2fb3-4af0-bf47-1067892757c4 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:48.449307 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:46:48.452735 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1273/2546] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:46:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:46:48.457174 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee95ab1-44fb-4d75-8384-145699fb1828 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:48.466553 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee95ab1-44fb-4d75-8384-145699fb1828 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:48.471608 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea99186-9536-44ee-956e-c247b3224f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:48.472268 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea99186-9536-44ee-956e-c247b3224f64 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:48.472544 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea99186-9536-44ee-956e-c247b3224f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:48.472812 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea99186-9536-44ee-956e-c247b3224f64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:48.473506 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea99186-9536-44ee-956e-c247b3224f64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:48.475437 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea99186-9536-44ee-956e-c247b3224f64 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:48.497207 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:46:48.505110 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1274/2547] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:46:48 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:46:48.509227 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1604a8b-2fb3-4af0-bf47-1067892757c4 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:48.519092 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1604a8b-2fb3-4af0-bf47-1067892757c4 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:48.576174 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5525f-aa5f-47f0-a28e-fea13e4380a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:48.577214 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5525f-aa5f-47f0-a28e-fea13e4380a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:48.577214 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5525f-aa5f-47f0-a28e-fea13e4380a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:48.577571 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5525f-aa5f-47f0-a28e-fea13e4380a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:48.578286 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5525f-aa5f-47f0-a28e-fea13e4380a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:48.580185 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5525f-aa5f-47f0-a28e-fea13e4380a6 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:48.605661 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1274/2548] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:46:48 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:46:48.609957 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea99186-9536-44ee-956e-c247b3224f64 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:48.620462 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea99186-9536-44ee-956e-c247b3224f64 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:48.625627 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4aca7-0931-488e-9168-4b40d9f4a655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:48.626324 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4aca7-0931-488e-9168-4b40d9f4a655 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:48.626604 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4aca7-0931-488e-9168-4b40d9f4a655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:48.626881 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4aca7-0931-488e-9168-4b40d9f4a655 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:48.627607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d4aca7-0931-488e-9168-4b40d9f4a655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:48.629210 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d4aca7-0931-488e-9168-4b40d9f4a655 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:48.639768 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1275/2549] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:46:48.643719 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5525f-aa5f-47f0-a28e-fea13e4380a6 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:48.653965 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5525f-aa5f-47f0-a28e-fea13e4380a6 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:48.659784 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93c8f6a-455d-425e-95bc-fdc4750dd0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:48.660475 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c8f6a-455d-425e-95bc-fdc4750dd0e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:48.660756 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c8f6a-455d-425e-95bc-fdc4750dd0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:48.661028 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c8f6a-455d-425e-95bc-fdc4750dd0e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:48.661758 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93c8f6a-455d-425e-95bc-fdc4750dd0e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:48.663430 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93c8f6a-455d-425e-95bc-fdc4750dd0e8 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:48.674342 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1275/2550] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:46:48.678538 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4aca7-0931-488e-9168-4b40d9f4a655 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:48.688940 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4aca7-0931-488e-9168-4b40d9f4a655 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:48.694378 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4902c7-e7a4-4e35-b19d-32fe9b8a03e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:48.695293 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4902c7-e7a4-4e35-b19d-32fe9b8a03e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:48.695579 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4902c7-e7a4-4e35-b19d-32fe9b8a03e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:48.695846 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4902c7-e7a4-4e35-b19d-32fe9b8a03e8 admin admin] PATH_INFO: `/v3/projects/5ec2820010154663a3650c0118bda7d7/users/5e29dbe9eaea41da8da78c280b8ba92a/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:48.711431 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4902c7-e7a4-4e35-b19d-32fe9b8a03e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ec2820010154663a3650c0118bda7d7, user_id=5e29dbe9eaea41da8da78c280b8ba92a, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:48.714078 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4902c7-e7a4-4e35-b19d-32fe9b8a03e8 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:48.728797 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1276/2551] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:46:48 2022] PUT /identity/v3/projects/5ec2820010154663a3650c0118bda7d7/users/5e29dbe9eaea41da8da78c280b8ba92a/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:46:48.739307 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288648a4-9408-4e3a-9915-54c1e9aae4d8 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:48.739601 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288648a4-9408-4e3a-9915-54c1e9aae4d8 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:48.739883 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288648a4-9408-4e3a-9915-54c1e9aae4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:48.769232 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-288648a4-9408-4e3a-9915-54c1e9aae4d8 None None] MFA Rules not processed for user `5e29dbe9eaea41da8da78c280b8ba92a`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:46:48.770500 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-288648a4-9408-4e3a-9915-54c1e9aae4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:46:48.839432 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1276/2552] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:46:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:46:48.844277 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4902c7-e7a4-4e35-b19d-32fe9b8a03e8 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:48.911724 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4902c7-e7a4-4e35-b19d-32fe9b8a03e8 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:48.917485 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fcb280-95cc-40cc-8e7b-63be32a0a0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:48.918201 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcb280-95cc-40cc-8e7b-63be32a0a0e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:48.918482 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcb280-95cc-40cc-8e7b-63be32a0a0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:48.918759 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcb280-95cc-40cc-8e7b-63be32a0a0e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:48.919451 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fcb280-95cc-40cc-8e7b-63be32a0a0e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:48.921746 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fcb280-95cc-40cc-8e7b-63be32a0a0e2 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:48.952895 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1277/2553] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:46:48 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:46:48.957386 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288648a4-9408-4e3a-9915-54c1e9aae4d8 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:48.969417 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288648a4-9408-4e3a-9915-54c1e9aae4d8 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:49.029005 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2de0f-eea8-4378-8f1b-a3922fbff92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:49.029682 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2de0f-eea8-4378-8f1b-a3922fbff92e admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:49.030489 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2de0f-eea8-4378-8f1b-a3922fbff92e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:49.030779 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2de0f-eea8-4378-8f1b-a3922fbff92e admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:49.031470 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2de0f-eea8-4378-8f1b-a3922fbff92e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:49.033380 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2de0f-eea8-4378-8f1b-a3922fbff92e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:49.051266 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:46:49.060421 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1277/2554] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:46:48 2022] POST /identity/v3/users => generated 297 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:46:49.065697 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fcb280-95cc-40cc-8e7b-63be32a0a0e2 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:49.077683 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fcb280-95cc-40cc-8e7b-63be32a0a0e2 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:49.083141 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a346f-d074-413b-884f-b1d8f33f4563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:49.083824 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a346f-d074-413b-884f-b1d8f33f4563 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:49.084102 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a346f-d074-413b-884f-b1d8f33f4563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:49.084370 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a346f-d074-413b-884f-b1d8f33f4563 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:49.085099 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a346f-d074-413b-884f-b1d8f33f4563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:49.086720 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a346f-d074-413b-884f-b1d8f33f4563 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:49.097722 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1278/2555] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:46:49.101939 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2de0f-eea8-4378-8f1b-a3922fbff92e admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:49.112485 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2de0f-eea8-4378-8f1b-a3922fbff92e admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:49.117460 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1929fe-55e7-47bb-b0ff-4f2f856da9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:49.118365 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1929fe-55e7-47bb-b0ff-4f2f856da9c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:49.118641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1929fe-55e7-47bb-b0ff-4f2f856da9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:49.118910 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1929fe-55e7-47bb-b0ff-4f2f856da9c8 admin admin] PATH_INFO: `/v3/projects/9a5bd2fb808c4a78bf8a5a4de2e57989/users/b4439e52ea28420ea9b004cd9f47e9ee/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:49.134289 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1929fe-55e7-47bb-b0ff-4f2f856da9c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a5bd2fb808c4a78bf8a5a4de2e57989, user_id=b4439e52ea28420ea9b004cd9f47e9ee, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:49.136913 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1929fe-55e7-47bb-b0ff-4f2f856da9c8 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:49.155344 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1278/2556] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:46:49 2022] PUT /identity/v3/projects/9a5bd2fb808c4a78bf8a5a4de2e57989/users/b4439e52ea28420ea9b004cd9f47e9ee/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:46:49.159673 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a346f-d074-413b-884f-b1d8f33f4563 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:49.172978 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a346f-d074-413b-884f-b1d8f33f4563 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:49.232529 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487cf565-23d0-4d86-b62a-a65ec01e3ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:49.233580 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487cf565-23d0-4d86-b62a-a65ec01e3ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:49.234071 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487cf565-23d0-4d86-b62a-a65ec01e3ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:49.234352 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487cf565-23d0-4d86-b62a-a65ec01e3ba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:49.235084 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487cf565-23d0-4d86-b62a-a65ec01e3ba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:49.236670 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487cf565-23d0-4d86-b62a-a65ec01e3ba0 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:49.246811 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1279/2557] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:46:49.251657 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1929fe-55e7-47bb-b0ff-4f2f856da9c8 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:49.262803 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1929fe-55e7-47bb-b0ff-4f2f856da9c8 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:49.268742 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce61452-dfff-48f0-b13c-58611976635f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:49.269634 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce61452-dfff-48f0-b13c-58611976635f admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:49.269946 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce61452-dfff-48f0-b13c-58611976635f admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:49.270216 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce61452-dfff-48f0-b13c-58611976635f admin admin] PATH_INFO: `/v3/projects/9a5bd2fb808c4a78bf8a5a4de2e57989/users/b4439e52ea28420ea9b004cd9f47e9ee/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:49.272335 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce61452-dfff-48f0-b13c-58611976635f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a5bd2fb808c4a78bf8a5a4de2e57989, user_id=b4439e52ea28420ea9b004cd9f47e9ee, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:49.274989 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce61452-dfff-48f0-b13c-58611976635f admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:49.286518 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1279/2558] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:46:49 2022] PUT /identity/v3/projects/9a5bd2fb808c4a78bf8a5a4de2e57989/users/b4439e52ea28420ea9b004cd9f47e9ee/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:46:49.298622 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122be77-cadb-4b1d-9b5d-c3ddc3ca0dac None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:49.298917 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122be77-cadb-4b1d-9b5d-c3ddc3ca0dac None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:49.299186 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122be77-cadb-4b1d-9b5d-c3ddc3ca0dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:49.335526 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-5122be77-cadb-4b1d-9b5d-c3ddc3ca0dac None None] MFA Rules not processed for user `b4439e52ea28420ea9b004cd9f47e9ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:46:49.336743 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-5122be77-cadb-4b1d-9b5d-c3ddc3ca0dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:46:49.360654 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:46:49.413528 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1280/2559] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:46:49 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:46:49.427132 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce61452-dfff-48f0-b13c-58611976635f admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:49.429143 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-dce61452-dfff-48f0-b13c-58611976635f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:46:49.490597 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce61452-dfff-48f0-b13c-58611976635f admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:49.494842 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ec15e-ce21-4808-8e09-debe2dd1661a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:49.495483 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ec15e-ce21-4808-8e09-debe2dd1661a service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:49.495766 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ec15e-ce21-4808-8e09-debe2dd1661a service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:49.496071 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ec15e-ce21-4808-8e09-debe2dd1661a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:49.506415 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ec15e-ce21-4808-8e09-debe2dd1661a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:49.507862 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ec15e-ce21-4808-8e09-debe2dd1661a service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:49.518236 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1280/2560] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:46:49 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:46:49.596744 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122be77-cadb-4b1d-9b5d-c3ddc3ca0dac None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:49.606713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122be77-cadb-4b1d-9b5d-c3ddc3ca0dac None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:49.610491 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365b6afa-5778-4832-8777-958d1fc803e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:49.611137 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b6afa-5778-4832-8777-958d1fc803e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:49.611415 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b6afa-5778-4832-8777-958d1fc803e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:49.611688 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b6afa-5778-4832-8777-958d1fc803e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:49.669492 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365b6afa-5778-4832-8777-958d1fc803e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:49.671284 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365b6afa-5778-4832-8777-958d1fc803e4 service cinder] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:49.681171 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1281/2561] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:46:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:46:49.962533 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ec15e-ce21-4808-8e09-debe2dd1661a service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:50.028106 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ec15e-ce21-4808-8e09-debe2dd1661a service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:50.033237 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6f4df-c7af-49c3-9789-62934e4e1e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:50.034160 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6f4df-c7af-49c3-9789-62934e4e1e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:50.034431 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6f4df-c7af-49c3-9789-62934e4e1e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:50.034706 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6f4df-c7af-49c3-9789-62934e4e1e61 admin admin] PATH_INFO: `/v3/users/5e29dbe9eaea41da8da78c280b8ba92a` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:50.035909 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6f4df-c7af-49c3-9789-62934e4e1e61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e29dbe9eaea41da8da78c280b8ba92a)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:50.037870 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6f4df-c7af-49c3-9789-62934e4e1e61 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:50.094370 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7ae6f4df-c7af-49c3-9789-62934e4e1e61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e29dbe9eaea41da8da78c280b8ba92a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:50.095032 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7ae6f4df-c7af-49c3-9789-62934e4e1e61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e29dbe9eaea41da8da78c280b8ba92a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:50.101928 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7ae6f4df-c7af-49c3-9789-62934e4e1e61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e29dbe9eaea41da8da78c280b8ba92a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:50.109301 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:46:50.115274 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7ae6f4df-c7af-49c3-9789-62934e4e1e61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e29dbe9eaea41da8da78c280b8ba92a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:50.124616 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7ae6f4df-c7af-49c3-9789-62934e4e1e61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e29dbe9eaea41da8da78c280b8ba92a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:50.130767 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1281/2562] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:46:49 2022] DELETE /identity/v3/users/5e29dbe9eaea41da8da78c280b8ba92a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:46:50.135494 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2ca7d-3683-4050-8834-8b2a53610f52 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:50.135857 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2ca7d-3683-4050-8834-8b2a53610f52 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:50.136236 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2ca7d-3683-4050-8834-8b2a53610f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:50.154490 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-d8e2ca7d-3683-4050-8834-8b2a53610f52 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:46:50.155992 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-d8e2ca7d-3683-4050-8834-8b2a53610f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:46:50.224646 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1282/2563] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:46:50.235419 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6f4df-c7af-49c3-9789-62934e4e1e61 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:50.237855 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7ae6f4df-c7af-49c3-9789-62934e4e1e61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:46:50.300380 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6f4df-c7af-49c3-9789-62934e4e1e61 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:50.304351 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b079ab3-fc34-4bc5-8b10-bc9e5db498e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:50.304997 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b079ab3-fc34-4bc5-8b10-bc9e5db498e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:50.305274 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b079ab3-fc34-4bc5-8b10-bc9e5db498e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:50.305543 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b079ab3-fc34-4bc5-8b10-bc9e5db498e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:50.315933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b079ab3-fc34-4bc5-8b10-bc9e5db498e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:50.317364 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b079ab3-fc34-4bc5-8b10-bc9e5db498e3 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:50.326887 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1282/2564] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:46:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:46:50.612848 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e2ca7d-3683-4050-8834-8b2a53610f52 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:50.614596 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-d8e2ca7d-3683-4050-8834-8b2a53610f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:46:50.634387 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e2ca7d-3683-4050-8834-8b2a53610f52 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:50.642238 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd2cc5-f6e9-482b-ac63-c8381197121c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:50.643458 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd2cc5-f6e9-482b-ac63-c8381197121c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:50.643991 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd2cc5-f6e9-482b-ac63-c8381197121c admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:50.644252 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd2cc5-f6e9-482b-ac63-c8381197121c admin admin] PATH_INFO: `/v3/projects/5ec2820010154663a3650c0118bda7d7` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:50.645992 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bd2cc5-f6e9-482b-ac63-c8381197121c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ec2820010154663a3650c0118bda7d7)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:50.648142 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bd2cc5-f6e9-482b-ac63-c8381197121c admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:50.703954 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-31bd2cc5-f6e9-482b-ac63-c8381197121c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ec2820010154663a3650c0118bda7d7', 'request_id': 'req-31bd2cc5-f6e9-482b-ac63-c8381197121c'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:50.706487 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:46:50.713643 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-31bd2cc5-f6e9-482b-ac63-c8381197121c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ec2820010154663a3650c0118bda7d7', 'request_id': 'req-31bd2cc5-f6e9-482b-ac63-c8381197121c'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:50.719795 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-31bd2cc5-f6e9-482b-ac63-c8381197121c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ec2820010154663a3650c0118bda7d7', 'request_id': 'req-31bd2cc5-f6e9-482b-ac63-c8381197121c'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:50.731249 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-31bd2cc5-f6e9-482b-ac63-c8381197121c admin admin] The token cache is being invalidate because project 5ec2820010154663a3650c0118bda7d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80150) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:46:50.731538 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-31bd2cc5-f6e9-482b-ac63-c8381197121c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:50.732243 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-31bd2cc5-f6e9-482b-ac63-c8381197121c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:50.734575 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1283/2565] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:46:50 2022] DELETE /identity/v3/projects/5ec2820010154663a3650c0118bda7d7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:46:50.738808 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b079ab3-fc34-4bc5-8b10-bc9e5db498e3 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:50.748842 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b079ab3-fc34-4bc5-8b10-bc9e5db498e3 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:50.808719 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968136bb-1f84-4bad-98f5-0c5ea995a903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:50.809497 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968136bb-1f84-4bad-98f5-0c5ea995a903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:50.809805 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968136bb-1f84-4bad-98f5-0c5ea995a903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:50.810084 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968136bb-1f84-4bad-98f5-0c5ea995a903 admin admin] PATH_INFO: `/v3/users/b4439e52ea28420ea9b004cd9f47e9ee` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:50.811334 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968136bb-1f84-4bad-98f5-0c5ea995a903 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4439e52ea28420ea9b004cd9f47e9ee)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:50.813464 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968136bb-1f84-4bad-98f5-0c5ea995a903 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:50.862182 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-968136bb-1f84-4bad-98f5-0c5ea995a903 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4439e52ea28420ea9b004cd9f47e9ee'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:50.862831 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-968136bb-1f84-4bad-98f5-0c5ea995a903 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4439e52ea28420ea9b004cd9f47e9ee'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:50.870363 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-968136bb-1f84-4bad-98f5-0c5ea995a903 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4439e52ea28420ea9b004cd9f47e9ee'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:50.882767 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-968136bb-1f84-4bad-98f5-0c5ea995a903 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4439e52ea28420ea9b004cd9f47e9ee'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:50.892479 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-968136bb-1f84-4bad-98f5-0c5ea995a903 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4439e52ea28420ea9b004cd9f47e9ee'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:50.899109 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1283/2566] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:46:50 2022] DELETE /identity/v3/users/b4439e52ea28420ea9b004cd9f47e9ee => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:46:51.196672 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd2cc5-f6e9-482b-ac63-c8381197121c admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:51.198210 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-31bd2cc5-f6e9-482b-ac63-c8381197121c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:46:51.213812 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd2cc5-f6e9-482b-ac63-c8381197121c admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:51.271214 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3914f-4bcb-4232-a428-aefc34fd67db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:51.272199 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3914f-4bcb-4232-a428-aefc34fd67db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:51.272483 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3914f-4bcb-4232-a428-aefc34fd67db admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:51.272740 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3914f-4bcb-4232-a428-aefc34fd67db admin admin] PATH_INFO: `/v3/projects/9a5bd2fb808c4a78bf8a5a4de2e57989` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:51.273983 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce3914f-4bcb-4232-a428-aefc34fd67db admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a5bd2fb808c4a78bf8a5a4de2e57989)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:51.275879 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce3914f-4bcb-4232-a428-aefc34fd67db admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:51.326080 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-dce3914f-4bcb-4232-a428-aefc34fd67db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a5bd2fb808c4a78bf8a5a4de2e57989', 'request_id': 'req-dce3914f-4bcb-4232-a428-aefc34fd67db'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:51.335243 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-dce3914f-4bcb-4232-a428-aefc34fd67db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a5bd2fb808c4a78bf8a5a4de2e57989', 'request_id': 'req-dce3914f-4bcb-4232-a428-aefc34fd67db'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:51.341480 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-dce3914f-4bcb-4232-a428-aefc34fd67db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a5bd2fb808c4a78bf8a5a4de2e57989', 'request_id': 'req-dce3914f-4bcb-4232-a428-aefc34fd67db'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:51.352955 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-dce3914f-4bcb-4232-a428-aefc34fd67db admin admin] The token cache is being invalidate because project 9a5bd2fb808c4a78bf8a5a4de2e57989 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80150) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:46:51.353277 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-dce3914f-4bcb-4232-a428-aefc34fd67db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:51.353972 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-dce3914f-4bcb-4232-a428-aefc34fd67db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:51.355588 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1284/2567] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:46:51 2022] DELETE /identity/v3/projects/9a5bd2fb808c4a78bf8a5a4de2e57989 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:46:51.361142 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b5e0e-8e18-4af4-bb49-d9677cefb87b None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:51.361420 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b5e0e-8e18-4af4-bb49-d9677cefb87b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:51.361787 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b5e0e-8e18-4af4-bb49-d9677cefb87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:51.369007 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:46:51.381196 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-1f0b5e0e-8e18-4af4-bb49-d9677cefb87b None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:46:51.383933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1f0b5e0e-8e18-4af4-bb49-d9677cefb87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:46:51.451241 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1284/2568] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:46:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:46:51.459511 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773241ce-d39b-4665-a232-d9caf2a7bc9a None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:51.459799 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773241ce-d39b-4665-a232-d9caf2a7bc9a None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:51.460045 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773241ce-d39b-4665-a232-d9caf2a7bc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:51.478824 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-773241ce-d39b-4665-a232-d9caf2a7bc9a None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:46:51.480035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-773241ce-d39b-4665-a232-d9caf2a7bc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:46:51.488030 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1285/2569] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:46:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:46:51.492846 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b5e0e-8e18-4af4-bb49-d9677cefb87b None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:51.508118 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b5e0e-8e18-4af4-bb49-d9677cefb87b None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:51.515373 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7be808-fbd6-420c-90dc-835a3038b833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:51.516313 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7be808-fbd6-420c-90dc-835a3038b833 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:51.516592 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7be808-fbd6-420c-90dc-835a3038b833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:51.516853 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7be808-fbd6-420c-90dc-835a3038b833 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:51.517577 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7be808-fbd6-420c-90dc-835a3038b833 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:46:51.517909 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7be808-fbd6-420c-90dc-835a3038b833 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:51.519505 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7be808-fbd6-420c-90dc-835a3038b833 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:51.531757 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1285/2570] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:46:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:46:51.536194 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773241ce-d39b-4665-a232-d9caf2a7bc9a None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:51.545462 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773241ce-d39b-4665-a232-d9caf2a7bc9a None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:51.550745 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dff5eb-53bd-4dc6-a640-dfaba9d5ee85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:51.551401 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dff5eb-53bd-4dc6-a640-dfaba9d5ee85 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:51.551678 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dff5eb-53bd-4dc6-a640-dfaba9d5ee85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:51.551934 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dff5eb-53bd-4dc6-a640-dfaba9d5ee85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:51.552636 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dff5eb-53bd-4dc6-a640-dfaba9d5ee85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:51.554557 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dff5eb-53bd-4dc6-a640-dfaba9d5ee85 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:51.583100 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1286/2571] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:46:51 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:46:51.587316 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7be808-fbd6-420c-90dc-835a3038b833 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:51.597615 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7be808-fbd6-420c-90dc-835a3038b833 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:51.661943 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ab363-c6be-4ce8-9ec3-676880e58ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:51.669992 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ab363-c6be-4ce8-9ec3-676880e58ec7 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:51.670335 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ab363-c6be-4ce8-9ec3-676880e58ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:51.670629 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ab363-c6be-4ce8-9ec3-676880e58ec7 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:51.671399 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ab363-c6be-4ce8-9ec3-676880e58ec7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:51.673346 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ab363-c6be-4ce8-9ec3-676880e58ec7 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:51.697490 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1286/2572] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:46:51 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:46:51.701967 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dff5eb-53bd-4dc6-a640-dfaba9d5ee85 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:51.712719 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dff5eb-53bd-4dc6-a640-dfaba9d5ee85 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:51.718303 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fadffc-ef56-4730-9766-6b50a19295c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:51.719013 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fadffc-ef56-4730-9766-6b50a19295c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:51.719334 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fadffc-ef56-4730-9766-6b50a19295c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:51.719669 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fadffc-ef56-4730-9766-6b50a19295c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:51.720420 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fadffc-ef56-4730-9766-6b50a19295c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:51.722055 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fadffc-ef56-4730-9766-6b50a19295c0 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:51.734031 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1287/2573] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:46:51.738139 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ab363-c6be-4ce8-9ec3-676880e58ec7 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:51.748324 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ab363-c6be-4ce8-9ec3-676880e58ec7 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:51.754157 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731c2d1-9acf-477d-b244-941dc13e9bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:51.754825 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731c2d1-9acf-477d-b244-941dc13e9bbc admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:51.755108 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731c2d1-9acf-477d-b244-941dc13e9bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:51.755375 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731c2d1-9acf-477d-b244-941dc13e9bbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:51.756102 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4731c2d1-9acf-477d-b244-941dc13e9bbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:51.757709 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4731c2d1-9acf-477d-b244-941dc13e9bbc admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:51.768468 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1287/2574] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:46:51.772803 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fadffc-ef56-4730-9766-6b50a19295c0 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:51.783215 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fadffc-ef56-4730-9766-6b50a19295c0 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:51.788028 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6394401-91ac-4e4e-a4f3-08af09a7a9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:51.788954 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6394401-91ac-4e4e-a4f3-08af09a7a9dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:51.789252 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6394401-91ac-4e4e-a4f3-08af09a7a9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:51.789527 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6394401-91ac-4e4e-a4f3-08af09a7a9dc admin admin] PATH_INFO: `/v3/projects/b7259db011494f51b76e201ebd6343f2/users/8958672b13974eb9bd74eefe2eff9655/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:51.804288 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6394401-91ac-4e4e-a4f3-08af09a7a9dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7259db011494f51b76e201ebd6343f2, user_id=8958672b13974eb9bd74eefe2eff9655, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:51.806971 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6394401-91ac-4e4e-a4f3-08af09a7a9dc admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:51.823284 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1288/2575] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:46:51 2022] PUT /identity/v3/projects/b7259db011494f51b76e201ebd6343f2/users/8958672b13974eb9bd74eefe2eff9655/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:46:51.835190 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78f5df-0bbe-46f5-b33d-d5fe749ea4a3 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:51.835422 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78f5df-0bbe-46f5-b33d-d5fe749ea4a3 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:51.835708 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78f5df-0bbe-46f5-b33d-d5fe749ea4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:51.864180 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-5c78f5df-0bbe-46f5-b33d-d5fe749ea4a3 None None] MFA Rules not processed for user `8958672b13974eb9bd74eefe2eff9655`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:46:51.865435 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5c78f5df-0bbe-46f5-b33d-d5fe749ea4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:46:51.930832 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:46:51.938752 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1288/2576] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:46:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:46:51.946620 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6394401-91ac-4e4e-a4f3-08af09a7a9dc admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:51.948417 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-d6394401-91ac-4e4e-a4f3-08af09a7a9dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:46:51.958865 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:46:52.008175 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6394401-91ac-4e4e-a4f3-08af09a7a9dc admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:52.012401 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e878fd-7ae2-40d7-b05c-e8a04660b870 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:52.013057 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e878fd-7ae2-40d7-b05c-e8a04660b870 service cinder] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:52.013338 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e878fd-7ae2-40d7-b05c-e8a04660b870 service cinder] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:52.013606 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e878fd-7ae2-40d7-b05c-e8a04660b870 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:52.022297 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e878fd-7ae2-40d7-b05c-e8a04660b870 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:52.023721 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e878fd-7ae2-40d7-b05c-e8a04660b870 service cinder] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:52.037600 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1289/2577] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:46:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:46:57.505678 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78f5df-0bbe-46f5-b33d-d5fe749ea4a3 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:57.572484 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78f5df-0bbe-46f5-b33d-d5fe749ea4a3 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:57.577644 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43031a-b542-4abb-b79a-8ec648bcc846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:57.578610 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43031a-b542-4abb-b79a-8ec648bcc846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:57.578876 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43031a-b542-4abb-b79a-8ec648bcc846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:57.579159 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43031a-b542-4abb-b79a-8ec648bcc846 admin admin] PATH_INFO: `/v3/users/8958672b13974eb9bd74eefe2eff9655` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:57.580392 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43031a-b542-4abb-b79a-8ec648bcc846 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8958672b13974eb9bd74eefe2eff9655)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:57.582480 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43031a-b542-4abb-b79a-8ec648bcc846 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:57.630362 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5f43031a-b542-4abb-b79a-8ec648bcc846 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8958672b13974eb9bd74eefe2eff9655'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:57.630888 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5f43031a-b542-4abb-b79a-8ec648bcc846 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8958672b13974eb9bd74eefe2eff9655'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:57.637983 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5f43031a-b542-4abb-b79a-8ec648bcc846 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8958672b13974eb9bd74eefe2eff9655'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:57.649837 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5f43031a-b542-4abb-b79a-8ec648bcc846 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8958672b13974eb9bd74eefe2eff9655'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:57.658914 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-5f43031a-b542-4abb-b79a-8ec648bcc846 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8958672b13974eb9bd74eefe2eff9655'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:57.665658 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1289/2578] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:46:57 2022] DELETE /identity/v3/users/8958672b13974eb9bd74eefe2eff9655 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:46:57.670499 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44927b23-bfa6-409a-a164-ed11faac61e6 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:57.671005 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44927b23-bfa6-409a-a164-ed11faac61e6 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:57.671158 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44927b23-bfa6-409a-a164-ed11faac61e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:57.690147 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-44927b23-bfa6-409a-a164-ed11faac61e6 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:46:57.691911 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-44927b23-bfa6-409a-a164-ed11faac61e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:46:57.757752 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1290/2579] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:46:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:46:57.767655 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43031a-b542-4abb-b79a-8ec648bcc846 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:57.769376 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5f43031a-b542-4abb-b79a-8ec648bcc846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:46:57.833968 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43031a-b542-4abb-b79a-8ec648bcc846 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:57.838634 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc21da11-4102-43da-b470-d3ea95082ed7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:57.839289 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21da11-4102-43da-b470-d3ea95082ed7 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:57.839575 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21da11-4102-43da-b470-d3ea95082ed7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:57.840133 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21da11-4102-43da-b470-d3ea95082ed7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:57.849198 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc21da11-4102-43da-b470-d3ea95082ed7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:57.850777 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc21da11-4102-43da-b470-d3ea95082ed7 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:57.861622 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1290/2580] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:46:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:46:58.151027 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44927b23-bfa6-409a-a164-ed11faac61e6 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:58.152555 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-44927b23-bfa6-409a-a164-ed11faac61e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:46:58.165921 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44927b23-bfa6-409a-a164-ed11faac61e6 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:58.171268 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0639f85-3259-4b33-bcfc-e3b288c66645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:58.172191 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0639f85-3259-4b33-bcfc-e3b288c66645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:58.172469 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0639f85-3259-4b33-bcfc-e3b288c66645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:58.172741 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0639f85-3259-4b33-bcfc-e3b288c66645 admin admin] PATH_INFO: `/v3/projects/b7259db011494f51b76e201ebd6343f2` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:58.174053 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0639f85-3259-4b33-bcfc-e3b288c66645 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7259db011494f51b76e201ebd6343f2)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:58.175957 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0639f85-3259-4b33-bcfc-e3b288c66645 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:58.228600 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-a0639f85-3259-4b33-bcfc-e3b288c66645 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7259db011494f51b76e201ebd6343f2', 'request_id': 'req-a0639f85-3259-4b33-bcfc-e3b288c66645'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:58.237591 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-a0639f85-3259-4b33-bcfc-e3b288c66645 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7259db011494f51b76e201ebd6343f2', 'request_id': 'req-a0639f85-3259-4b33-bcfc-e3b288c66645'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:58.243668 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-a0639f85-3259-4b33-bcfc-e3b288c66645 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7259db011494f51b76e201ebd6343f2', 'request_id': 'req-a0639f85-3259-4b33-bcfc-e3b288c66645'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:58.254780 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-a0639f85-3259-4b33-bcfc-e3b288c66645 admin admin] The token cache is being invalidate because project b7259db011494f51b76e201ebd6343f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80150) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:46:58.255064 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-a0639f85-3259-4b33-bcfc-e3b288c66645 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:58.255737 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-a0639f85-3259-4b33-bcfc-e3b288c66645 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:58.257339 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1291/2581] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:46:58 2022] DELETE /identity/v3/projects/b7259db011494f51b76e201ebd6343f2 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:46:58.263067 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99303a82-7e9b-4ff6-b156-4efd8dd735d2 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:58.263361 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99303a82-7e9b-4ff6-b156-4efd8dd735d2 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:58.263641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99303a82-7e9b-4ff6-b156-4efd8dd735d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:58.283555 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-99303a82-7e9b-4ff6-b156-4efd8dd735d2 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:46:58.284824 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-99303a82-7e9b-4ff6-b156-4efd8dd735d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:46:58.303191 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:46:58.349900 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1291/2582] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:46:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:46:58.358366 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c557a3f-0e64-4fa1-a04b-e5918608bd5e None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:58.358656 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c557a3f-0e64-4fa1-a04b-e5918608bd5e None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:58.358934 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c557a3f-0e64-4fa1-a04b-e5918608bd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:58.377626 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-9c557a3f-0e64-4fa1-a04b-e5918608bd5e None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:46:58.378862 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-9c557a3f-0e64-4fa1-a04b-e5918608bd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:46:58.387551 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1292/2583] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:46:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:46:58.391855 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99303a82-7e9b-4ff6-b156-4efd8dd735d2 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:58.402215 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99303a82-7e9b-4ff6-b156-4efd8dd735d2 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:58.407117 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043d957-34b7-4c49-b06c-48b33b3abb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:58.407773 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043d957-34b7-4c49-b06c-48b33b3abb6f admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:58.408056 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043d957-34b7-4c49-b06c-48b33b3abb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:58.408325 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043d957-34b7-4c49-b06c-48b33b3abb6f admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:58.409063 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9043d957-34b7-4c49-b06c-48b33b3abb6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:46:58.409365 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9043d957-34b7-4c49-b06c-48b33b3abb6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:58.410989 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9043d957-34b7-4c49-b06c-48b33b3abb6f admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:58.422756 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1292/2584] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:46:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:46:58.427120 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c557a3f-0e64-4fa1-a04b-e5918608bd5e None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:58.436947 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c557a3f-0e64-4fa1-a04b-e5918608bd5e None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:58.442290 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ae413-ba47-4d9e-ba3f-e08337658f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:58.442951 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ae413-ba47-4d9e-ba3f-e08337658f70 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:58.443231 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ae413-ba47-4d9e-ba3f-e08337658f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:58.443496 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ae413-ba47-4d9e-ba3f-e08337658f70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:58.444199 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ae413-ba47-4d9e-ba3f-e08337658f70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:58.446724 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ae413-ba47-4d9e-ba3f-e08337658f70 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:58.475725 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1293/2585] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:46:58 2022] POST /identity/v3/projects => generated 359 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 17:46:58.479774 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043d957-34b7-4c49-b06c-48b33b3abb6f admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:58.490551 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043d957-34b7-4c49-b06c-48b33b3abb6f admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:58.553767 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed6d4b-419d-4c01-804b-79f17f686c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:58.554556 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed6d4b-419d-4c01-804b-79f17f686c7f admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:58.554912 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed6d4b-419d-4c01-804b-79f17f686c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:58.555383 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed6d4b-419d-4c01-804b-79f17f686c7f admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:58.556187 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ed6d4b-419d-4c01-804b-79f17f686c7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:58.558357 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ed6d4b-419d-4c01-804b-79f17f686c7f admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:58.584790 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1293/2586] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:46:58 2022] POST /identity/v3/users => generated 280 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:46:58.589106 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ae413-ba47-4d9e-ba3f-e08337658f70 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:58.595835 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:46:58.600238 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ae413-ba47-4d9e-ba3f-e08337658f70 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:58.607926 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa6974d-5d27-4cfb-8256-7a5edeb110cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:58.608871 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6974d-5d27-4cfb-8256-7a5edeb110cb admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:58.609383 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6974d-5d27-4cfb-8256-7a5edeb110cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:58.610464 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6974d-5d27-4cfb-8256-7a5edeb110cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:58.610836 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa6974d-5d27-4cfb-8256-7a5edeb110cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:58.612869 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa6974d-5d27-4cfb-8256-7a5edeb110cb admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:58.625750 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1294/2587] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 17:46:58.630046 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed6d4b-419d-4c01-804b-79f17f686c7f admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:58.640713 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed6d4b-419d-4c01-804b-79f17f686c7f admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:58.645423 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c6e36-1941-4b7b-85d6-2fefe767f3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:58.646216 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c6e36-1941-4b7b-85d6-2fefe767f3ec admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:58.646502 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c6e36-1941-4b7b-85d6-2fefe767f3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:58.646773 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c6e36-1941-4b7b-85d6-2fefe767f3ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:58.647501 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c6e36-1941-4b7b-85d6-2fefe767f3ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:58.649133 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c6e36-1941-4b7b-85d6-2fefe767f3ec admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:58.660041 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1294/2588] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 17:46:58.664180 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa6974d-5d27-4cfb-8256-7a5edeb110cb admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:58.675412 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa6974d-5d27-4cfb-8256-7a5edeb110cb admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:58.682366 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768b25d-fbe0-42a5-9dac-d9f4887f46e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:58.683202 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768b25d-fbe0-42a5-9dac-d9f4887f46e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:58.683487 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768b25d-fbe0-42a5-9dac-d9f4887f46e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:58.683781 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768b25d-fbe0-42a5-9dac-d9f4887f46e0 admin admin] PATH_INFO: `/v3/projects/860564bdf9ca460e837d9d6b43ab5dbb/users/44a10adf1bfb4d5bb0df0aa96079b15e/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:58.701035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2768b25d-fbe0-42a5-9dac-d9f4887f46e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=860564bdf9ca460e837d9d6b43ab5dbb, user_id=44a10adf1bfb4d5bb0df0aa96079b15e, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:58.703695 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2768b25d-fbe0-42a5-9dac-d9f4887f46e0 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:58.718962 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1295/2589] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:46:58 2022] PUT /identity/v3/projects/860564bdf9ca460e837d9d6b43ab5dbb/users/44a10adf1bfb4d5bb0df0aa96079b15e/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:46:58.730432 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8681be-6590-49c9-8f1d-afe1ce084bcc None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:58.730792 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8681be-6590-49c9-8f1d-afe1ce084bcc None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:58.731204 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8681be-6590-49c9-8f1d-afe1ce084bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:58.759496 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-3d8681be-6590-49c9-8f1d-afe1ce084bcc None None] MFA Rules not processed for user `44a10adf1bfb4d5bb0df0aa96079b15e`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:46:58.760637 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-3d8681be-6590-49c9-8f1d-afe1ce084bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:46:58.826932 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1295/2590] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:46:58 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:46:58.858217 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768b25d-fbe0-42a5-9dac-d9f4887f46e0 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:58.860096 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-2768b25d-fbe0-42a5-9dac-d9f4887f46e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:46:58.923463 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768b25d-fbe0-42a5-9dac-d9f4887f46e0 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:58.927564 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d835d0-14f0-4443-a567-0705b0197c86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:58.928209 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d835d0-14f0-4443-a567-0705b0197c86 service cinder] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:58.928492 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d835d0-14f0-4443-a567-0705b0197c86 service cinder] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:58.928762 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d835d0-14f0-4443-a567-0705b0197c86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:58.937773 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d835d0-14f0-4443-a567-0705b0197c86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:58.939243 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d835d0-14f0-4443-a567-0705b0197c86 service cinder] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:58.948550 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1296/2591] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:46:58 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:46:58.962633 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8681be-6590-49c9-8f1d-afe1ce084bcc None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:58.983848 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:46:59.029371 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8681be-6590-49c9-8f1d-afe1ce084bcc None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:59.033955 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376dbe20-80bc-4f14-8682-6cf1a963bbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:59.034845 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376dbe20-80bc-4f14-8682-6cf1a963bbd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:59.035123 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376dbe20-80bc-4f14-8682-6cf1a963bbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:59.035393 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376dbe20-80bc-4f14-8682-6cf1a963bbd7 admin admin] PATH_INFO: `/v3/users/44a10adf1bfb4d5bb0df0aa96079b15e` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:59.036619 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376dbe20-80bc-4f14-8682-6cf1a963bbd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44a10adf1bfb4d5bb0df0aa96079b15e)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:59.038575 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376dbe20-80bc-4f14-8682-6cf1a963bbd7 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:59.089232 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-376dbe20-80bc-4f14-8682-6cf1a963bbd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44a10adf1bfb4d5bb0df0aa96079b15e'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:59.089904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-376dbe20-80bc-4f14-8682-6cf1a963bbd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44a10adf1bfb4d5bb0df0aa96079b15e'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:59.096737 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-376dbe20-80bc-4f14-8682-6cf1a963bbd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44a10adf1bfb4d5bb0df0aa96079b15e'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:59.109212 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-376dbe20-80bc-4f14-8682-6cf1a963bbd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44a10adf1bfb4d5bb0df0aa96079b15e'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:59.119337 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-376dbe20-80bc-4f14-8682-6cf1a963bbd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44a10adf1bfb4d5bb0df0aa96079b15e'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:59.125904 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1296/2592] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:46:58 2022] DELETE /identity/v3/users/44a10adf1bfb4d5bb0df0aa96079b15e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:46:59.131308 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b758cab-b576-4ad9-91d0-fea26231f3d5 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:59.131636 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b758cab-b576-4ad9-91d0-fea26231f3d5 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:59.131907 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b758cab-b576-4ad9-91d0-fea26231f3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:59.150303 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-9b758cab-b576-4ad9-91d0-fea26231f3d5 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:46:59.151535 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-9b758cab-b576-4ad9-91d0-fea26231f3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:46:59.214282 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1297/2593] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:46:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:46:59.224158 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376dbe20-80bc-4f14-8682-6cf1a963bbd7 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:59.225664 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-376dbe20-80bc-4f14-8682-6cf1a963bbd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:46:59.296178 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376dbe20-80bc-4f14-8682-6cf1a963bbd7 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:59.300230 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d00ad-f729-4e25-a01f-e0e3328158d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:59.300891 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d00ad-f729-4e25-a01f-e0e3328158d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:59.301175 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d00ad-f729-4e25-a01f-e0e3328158d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:59.301644 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d00ad-f729-4e25-a01f-e0e3328158d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:59.315652 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d00ad-f729-4e25-a01f-e0e3328158d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:59.317116 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d00ad-f729-4e25-a01f-e0e3328158d0 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:59.327721 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1297/2594] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:46:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:46:59.601147 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b758cab-b576-4ad9-91d0-fea26231f3d5 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:59.603203 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-9b758cab-b576-4ad9-91d0-fea26231f3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:46:59.615934 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b758cab-b576-4ad9-91d0-fea26231f3d5 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:59.621925 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f1509-529d-46e7-80c0-c93f4649b3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:59.622846 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f1509-529d-46e7-80c0-c93f4649b3f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:59.623125 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f1509-529d-46e7-80c0-c93f4649b3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:59.623449 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f1509-529d-46e7-80c0-c93f4649b3f7 admin admin] PATH_INFO: `/v3/projects/860564bdf9ca460e837d9d6b43ab5dbb` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:59.624770 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f1509-529d-46e7-80c0-c93f4649b3f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=860564bdf9ca460e837d9d6b43ab5dbb)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:59.626634 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f1509-529d-46e7-80c0-c93f4649b3f7 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:59.680617 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-295f1509-529d-46e7-80c0-c93f4649b3f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '860564bdf9ca460e837d9d6b43ab5dbb', 'request_id': 'req-295f1509-529d-46e7-80c0-c93f4649b3f7'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:59.690924 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-295f1509-529d-46e7-80c0-c93f4649b3f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '860564bdf9ca460e837d9d6b43ab5dbb', 'request_id': 'req-295f1509-529d-46e7-80c0-c93f4649b3f7'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:59.698097 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-295f1509-529d-46e7-80c0-c93f4649b3f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '860564bdf9ca460e837d9d6b43ab5dbb', 'request_id': 'req-295f1509-529d-46e7-80c0-c93f4649b3f7'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:59.699988 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:46:59.710662 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-295f1509-529d-46e7-80c0-c93f4649b3f7 admin admin] The token cache is being invalidate because project 860564bdf9ca460e837d9d6b43ab5dbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80150) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:46:59.711183 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-295f1509-529d-46e7-80c0-c93f4649b3f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:59.712196 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-295f1509-529d-46e7-80c0-c93f4649b3f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:46:59.713769 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1298/2595] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:46:59 2022] DELETE /identity/v3/projects/860564bdf9ca460e837d9d6b43ab5dbb => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:46:59.718870 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97d3a6-e0cd-4a28-bb8a-e2f89a81a307 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:59.719327 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97d3a6-e0cd-4a28-bb8a-e2f89a81a307 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:59.719440 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97d3a6-e0cd-4a28-bb8a-e2f89a81a307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:59.738290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-2a97d3a6-e0cd-4a28-bb8a-e2f89a81a307 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:46:59.739498 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-2a97d3a6-e0cd-4a28-bb8a-e2f89a81a307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:46:59.773751 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:46:59.800902 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1298/2596] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:46:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:46:59.809997 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165b92d-fec8-40db-b2f3-23ac0ac1af01 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:59.810288 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165b92d-fec8-40db-b2f3-23ac0ac1af01 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:59.810589 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165b92d-fec8-40db-b2f3-23ac0ac1af01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:59.829616 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-e165b92d-fec8-40db-b2f3-23ac0ac1af01 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:46:59.830838 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-e165b92d-fec8-40db-b2f3-23ac0ac1af01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:46:59.839376 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1299/2597] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:46:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:46:59.844030 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97d3a6-e0cd-4a28-bb8a-e2f89a81a307 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:59.853943 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97d3a6-e0cd-4a28-bb8a-e2f89a81a307 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:59.859541 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13381abd-9ff0-4993-98bf-31f8a3ced997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:59.860192 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13381abd-9ff0-4993-98bf-31f8a3ced997 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:59.860467 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13381abd-9ff0-4993-98bf-31f8a3ced997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:59.860737 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13381abd-9ff0-4993-98bf-31f8a3ced997 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:59.861458 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13381abd-9ff0-4993-98bf-31f8a3ced997 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:46:59.861756 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13381abd-9ff0-4993-98bf-31f8a3ced997 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:59.863383 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13381abd-9ff0-4993-98bf-31f8a3ced997 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:59.876086 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1299/2598] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:46:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:46:59.880491 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165b92d-fec8-40db-b2f3-23ac0ac1af01 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:59.891932 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165b92d-fec8-40db-b2f3-23ac0ac1af01 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:46:59.900115 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e15a7-3f02-44e2-a8aa-4140fcf4e8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:46:59.901015 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e15a7-3f02-44e2-a8aa-4140fcf4e8ec admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:46:59.901338 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e15a7-3f02-44e2-a8aa-4140fcf4e8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:46:59.901653 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e15a7-3f02-44e2-a8aa-4140fcf4e8ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:46:59.902756 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e15a7-3f02-44e2-a8aa-4140fcf4e8ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:46:59.905533 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e15a7-3f02-44e2-a8aa-4140fcf4e8ec admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:46:59.937036 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1300/2599] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:46:59 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:46:59.941603 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13381abd-9ff0-4993-98bf-31f8a3ced997 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:46:59.952322 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13381abd-9ff0-4993-98bf-31f8a3ced997 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:00.008661 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4d0ad-c5dd-49ea-b16d-a97a7f6f47e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:00.009339 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4d0ad-c5dd-49ea-b16d-a97a7f6f47e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:00.009626 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4d0ad-c5dd-49ea-b16d-a97a7f6f47e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:00.009929 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4d0ad-c5dd-49ea-b16d-a97a7f6f47e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:00.010628 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4d0ad-c5dd-49ea-b16d-a97a7f6f47e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:00.012519 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4d0ad-c5dd-49ea-b16d-a97a7f6f47e7 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:00.035905 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1300/2600] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:46:59 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:47:00.040190 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e15a7-3f02-44e2-a8aa-4140fcf4e8ec admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:00.050760 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e15a7-3f02-44e2-a8aa-4140fcf4e8ec admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:00.055682 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fa2d7-d111-4c10-8111-aace1f36d836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:00.056284 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fa2d7-d111-4c10-8111-aace1f36d836 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:00.056570 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fa2d7-d111-4c10-8111-aace1f36d836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:00.056841 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fa2d7-d111-4c10-8111-aace1f36d836 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:00.057573 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278fa2d7-d111-4c10-8111-aace1f36d836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:00.059238 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278fa2d7-d111-4c10-8111-aace1f36d836 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:00.070132 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1301/2601] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 17:47:00.074307 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4d0ad-c5dd-49ea-b16d-a97a7f6f47e7 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:00.084696 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4d0ad-c5dd-49ea-b16d-a97a7f6f47e7 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:00.089906 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce9b54-20be-4899-a8dc-e5ef76db716a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:00.090567 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce9b54-20be-4899-a8dc-e5ef76db716a admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:00.090847 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce9b54-20be-4899-a8dc-e5ef76db716a admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:00.091114 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce9b54-20be-4899-a8dc-e5ef76db716a admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:00.091834 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce9b54-20be-4899-a8dc-e5ef76db716a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:00.093424 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce9b54-20be-4899-a8dc-e5ef76db716a admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:00.103456 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1301/2602] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:47:00.107508 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fa2d7-d111-4c10-8111-aace1f36d836 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:00.117480 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fa2d7-d111-4c10-8111-aace1f36d836 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:00.122935 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018be49-64a6-4f32-8e15-9d020797702d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:00.123833 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018be49-64a6-4f32-8e15-9d020797702d admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:00.124109 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018be49-64a6-4f32-8e15-9d020797702d admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:00.124383 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018be49-64a6-4f32-8e15-9d020797702d admin admin] PATH_INFO: `/v3/projects/2c515a513ccb4d81b30e398f228eaa3b/users/56fd2360663e47b19a35032be3dc10a0/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:00.140547 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a018be49-64a6-4f32-8e15-9d020797702d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c515a513ccb4d81b30e398f228eaa3b, user_id=56fd2360663e47b19a35032be3dc10a0, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:00.143305 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a018be49-64a6-4f32-8e15-9d020797702d admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:00.160178 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1302/2603] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:47:00 2022] PUT /identity/v3/projects/2c515a513ccb4d81b30e398f228eaa3b/users/56fd2360663e47b19a35032be3dc10a0/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:47:00.171254 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150650b-7ed6-47a8-a647-7b1ce777774c None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:00.171542 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150650b-7ed6-47a8-a647-7b1ce777774c None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:00.171813 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150650b-7ed6-47a8-a647-7b1ce777774c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:00.199719 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-8150650b-7ed6-47a8-a647-7b1ce777774c None None] MFA Rules not processed for user `56fd2360663e47b19a35032be3dc10a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:47:00.200915 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8150650b-7ed6-47a8-a647-7b1ce777774c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:00.279366 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1302/2604] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:47:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:47:00.284610 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018be49-64a6-4f32-8e15-9d020797702d admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:00.351008 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018be49-64a6-4f32-8e15-9d020797702d admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:00.357156 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e6680-2f2d-481e-a257-bb3c45f8c8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:00.357797 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e6680-2f2d-481e-a257-bb3c45f8c8df admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:00.358102 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e6680-2f2d-481e-a257-bb3c45f8c8df admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:00.358378 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e6680-2f2d-481e-a257-bb3c45f8c8df admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:00.359072 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290e6680-2f2d-481e-a257-bb3c45f8c8df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:00.360980 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290e6680-2f2d-481e-a257-bb3c45f8c8df admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:00.391775 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1303/2605] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:47:00 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:47:00.396044 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150650b-7ed6-47a8-a647-7b1ce777774c None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:00.407013 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150650b-7ed6-47a8-a647-7b1ce777774c None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:00.441583 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:00.468869 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e94d74-5849-482c-8c28-0b7597d34b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:00.469557 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e94d74-5849-482c-8c28-0b7597d34b36 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:00.469875 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e94d74-5849-482c-8c28-0b7597d34b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:00.470155 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e94d74-5849-482c-8c28-0b7597d34b36 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:00.470857 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e94d74-5849-482c-8c28-0b7597d34b36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:00.472776 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e94d74-5849-482c-8c28-0b7597d34b36 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:00.493742 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1303/2606] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:47:00 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:47:00.498071 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e6680-2f2d-481e-a257-bb3c45f8c8df admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:00.509060 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e6680-2f2d-481e-a257-bb3c45f8c8df admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:00.513871 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dfee65-b831-4314-8fa4-f14ab8d594ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:00.514687 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfee65-b831-4314-8fa4-f14ab8d594ba admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:00.517882 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfee65-b831-4314-8fa4-f14ab8d594ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:00.517882 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfee65-b831-4314-8fa4-f14ab8d594ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:00.517882 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dfee65-b831-4314-8fa4-f14ab8d594ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:00.517882 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dfee65-b831-4314-8fa4-f14ab8d594ba admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:00.528749 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1304/2607] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 17:47:00.532851 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e94d74-5849-482c-8c28-0b7597d34b36 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:00.542844 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e94d74-5849-482c-8c28-0b7597d34b36 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:00.547454 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1d018-edae-4264-8fa8-d65d994c7e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:00.548115 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1d018-edae-4264-8fa8-d65d994c7e2f admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:00.548399 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1d018-edae-4264-8fa8-d65d994c7e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:00.548667 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1d018-edae-4264-8fa8-d65d994c7e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:00.549392 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac1d018-edae-4264-8fa8-d65d994c7e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:00.551011 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac1d018-edae-4264-8fa8-d65d994c7e2f admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:00.561424 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1304/2608] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:47:00.566096 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dfee65-b831-4314-8fa4-f14ab8d594ba admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:00.576973 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dfee65-b831-4314-8fa4-f14ab8d594ba admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:00.582137 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203eb0ab-a6a2-465b-941b-2f0c8666f52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:00.583030 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203eb0ab-a6a2-465b-941b-2f0c8666f52f admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:00.583313 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203eb0ab-a6a2-465b-941b-2f0c8666f52f admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:00.583577 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203eb0ab-a6a2-465b-941b-2f0c8666f52f admin admin] PATH_INFO: `/v3/projects/4e93036704fa4e988fc08a8ee63d4f2d/users/d10e40693d2b483d8a1f948e5935ffad/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:00.598148 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203eb0ab-a6a2-465b-941b-2f0c8666f52f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e93036704fa4e988fc08a8ee63d4f2d, user_id=d10e40693d2b483d8a1f948e5935ffad, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:00.600792 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203eb0ab-a6a2-465b-941b-2f0c8666f52f admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:00.615616 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1305/2609] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:47:00 2022] PUT /identity/v3/projects/4e93036704fa4e988fc08a8ee63d4f2d/users/d10e40693d2b483d8a1f948e5935ffad/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:47:00.626169 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186d5e3-d000-42ed-973f-39a28986a963 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:00.626461 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186d5e3-d000-42ed-973f-39a28986a963 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:00.626733 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186d5e3-d000-42ed-973f-39a28986a963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:00.653068 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-7186d5e3-d000-42ed-973f-39a28986a963 None None] MFA Rules not processed for user `d10e40693d2b483d8a1f948e5935ffad`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:47:00.654304 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7186d5e3-d000-42ed-973f-39a28986a963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:00.720290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1305/2610] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:47:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:47:00.725217 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203eb0ab-a6a2-465b-941b-2f0c8666f52f admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:00.768972 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:00.786743 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203eb0ab-a6a2-465b-941b-2f0c8666f52f admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:00.791583 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abade5f7-95c4-4db0-8db7-3bde58a9317f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:00.792240 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abade5f7-95c4-4db0-8db7-3bde58a9317f admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:00.792516 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abade5f7-95c4-4db0-8db7-3bde58a9317f admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:00.792788 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abade5f7-95c4-4db0-8db7-3bde58a9317f admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:00.793506 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abade5f7-95c4-4db0-8db7-3bde58a9317f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:00.795423 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abade5f7-95c4-4db0-8db7-3bde58a9317f admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:00.822955 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1306/2611] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:47:00 2022] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:47:00.827320 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186d5e3-d000-42ed-973f-39a28986a963 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:00.838263 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186d5e3-d000-42ed-973f-39a28986a963 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:00.896787 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535d335-9a1c-4a19-94cd-f6fe6e9ebe2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:00.897450 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535d335-9a1c-4a19-94cd-f6fe6e9ebe2b admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:00.897724 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535d335-9a1c-4a19-94cd-f6fe6e9ebe2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:00.898020 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535d335-9a1c-4a19-94cd-f6fe6e9ebe2b admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:00.898695 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d535d335-9a1c-4a19-94cd-f6fe6e9ebe2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:00.900634 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d535d335-9a1c-4a19-94cd-f6fe6e9ebe2b admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:00.923126 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1306/2612] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:47:00 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:47:00.927186 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abade5f7-95c4-4db0-8db7-3bde58a9317f admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:00.938009 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abade5f7-95c4-4db0-8db7-3bde58a9317f admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:00.944037 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78adbf-18ed-4c5d-a8af-f604d9aad79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:00.944715 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78adbf-18ed-4c5d-a8af-f604d9aad79d admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:00.945001 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78adbf-18ed-4c5d-a8af-f604d9aad79d admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:00.945275 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78adbf-18ed-4c5d-a8af-f604d9aad79d admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:00.946086 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c78adbf-18ed-4c5d-a8af-f604d9aad79d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:00.947704 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c78adbf-18ed-4c5d-a8af-f604d9aad79d admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:00.958590 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1307/2613] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:47:00.963181 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535d335-9a1c-4a19-94cd-f6fe6e9ebe2b admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:00.973711 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535d335-9a1c-4a19-94cd-f6fe6e9ebe2b admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:00.979166 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff6d7b1-bc41-4861-a848-a3611b340398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:00.980121 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6d7b1-bc41-4861-a848-a3611b340398 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:00.980413 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6d7b1-bc41-4861-a848-a3611b340398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:00.980706 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6d7b1-bc41-4861-a848-a3611b340398 admin admin] PATH_INFO: `/v3/projects/0cb4b6b2c08e49628ebf4b1ebacac42e/users/f0388c1bd30e43e5bec78d77e6a71f39/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:00.995908 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff6d7b1-bc41-4861-a848-a3611b340398 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cb4b6b2c08e49628ebf4b1ebacac42e, user_id=f0388c1bd30e43e5bec78d77e6a71f39, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:00.998580 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff6d7b1-bc41-4861-a848-a3611b340398 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:01.014550 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1307/2614] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:47:00 2022] PUT /identity/v3/projects/0cb4b6b2c08e49628ebf4b1ebacac42e/users/f0388c1bd30e43e5bec78d77e6a71f39/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:47:01.018651 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78adbf-18ed-4c5d-a8af-f604d9aad79d admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:01.029096 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78adbf-18ed-4c5d-a8af-f604d9aad79d admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:01.091508 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44646b9c-7d0b-4af4-814b-e232381ef318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:01.092104 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44646b9c-7d0b-4af4-814b-e232381ef318 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:01.092383 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44646b9c-7d0b-4af4-814b-e232381ef318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:01.092658 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44646b9c-7d0b-4af4-814b-e232381ef318 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:01.093386 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44646b9c-7d0b-4af4-814b-e232381ef318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:01.095032 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44646b9c-7d0b-4af4-814b-e232381ef318 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:01.104847 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1308/2615] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:47:01.109515 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff6d7b1-bc41-4861-a848-a3611b340398 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:01.120195 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff6d7b1-bc41-4861-a848-a3611b340398 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:01.125562 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e272fa0-a856-4398-9268-4a925d12faa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:01.126485 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e272fa0-a856-4398-9268-4a925d12faa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:01.126764 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e272fa0-a856-4398-9268-4a925d12faa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:01.127034 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e272fa0-a856-4398-9268-4a925d12faa6 admin admin] PATH_INFO: `/v3/projects/0cb4b6b2c08e49628ebf4b1ebacac42e/users/f0388c1bd30e43e5bec78d77e6a71f39/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:01.129094 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e272fa0-a856-4398-9268-4a925d12faa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cb4b6b2c08e49628ebf4b1ebacac42e, user_id=f0388c1bd30e43e5bec78d77e6a71f39, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:01.131743 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e272fa0-a856-4398-9268-4a925d12faa6 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:01.135390 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:01.144298 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1308/2616] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:47:01 2022] PUT /identity/v3/projects/0cb4b6b2c08e49628ebf4b1ebacac42e/users/f0388c1bd30e43e5bec78d77e6a71f39/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:47:01.220533 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26edaf4-69ce-4b8b-9bac-d90957878dca None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:01.220822 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26edaf4-69ce-4b8b-9bac-d90957878dca None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:01.221104 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26edaf4-69ce-4b8b-9bac-d90957878dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:01.248968 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-c26edaf4-69ce-4b8b-9bac-d90957878dca None None] MFA Rules not processed for user `f0388c1bd30e43e5bec78d77e6a71f39`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:47:01.250221 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-c26edaf4-69ce-4b8b-9bac-d90957878dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:01.335242 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1309/2617] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:47:01 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:47:01.346471 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e272fa0-a856-4398-9268-4a925d12faa6 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:01.348081 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-0e272fa0-a856-4398-9268-4a925d12faa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:01.408075 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e272fa0-a856-4398-9268-4a925d12faa6 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:01.411976 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03b553-485e-4f98-a4f3-2af170bc18c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:01.412697 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03b553-485e-4f98-a4f3-2af170bc18c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:01.412977 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03b553-485e-4f98-a4f3-2af170bc18c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:01.413246 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03b553-485e-4f98-a4f3-2af170bc18c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:01.470748 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e03b553-485e-4f98-a4f3-2af170bc18c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:01.472184 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e03b553-485e-4f98-a4f3-2af170bc18c8 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:01.482229 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1309/2618] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:47:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:47:03.021954 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26edaf4-69ce-4b8b-9bac-d90957878dca None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:03.023376 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-c26edaf4-69ce-4b8b-9bac-d90957878dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:03.035741 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26edaf4-69ce-4b8b-9bac-d90957878dca None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:03.039655 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e622aae-9996-41e5-9a7b-6df36b5c87e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:03.040416 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e622aae-9996-41e5-9a7b-6df36b5c87e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:03.040696 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e622aae-9996-41e5-9a7b-6df36b5c87e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:03.040965 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e622aae-9996-41e5-9a7b-6df36b5c87e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:03.080492 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:03.107744 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e622aae-9996-41e5-9a7b-6df36b5c87e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:03.109207 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e622aae-9996-41e5-9a7b-6df36b5c87e1 service cinder] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:03.120354 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1310/2619] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:47:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:47:03.698348 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03b553-485e-4f98-a4f3-2af170bc18c8 service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:03.707721 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03b553-485e-4f98-a4f3-2af170bc18c8 service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:03.713685 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de0b4c-cc6c-4d22-8be1-c3724851e604 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:03.715405 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de0b4c-cc6c-4d22-8be1-c3724851e604 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:03.715902 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de0b4c-cc6c-4d22-8be1-c3724851e604 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:03.716297 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de0b4c-cc6c-4d22-8be1-c3724851e604 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:03.725928 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30de0b4c-cc6c-4d22-8be1-c3724851e604 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:03.727440 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30de0b4c-cc6c-4d22-8be1-c3724851e604 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:03.736821 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1310/2620] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:47:03 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:47:07.196323 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e622aae-9996-41e5-9a7b-6df36b5c87e1 service cinder] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:07.198081 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-0e622aae-9996-41e5-9a7b-6df36b5c87e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:07.268170 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e622aae-9996-41e5-9a7b-6df36b5c87e1 service cinder] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:07.272540 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e349f-1faf-43fc-bc2a-bd02c675863f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:07.273190 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e349f-1faf-43fc-bc2a-bd02c675863f service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:07.273464 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e349f-1faf-43fc-bc2a-bd02c675863f service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:07.273728 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e349f-1faf-43fc-bc2a-bd02c675863f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:07.275982 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-3f9e349f-1faf-43fc-bc2a-bd02c675863f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:07.352254 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e349f-1faf-43fc-bc2a-bd02c675863f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:07.354039 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e349f-1faf-43fc-bc2a-bd02c675863f service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:07.363753 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1311/2621] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:47:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:47:07.645146 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de0b4c-cc6c-4d22-8be1-c3724851e604 service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:07.655591 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de0b4c-cc6c-4d22-8be1-c3724851e604 service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:07.660358 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e3b0e-e0d1-4dc9-bf8d-e19b438bfbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:07.661257 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e3b0e-e0d1-4dc9-bf8d-e19b438bfbfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:07.661535 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e3b0e-e0d1-4dc9-bf8d-e19b438bfbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:07.661835 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e3b0e-e0d1-4dc9-bf8d-e19b438bfbfe admin admin] PATH_INFO: `/v3/users/56fd2360663e47b19a35032be3dc10a0` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:07.663027 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7e3b0e-e0d1-4dc9-bf8d-e19b438bfbfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=56fd2360663e47b19a35032be3dc10a0)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:07.664938 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7e3b0e-e0d1-4dc9-bf8d-e19b438bfbfe admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:07.717755 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-af7e3b0e-e0d1-4dc9-bf8d-e19b438bfbfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56fd2360663e47b19a35032be3dc10a0'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:07.718434 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-af7e3b0e-e0d1-4dc9-bf8d-e19b438bfbfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56fd2360663e47b19a35032be3dc10a0'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:07.725970 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-af7e3b0e-e0d1-4dc9-bf8d-e19b438bfbfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56fd2360663e47b19a35032be3dc10a0'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:07.739262 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-af7e3b0e-e0d1-4dc9-bf8d-e19b438bfbfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56fd2360663e47b19a35032be3dc10a0'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:07.748882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-af7e3b0e-e0d1-4dc9-bf8d-e19b438bfbfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56fd2360663e47b19a35032be3dc10a0'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:07.755229 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1311/2622] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:47:07 2022] DELETE /identity/v3/users/56fd2360663e47b19a35032be3dc10a0 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:47:07.759932 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451bedc-2b77-4dbc-a07d-4e1ff2b51b37 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:07.760229 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451bedc-2b77-4dbc-a07d-4e1ff2b51b37 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:07.760511 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451bedc-2b77-4dbc-a07d-4e1ff2b51b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:07.778348 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-7451bedc-2b77-4dbc-a07d-4e1ff2b51b37 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:47:07.779846 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-7451bedc-2b77-4dbc-a07d-4e1ff2b51b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:07.844036 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1312/2623] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:47:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:47:07.871010 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e3b0e-e0d1-4dc9-bf8d-e19b438bfbfe admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:07.872431 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-af7e3b0e-e0d1-4dc9-bf8d-e19b438bfbfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:07.883846 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:07.938126 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e3b0e-e0d1-4dc9-bf8d-e19b438bfbfe admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:07.942515 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131b8a2-97f6-422c-b6ff-0100fc1845a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:07.943260 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131b8a2-97f6-422c-b6ff-0100fc1845a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:07.943546 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131b8a2-97f6-422c-b6ff-0100fc1845a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:07.943821 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131b8a2-97f6-422c-b6ff-0100fc1845a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:07.953847 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2131b8a2-97f6-422c-b6ff-0100fc1845a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:07.955381 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2131b8a2-97f6-422c-b6ff-0100fc1845a5 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:07.965692 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1312/2624] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:47:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:47:08.390954 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451bedc-2b77-4dbc-a07d-4e1ff2b51b37 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:08.392992 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-7451bedc-2b77-4dbc-a07d-4e1ff2b51b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:08.412566 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451bedc-2b77-4dbc-a07d-4e1ff2b51b37 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:08.419633 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595fcf9-2464-4142-9282-182afe89f8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:08.420581 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595fcf9-2464-4142-9282-182afe89f8e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:08.420799 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595fcf9-2464-4142-9282-182afe89f8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:08.421076 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595fcf9-2464-4142-9282-182afe89f8e4 admin admin] PATH_INFO: `/v3/projects/2c515a513ccb4d81b30e398f228eaa3b` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:08.422356 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6595fcf9-2464-4142-9282-182afe89f8e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c515a513ccb4d81b30e398f228eaa3b)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:08.424299 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6595fcf9-2464-4142-9282-182afe89f8e4 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:08.465090 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:08.516099 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-6595fcf9-2464-4142-9282-182afe89f8e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c515a513ccb4d81b30e398f228eaa3b', 'request_id': 'req-6595fcf9-2464-4142-9282-182afe89f8e4'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:08.530993 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-6595fcf9-2464-4142-9282-182afe89f8e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c515a513ccb4d81b30e398f228eaa3b', 'request_id': 'req-6595fcf9-2464-4142-9282-182afe89f8e4'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:08.538826 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-6595fcf9-2464-4142-9282-182afe89f8e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c515a513ccb4d81b30e398f228eaa3b', 'request_id': 'req-6595fcf9-2464-4142-9282-182afe89f8e4'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:08.551104 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-6595fcf9-2464-4142-9282-182afe89f8e4 admin admin] The token cache is being invalidate because project 2c515a513ccb4d81b30e398f228eaa3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80150) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:47:08.551393 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-6595fcf9-2464-4142-9282-182afe89f8e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:08.552066 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-6595fcf9-2464-4142-9282-182afe89f8e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:08.553626 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1313/2625] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:47:08 2022] DELETE /identity/v3/projects/2c515a513ccb4d81b30e398f228eaa3b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:47:08.557870 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131b8a2-97f6-422c-b6ff-0100fc1845a5 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:08.568723 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131b8a2-97f6-422c-b6ff-0100fc1845a5 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:08.628563 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead4ce4-3e0b-485d-8d33-fb7953ce9358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:08.629384 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead4ce4-3e0b-485d-8d33-fb7953ce9358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:08.629698 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead4ce4-3e0b-485d-8d33-fb7953ce9358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:08.629977 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead4ce4-3e0b-485d-8d33-fb7953ce9358 admin admin] PATH_INFO: `/v3/users/d10e40693d2b483d8a1f948e5935ffad` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:08.631231 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aead4ce4-3e0b-485d-8d33-fb7953ce9358 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d10e40693d2b483d8a1f948e5935ffad)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:08.633157 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aead4ce4-3e0b-485d-8d33-fb7953ce9358 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:08.686000 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-aead4ce4-3e0b-485d-8d33-fb7953ce9358 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd10e40693d2b483d8a1f948e5935ffad'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:08.687099 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-aead4ce4-3e0b-485d-8d33-fb7953ce9358 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd10e40693d2b483d8a1f948e5935ffad'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:08.694520 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-aead4ce4-3e0b-485d-8d33-fb7953ce9358 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd10e40693d2b483d8a1f948e5935ffad'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:08.707618 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-aead4ce4-3e0b-485d-8d33-fb7953ce9358 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd10e40693d2b483d8a1f948e5935ffad'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:08.716611 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-aead4ce4-3e0b-485d-8d33-fb7953ce9358 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd10e40693d2b483d8a1f948e5935ffad'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:08.723023 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1313/2626] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:47:08 2022] DELETE /identity/v3/users/d10e40693d2b483d8a1f948e5935ffad => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:47:09.126147 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595fcf9-2464-4142-9282-182afe89f8e4 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:09.127627 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-6595fcf9-2464-4142-9282-182afe89f8e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:09.141461 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595fcf9-2464-4142-9282-182afe89f8e4 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:09.211550 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82a4bd-3443-4143-9e4a-9ad93e9b86c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:09.212764 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82a4bd-3443-4143-9e4a-9ad93e9b86c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:09.213575 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82a4bd-3443-4143-9e4a-9ad93e9b86c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:09.213575 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82a4bd-3443-4143-9e4a-9ad93e9b86c4 admin admin] PATH_INFO: `/v3/projects/4e93036704fa4e988fc08a8ee63d4f2d` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:09.215215 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82a4bd-3443-4143-9e4a-9ad93e9b86c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e93036704fa4e988fc08a8ee63d4f2d)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:09.217371 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82a4bd-3443-4143-9e4a-9ad93e9b86c4 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:09.272426 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-bc82a4bd-3443-4143-9e4a-9ad93e9b86c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e93036704fa4e988fc08a8ee63d4f2d', 'request_id': 'req-bc82a4bd-3443-4143-9e4a-9ad93e9b86c4'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:09.283231 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-bc82a4bd-3443-4143-9e4a-9ad93e9b86c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e93036704fa4e988fc08a8ee63d4f2d', 'request_id': 'req-bc82a4bd-3443-4143-9e4a-9ad93e9b86c4'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:09.289644 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-bc82a4bd-3443-4143-9e4a-9ad93e9b86c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e93036704fa4e988fc08a8ee63d4f2d', 'request_id': 'req-bc82a4bd-3443-4143-9e4a-9ad93e9b86c4'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:09.310663 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-bc82a4bd-3443-4143-9e4a-9ad93e9b86c4 admin admin] The token cache is being invalidate because project 4e93036704fa4e988fc08a8ee63d4f2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80150) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:47:09.311122 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-bc82a4bd-3443-4143-9e4a-9ad93e9b86c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:09.312932 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-bc82a4bd-3443-4143-9e4a-9ad93e9b86c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:09.319880 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1314/2627] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:47:09 2022] DELETE /identity/v3/projects/4e93036704fa4e988fc08a8ee63d4f2d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:47:09.321671 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead4ce4-3e0b-485d-8d33-fb7953ce9358 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:09.323677 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-aead4ce4-3e0b-485d-8d33-fb7953ce9358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:09.338001 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead4ce4-3e0b-485d-8d33-fb7953ce9358 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:09.369819 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:09.401054 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b84c63-f1ea-4583-99c7-76c284193d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:09.402323 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b84c63-f1ea-4583-99c7-76c284193d2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:09.402323 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b84c63-f1ea-4583-99c7-76c284193d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:09.402634 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b84c63-f1ea-4583-99c7-76c284193d2a admin admin] PATH_INFO: `/v3/users/f0388c1bd30e43e5bec78d77e6a71f39` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:09.404128 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b84c63-f1ea-4583-99c7-76c284193d2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0388c1bd30e43e5bec78d77e6a71f39)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:09.406327 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b84c63-f1ea-4583-99c7-76c284193d2a admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:09.461273 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c3b84c63-f1ea-4583-99c7-76c284193d2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0388c1bd30e43e5bec78d77e6a71f39'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:09.461949 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c3b84c63-f1ea-4583-99c7-76c284193d2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0388c1bd30e43e5bec78d77e6a71f39'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:09.469474 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c3b84c63-f1ea-4583-99c7-76c284193d2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0388c1bd30e43e5bec78d77e6a71f39'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:09.482771 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c3b84c63-f1ea-4583-99c7-76c284193d2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0388c1bd30e43e5bec78d77e6a71f39'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:09.494807 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-c3b84c63-f1ea-4583-99c7-76c284193d2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0388c1bd30e43e5bec78d77e6a71f39'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:09.502046 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1314/2628] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:47:09 2022] DELETE /identity/v3/users/f0388c1bd30e43e5bec78d77e6a71f39 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:47:09.798117 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82a4bd-3443-4143-9e4a-9ad93e9b86c4 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:09.799718 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-bc82a4bd-3443-4143-9e4a-9ad93e9b86c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:09.819033 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82a4bd-3443-4143-9e4a-9ad93e9b86c4 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:09.861269 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:09.883142 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4529e3-7c48-49f3-81bd-5f5b0d9cf00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:09.884277 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4529e3-7c48-49f3-81bd-5f5b0d9cf00f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:09.884692 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4529e3-7c48-49f3-81bd-5f5b0d9cf00f admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:09.885035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4529e3-7c48-49f3-81bd-5f5b0d9cf00f admin admin] PATH_INFO: `/v3/projects/0cb4b6b2c08e49628ebf4b1ebacac42e` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:09.886578 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4529e3-7c48-49f3-81bd-5f5b0d9cf00f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cb4b6b2c08e49628ebf4b1ebacac42e)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:09.888638 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4529e3-7c48-49f3-81bd-5f5b0d9cf00f admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:09.936592 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-bb4529e3-7c48-49f3-81bd-5f5b0d9cf00f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cb4b6b2c08e49628ebf4b1ebacac42e', 'request_id': 'req-bb4529e3-7c48-49f3-81bd-5f5b0d9cf00f'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:09.945349 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-bb4529e3-7c48-49f3-81bd-5f5b0d9cf00f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cb4b6b2c08e49628ebf4b1ebacac42e', 'request_id': 'req-bb4529e3-7c48-49f3-81bd-5f5b0d9cf00f'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:09.951706 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-bb4529e3-7c48-49f3-81bd-5f5b0d9cf00f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cb4b6b2c08e49628ebf4b1ebacac42e', 'request_id': 'req-bb4529e3-7c48-49f3-81bd-5f5b0d9cf00f'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:09.963192 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-bb4529e3-7c48-49f3-81bd-5f5b0d9cf00f admin admin] The token cache is being invalidate because project 0cb4b6b2c08e49628ebf4b1ebacac42e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80150) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:47:09.963478 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-bb4529e3-7c48-49f3-81bd-5f5b0d9cf00f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:09.964163 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-bb4529e3-7c48-49f3-81bd-5f5b0d9cf00f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:09.965797 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1315/2629] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:47:09 2022] DELETE /identity/v3/projects/0cb4b6b2c08e49628ebf4b1ebacac42e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:47:09.970906 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd433f0e-beb9-4dbb-9796-b9dc369e64f8 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:09.971408 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd433f0e-beb9-4dbb-9796-b9dc369e64f8 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:09.971651 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd433f0e-beb9-4dbb-9796-b9dc369e64f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:09.991607 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-cd433f0e-beb9-4dbb-9796-b9dc369e64f8 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:47:09.992856 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-cd433f0e-beb9-4dbb-9796-b9dc369e64f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:10.058981 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1315/2630] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:47:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:47:10.068875 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a3e6b-6a84-4af2-9746-e2eb328ac390 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:10.068875 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a3e6b-6a84-4af2-9746-e2eb328ac390 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:10.068875 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a3e6b-6a84-4af2-9746-e2eb328ac390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:10.090965 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-de0a3e6b-6a84-4af2-9746-e2eb328ac390 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:47:10.092249 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-de0a3e6b-6a84-4af2-9746-e2eb328ac390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:10.104081 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1316/2631] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:47:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:47:10.105244 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd433f0e-beb9-4dbb-9796-b9dc369e64f8 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:10.115537 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd433f0e-beb9-4dbb-9796-b9dc369e64f8 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:10.120366 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890538b-7d42-402c-84b4-ab054c95dbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:10.121058 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890538b-7d42-402c-84b4-ab054c95dbae admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:10.121338 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890538b-7d42-402c-84b4-ab054c95dbae admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:10.121609 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890538b-7d42-402c-84b4-ab054c95dbae admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:10.122390 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4890538b-7d42-402c-84b4-ab054c95dbae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:47:10.122693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4890538b-7d42-402c-84b4-ab054c95dbae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:10.124318 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4890538b-7d42-402c-84b4-ab054c95dbae admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:10.137142 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1316/2632] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:47:10.142056 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a3e6b-6a84-4af2-9746-e2eb328ac390 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:10.151733 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a3e6b-6a84-4af2-9746-e2eb328ac390 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:10.156620 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016404ae-4b13-4e48-9add-2ccff9964ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:10.157410 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016404ae-4b13-4e48-9add-2ccff9964ea6 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:10.157809 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016404ae-4b13-4e48-9add-2ccff9964ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:10.158184 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016404ae-4b13-4e48-9add-2ccff9964ea6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:10.159064 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016404ae-4b13-4e48-9add-2ccff9964ea6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:10.161050 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016404ae-4b13-4e48-9add-2ccff9964ea6 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:10.202166 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1317/2633] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:47:10 2022] POST /identity/v3/projects => generated 369 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:47:10.204192 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890538b-7d42-402c-84b4-ab054c95dbae admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:10.215704 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890538b-7d42-402c-84b4-ab054c95dbae admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:10.250356 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:10.278842 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dab3e6-df54-475c-9381-eac66fa1cf87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:10.279512 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dab3e6-df54-475c-9381-eac66fa1cf87 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:10.279808 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dab3e6-df54-475c-9381-eac66fa1cf87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:10.280391 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dab3e6-df54-475c-9381-eac66fa1cf87 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:10.280982 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dab3e6-df54-475c-9381-eac66fa1cf87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:10.283275 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dab3e6-df54-475c-9381-eac66fa1cf87 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:10.307221 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1317/2634] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:47:10 2022] POST /identity/v3/users => generated 285 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:47:10.311460 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016404ae-4b13-4e48-9add-2ccff9964ea6 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:10.331474 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016404ae-4b13-4e48-9add-2ccff9964ea6 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:10.338320 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a91542-6d8e-48b0-8701-cd01269deddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:10.339055 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a91542-6d8e-48b0-8701-cd01269deddb admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:10.339337 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a91542-6d8e-48b0-8701-cd01269deddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:10.339610 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a91542-6d8e-48b0-8701-cd01269deddb admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:10.340351 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a91542-6d8e-48b0-8701-cd01269deddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:10.342039 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a91542-6d8e-48b0-8701-cd01269deddb admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:10.353721 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1318/2635] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:47:10.357756 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dab3e6-df54-475c-9381-eac66fa1cf87 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:10.368199 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dab3e6-df54-475c-9381-eac66fa1cf87 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:10.373695 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef700ad-495a-42db-a3ea-7bf7d1086d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:10.374417 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef700ad-495a-42db-a3ea-7bf7d1086d9d admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:10.374695 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef700ad-495a-42db-a3ea-7bf7d1086d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:10.375215 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef700ad-495a-42db-a3ea-7bf7d1086d9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:10.375968 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef700ad-495a-42db-a3ea-7bf7d1086d9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:10.377619 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef700ad-495a-42db-a3ea-7bf7d1086d9d admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:10.389424 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1318/2636] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:47:10.393568 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a91542-6d8e-48b0-8701-cd01269deddb admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:10.404718 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a91542-6d8e-48b0-8701-cd01269deddb admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:10.410010 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490cda1-4dbc-40cf-bdde-66002c346b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:10.411499 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490cda1-4dbc-40cf-bdde-66002c346b1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:10.411499 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490cda1-4dbc-40cf-bdde-66002c346b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:10.411871 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490cda1-4dbc-40cf-bdde-66002c346b1f admin admin] PATH_INFO: `/v3/projects/9e31f18468cf4b29b1ea8f0908e54aab/users/2f25ec53ef37459080df5680c95ee91f/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:10.429995 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8490cda1-4dbc-40cf-bdde-66002c346b1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e31f18468cf4b29b1ea8f0908e54aab, user_id=2f25ec53ef37459080df5680c95ee91f, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:10.433128 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8490cda1-4dbc-40cf-bdde-66002c346b1f admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:10.451323 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1319/2637] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:47:10 2022] PUT /identity/v3/projects/9e31f18468cf4b29b1ea8f0908e54aab/users/2f25ec53ef37459080df5680c95ee91f/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:47:10.463565 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e0a9c-9b67-489d-87df-41c472de42d4 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:10.463851 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e0a9c-9b67-489d-87df-41c472de42d4 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:10.464143 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e0a9c-9b67-489d-87df-41c472de42d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:10.494691 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-367e0a9c-9b67-489d-87df-41c472de42d4 None None] MFA Rules not processed for user `2f25ec53ef37459080df5680c95ee91f`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:47:10.496054 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-367e0a9c-9b67-489d-87df-41c472de42d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:10.610971 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1319/2638] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:47:10 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:47:10.620154 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490cda1-4dbc-40cf-bdde-66002c346b1f admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:10.622353 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-8490cda1-4dbc-40cf-bdde-66002c346b1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:10.731335 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490cda1-4dbc-40cf-bdde-66002c346b1f admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:10.734955 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952d615-dd63-4e6f-9018-3ea2699145ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:10.735612 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952d615-dd63-4e6f-9018-3ea2699145ab service cinder] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:10.735891 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952d615-dd63-4e6f-9018-3ea2699145ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:10.736157 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952d615-dd63-4e6f-9018-3ea2699145ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:10.745135 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9952d615-dd63-4e6f-9018-3ea2699145ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:10.746607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9952d615-dd63-4e6f-9018-3ea2699145ab service cinder] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:10.756566 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1320/2639] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:47:10 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:47:10.781620 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e0a9c-9b67-489d-87df-41c472de42d4 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:10.850904 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952d615-dd63-4e6f-9018-3ea2699145ab service cinder] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:10.852787 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-9952d615-dd63-4e6f-9018-3ea2699145ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:10.862827 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e0a9c-9b67-489d-87df-41c472de42d4 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:10.866030 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:10.868557 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8e7ce-c24d-47e6-b58d-041a0168c20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:10.870009 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8e7ce-c24d-47e6-b58d-041a0168c20b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:10.870568 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8e7ce-c24d-47e6-b58d-041a0168c20b admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:10.870951 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8e7ce-c24d-47e6-b58d-041a0168c20b admin admin] PATH_INFO: `/v3/users/2f25ec53ef37459080df5680c95ee91f` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:10.872684 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8e7ce-c24d-47e6-b58d-041a0168c20b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f25ec53ef37459080df5680c95ee91f)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:10.875291 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8e7ce-c24d-47e6-b58d-041a0168c20b admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:10.951542 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952d615-dd63-4e6f-9018-3ea2699145ab service cinder] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:10.956945 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea0d32-1c00-465c-b0b2-a3d0d22a0235 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96b2105f8d29443383ed51a8fd5cec6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:10.957608 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea0d32-1c00-465c-b0b2-a3d0d22a0235 service placement] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:10.957930 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea0d32-1c00-465c-b0b2-a3d0d22a0235 service placement] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:10.958208 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea0d32-1c00-465c-b0b2-a3d0d22a0235 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:10.959978 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-6aea0d32-1c00-465c-b0b2-a3d0d22a0235 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:10.962363 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-bda8e7ce-c24d-47e6-b58d-041a0168c20b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f25ec53ef37459080df5680c95ee91f'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:10.963978 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-bda8e7ce-c24d-47e6-b58d-041a0168c20b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f25ec53ef37459080df5680c95ee91f'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:10.965206 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:10.972617 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea0d32-1c00-465c-b0b2-a3d0d22a0235 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:10.972806 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-bda8e7ce-c24d-47e6-b58d-041a0168c20b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f25ec53ef37459080df5680c95ee91f'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:10.974347 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea0d32-1c00-465c-b0b2-a3d0d22a0235 service placement] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:10.985547 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1321/2640] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:47:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:47:10.986431 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea0d32-1c00-465c-b0b2-a3d0d22a0235 service placement] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:10.986590 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-bda8e7ce-c24d-47e6-b58d-041a0168c20b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f25ec53ef37459080df5680c95ee91f'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:10.987812 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-6aea0d32-1c00-465c-b0b2-a3d0d22a0235 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:10.997899 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-bda8e7ce-c24d-47e6-b58d-041a0168c20b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f25ec53ef37459080df5680c95ee91f'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:11.001044 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea0d32-1c00-465c-b0b2-a3d0d22a0235 service placement] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:11.005677 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1320/2641] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:47:10 2022] DELETE /identity/v3/users/2f25ec53ef37459080df5680c95ee91f => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:47:11.009260 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd04ce4-db22-481a-a6de-c3ef6543f18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:11.010387 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd04ce4-db22-481a-a6de-c3ef6543f18c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:11.010670 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd04ce4-db22-481a-a6de-c3ef6543f18c admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:11.010944 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd04ce4-db22-481a-a6de-c3ef6543f18c admin admin] PATH_INFO: `/v3/users/1332dc25fb5c4d5b8ed7bd0bd77243d0` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:11.011049 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6f57a-f9a0-4ae2-8e54-e9fb325a51bc None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:11.011300 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6f57a-f9a0-4ae2-8e54-e9fb325a51bc None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:11.011647 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6f57a-f9a0-4ae2-8e54-e9fb325a51bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:11.012176 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd04ce4-db22-481a-a6de-c3ef6543f18c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1332dc25fb5c4d5b8ed7bd0bd77243d0)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:11.014137 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd04ce4-db22-481a-a6de-c3ef6543f18c admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:11.030849 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-75f6f57a-f9a0-4ae2-8e54-e9fb325a51bc None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:47:11.032080 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-75f6f57a-f9a0-4ae2-8e54-e9fb325a51bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:11.067067 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-efd04ce4-db22-481a-a6de-c3ef6543f18c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1332dc25fb5c4d5b8ed7bd0bd77243d0'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:11.067705 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-efd04ce4-db22-481a-a6de-c3ef6543f18c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1332dc25fb5c4d5b8ed7bd0bd77243d0'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:11.075295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-efd04ce4-db22-481a-a6de-c3ef6543f18c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1332dc25fb5c4d5b8ed7bd0bd77243d0'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:11.075990 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-efd04ce4-db22-481a-a6de-c3ef6543f18c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1332dc25fb5c4d5b8ed7bd0bd77243d0'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:11.089154 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-efd04ce4-db22-481a-a6de-c3ef6543f18c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1332dc25fb5c4d5b8ed7bd0bd77243d0'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:11.095361 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1321/2642] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:47:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:47:11.105423 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f6f57a-f9a0-4ae2-8e54-e9fb325a51bc None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:11.106796 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-75f6f57a-f9a0-4ae2-8e54-e9fb325a51bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:11.107425 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1322/2643] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:47:10 2022] DELETE /identity/v3/users/1332dc25fb5c4d5b8ed7bd0bd77243d0 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:47:11.166813 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f6f57a-f9a0-4ae2-8e54-e9fb325a51bc None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:11.217739 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0ded0-a8f7-4631-8302-5da90a6991ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:11.218446 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0ded0-a8f7-4631-8302-5da90a6991ab service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:11.218721 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0ded0-a8f7-4631-8302-5da90a6991ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:11.218998 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0ded0-a8f7-4631-8302-5da90a6991ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:11.254690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:11.287574 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c0ded0-a8f7-4631-8302-5da90a6991ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:11.288820 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd04ce4-db22-481a-a6de-c3ef6543f18c admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:11.289240 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c0ded0-a8f7-4631-8302-5da90a6991ab service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:11.290500 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-efd04ce4-db22-481a-a6de-c3ef6543f18c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:11.300068 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1322/2644] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:47:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 17:47:11.316227 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd04ce4-db22-481a-a6de-c3ef6543f18c admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:11.322039 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680463e7-d395-4830-88ff-d57d903ea297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:11.323852 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680463e7-d395-4830-88ff-d57d903ea297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:11.324501 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680463e7-d395-4830-88ff-d57d903ea297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:11.324501 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680463e7-d395-4830-88ff-d57d903ea297 admin admin] PATH_INFO: `/v3/projects/57b501d5874e405daa2793c3b72f3201` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:11.325727 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680463e7-d395-4830-88ff-d57d903ea297 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57b501d5874e405daa2793c3b72f3201)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:11.327823 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680463e7-d395-4830-88ff-d57d903ea297 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:11.385448 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-680463e7-d395-4830-88ff-d57d903ea297 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57b501d5874e405daa2793c3b72f3201', 'request_id': 'req-680463e7-d395-4830-88ff-d57d903ea297'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:11.394404 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-680463e7-d395-4830-88ff-d57d903ea297 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57b501d5874e405daa2793c3b72f3201', 'request_id': 'req-680463e7-d395-4830-88ff-d57d903ea297'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:11.400970 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-680463e7-d395-4830-88ff-d57d903ea297 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57b501d5874e405daa2793c3b72f3201', 'request_id': 'req-680463e7-d395-4830-88ff-d57d903ea297'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:11.402205 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:11.414914 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-680463e7-d395-4830-88ff-d57d903ea297 admin admin] The token cache is being invalidate because project 57b501d5874e405daa2793c3b72f3201 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80150) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:47:11.415467 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-680463e7-d395-4830-88ff-d57d903ea297 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:11.416944 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-680463e7-d395-4830-88ff-d57d903ea297 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:11.418665 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1323/2645] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:47:11 2022] DELETE /identity/v3/projects/57b501d5874e405daa2793c3b72f3201 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:47:11.423674 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2170c-a8c5-4002-adf4-a6b94d8febdb None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:11.423963 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2170c-a8c5-4002-adf4-a6b94d8febdb None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:11.424244 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2170c-a8c5-4002-adf4-a6b94d8febdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:11.444043 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-44d2170c-a8c5-4002-adf4-a6b94d8febdb None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:47:11.445473 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-44d2170c-a8c5-4002-adf4-a6b94d8febdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:11.511240 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1323/2646] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:47:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:47:11.519153 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7baab18-a08d-4158-b9ce-de50dd5cd9cc None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:11.519545 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7baab18-a08d-4158-b9ce-de50dd5cd9cc None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:11.519966 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7baab18-a08d-4158-b9ce-de50dd5cd9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:11.547816 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-c7baab18-a08d-4158-b9ce-de50dd5cd9cc None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:47:11.549051 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-c7baab18-a08d-4158-b9ce-de50dd5cd9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:11.558327 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1324/2647] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:47:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:47:11.562849 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2170c-a8c5-4002-adf4-a6b94d8febdb None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:11.573329 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2170c-a8c5-4002-adf4-a6b94d8febdb None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:11.578727 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af774e3-14ba-4d12-8970-156395c11c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:11.579444 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af774e3-14ba-4d12-8970-156395c11c35 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:11.579728 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af774e3-14ba-4d12-8970-156395c11c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:11.580000 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af774e3-14ba-4d12-8970-156395c11c35 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:11.580731 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af774e3-14ba-4d12-8970-156395c11c35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:47:11.581035 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af774e3-14ba-4d12-8970-156395c11c35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:11.582671 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af774e3-14ba-4d12-8970-156395c11c35 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:11.595018 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1324/2648] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:47:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:47:11.599846 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7baab18-a08d-4158-b9ce-de50dd5cd9cc None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:11.606894 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af774e3-14ba-4d12-8970-156395c11c35 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:11.608797 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-2af774e3-14ba-4d12-8970-156395c11c35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:11.613066 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7baab18-a08d-4158-b9ce-de50dd5cd9cc None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:11.622761 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af774e3-14ba-4d12-8970-156395c11c35 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:11.625970 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5158dd-2538-46ad-a33b-bc8a23e780f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:11.626660 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5158dd-2538-46ad-a33b-bc8a23e780f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:11.626941 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5158dd-2538-46ad-a33b-bc8a23e780f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:11.627208 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5158dd-2538-46ad-a33b-bc8a23e780f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:11.627904 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5158dd-2538-46ad-a33b-bc8a23e780f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:11.629182 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb79b6-6f0c-4aa9-8592-9b9600ffd127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:11.629834 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5158dd-2538-46ad-a33b-bc8a23e780f2 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:11.630429 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb79b6-6f0c-4aa9-8592-9b9600ffd127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:11.630880 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb79b6-6f0c-4aa9-8592-9b9600ffd127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:11.631316 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb79b6-6f0c-4aa9-8592-9b9600ffd127 admin admin] PATH_INFO: `/v3/projects/9e31f18468cf4b29b1ea8f0908e54aab` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:11.632691 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb79b6-6f0c-4aa9-8592-9b9600ffd127 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e31f18468cf4b29b1ea8f0908e54aab)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:11.634905 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb79b6-6f0c-4aa9-8592-9b9600ffd127 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:11.664665 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1325/2649] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:47:11 2022] POST /identity/v3/projects => generated 379 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:47:11.665890 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5158dd-2538-46ad-a33b-bc8a23e780f2 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:11.688794 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-78cb79b6-6f0c-4aa9-8592-9b9600ffd127 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e31f18468cf4b29b1ea8f0908e54aab', 'request_id': 'req-78cb79b6-6f0c-4aa9-8592-9b9600ffd127'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:11.697868 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-78cb79b6-6f0c-4aa9-8592-9b9600ffd127 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e31f18468cf4b29b1ea8f0908e54aab', 'request_id': 'req-78cb79b6-6f0c-4aa9-8592-9b9600ffd127'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:11.703661 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-78cb79b6-6f0c-4aa9-8592-9b9600ffd127 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e31f18468cf4b29b1ea8f0908e54aab', 'request_id': 'req-78cb79b6-6f0c-4aa9-8592-9b9600ffd127'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:11.715115 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-78cb79b6-6f0c-4aa9-8592-9b9600ffd127 admin admin] The token cache is being invalidate because project 9e31f18468cf4b29b1ea8f0908e54aab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:47:11.715400 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-78cb79b6-6f0c-4aa9-8592-9b9600ffd127 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:11.716054 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-78cb79b6-6f0c-4aa9-8592-9b9600ffd127 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:11.717632 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1325/2650] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:47:11 2022] DELETE /identity/v3/projects/9e31f18468cf4b29b1ea8f0908e54aab => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:47:11.722489 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c475a7-01c0-4279-9131-eff46e1306ef None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:11.722779 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c475a7-01c0-4279-9131-eff46e1306ef None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:11.723058 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c475a7-01c0-4279-9131-eff46e1306ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:11.735427 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5158dd-2538-46ad-a33b-bc8a23e780f2 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:11.740398 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-b2c475a7-01c0-4279-9131-eff46e1306ef None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:47:11.741599 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b2c475a7-01c0-4279-9131-eff46e1306ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:11.779692 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:11.793712 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2226c-cec1-49ad-97a1-c56fb433c5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:11.794444 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2226c-cec1-49ad-97a1-c56fb433c5b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:11.794721 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2226c-cec1-49ad-97a1-c56fb433c5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:11.794992 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2226c-cec1-49ad-97a1-c56fb433c5b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:11.795678 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f2226c-cec1-49ad-97a1-c56fb433c5b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:11.797584 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f2226c-cec1-49ad-97a1-c56fb433c5b4 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:11.808887 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1326/2651] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:47:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:47:11.810679 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291dfa0e-7c9b-43d3-a6ff-5143a06412f1 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:11.810971 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291dfa0e-7c9b-43d3-a6ff-5143a06412f1 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:11.811243 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291dfa0e-7c9b-43d3-a6ff-5143a06412f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:11.823154 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1326/2652] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:47:11 2022] POST /identity/v3/users => generated 290 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:47:11.824516 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2226c-cec1-49ad-97a1-c56fb433c5b4 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:11.826284 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-82f2226c-cec1-49ad-97a1-c56fb433c5b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:11.830097 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-291dfa0e-7c9b-43d3-a6ff-5143a06412f1 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:47:11.831274 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-291dfa0e-7c9b-43d3-a6ff-5143a06412f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:11.839179 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2226c-cec1-49ad-97a1-c56fb433c5b4 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:11.839816 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1327/2653] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:47:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:47:11.843771 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291dfa0e-7c9b-43d3-a6ff-5143a06412f1 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:11.843900 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6149d6f-2892-4e38-a356-0215b4778afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:11.844533 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6149d6f-2892-4e38-a356-0215b4778afd admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:11.844813 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6149d6f-2892-4e38-a356-0215b4778afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:11.845088 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6149d6f-2892-4e38-a356-0215b4778afd admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:11.846387 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6149d6f-2892-4e38-a356-0215b4778afd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:11.847592 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6149d6f-2892-4e38-a356-0215b4778afd admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:11.854079 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291dfa0e-7c9b-43d3-a6ff-5143a06412f1 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:11.858874 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1327/2654] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 17:47:11.859308 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe1285-f85f-4b9f-b5a3-1e5faf20beff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:11.859746 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe1285-f85f-4b9f-b5a3-1e5faf20beff admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:11.860030 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe1285-f85f-4b9f-b5a3-1e5faf20beff admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:11.860301 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe1285-f85f-4b9f-b5a3-1e5faf20beff admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:11.861041 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe1285-f85f-4b9f-b5a3-1e5faf20beff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:47:11.861345 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe1285-f85f-4b9f-b5a3-1e5faf20beff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:11.862877 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6149d6f-2892-4e38-a356-0215b4778afd admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:11.863120 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe1285-f85f-4b9f-b5a3-1e5faf20beff admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:11.874115 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6149d6f-2892-4e38-a356-0215b4778afd admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:11.875903 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1328/2655] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:47:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:47:11.878801 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee983fb-b0d0-4daf-9d00-2a66972d2f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:11.879527 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee983fb-b0d0-4daf-9d00-2a66972d2f1a admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:11.879810 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee983fb-b0d0-4daf-9d00-2a66972d2f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:11.880120 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee983fb-b0d0-4daf-9d00-2a66972d2f1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:11.880256 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe1285-f85f-4b9f-b5a3-1e5faf20beff admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:11.880855 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee983fb-b0d0-4daf-9d00-2a66972d2f1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:11.882490 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee983fb-b0d0-4daf-9d00-2a66972d2f1a admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:11.890444 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe1285-f85f-4b9f-b5a3-1e5faf20beff admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:11.893684 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1328/2656] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 17:47:11.895549 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d58ff3-8c6e-4d17-ab5c-99568e09ee7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:11.896278 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d58ff3-8c6e-4d17-ab5c-99568e09ee7d admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:11.896635 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d58ff3-8c6e-4d17-ab5c-99568e09ee7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:11.897184 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d58ff3-8c6e-4d17-ab5c-99568e09ee7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:11.897804 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee983fb-b0d0-4daf-9d00-2a66972d2f1a admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:11.897949 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d58ff3-8c6e-4d17-ab5c-99568e09ee7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:11.899836 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d58ff3-8c6e-4d17-ab5c-99568e09ee7d admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:11.907742 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee983fb-b0d0-4daf-9d00-2a66972d2f1a admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:11.912376 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a199fd-a41d-4ab9-bf22-ecc8ccb2f322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:11.913259 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a199fd-a41d-4ab9-bf22-ecc8ccb2f322 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:11.913542 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a199fd-a41d-4ab9-bf22-ecc8ccb2f322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:11.913847 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a199fd-a41d-4ab9-bf22-ecc8ccb2f322 admin admin] PATH_INFO: `/v3/projects/33806fb6af2344a7bb5cf8736fbe01e7/users/8c343f6724c045d38d6a842220e14414/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:11.927342 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1329/2657] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:47:11 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 17:47:11.928871 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a199fd-a41d-4ab9-bf22-ecc8ccb2f322 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33806fb6af2344a7bb5cf8736fbe01e7, user_id=8c343f6724c045d38d6a842220e14414, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:11.931425 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d58ff3-8c6e-4d17-ab5c-99568e09ee7d admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:11.931602 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a199fd-a41d-4ab9-bf22-ecc8ccb2f322 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:11.946327 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1329/2658] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:47:11 2022] PUT /identity/v3/projects/33806fb6af2344a7bb5cf8736fbe01e7/users/8c343f6724c045d38d6a842220e14414/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:47:11.958205 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8481640-0c46-40fc-916b-5311cd9d88cc None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:11.958587 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8481640-0c46-40fc-916b-5311cd9d88cc None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:11.958933 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8481640-0c46-40fc-916b-5311cd9d88cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:11.989270 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-e8481640-0c46-40fc-916b-5311cd9d88cc None None] MFA Rules not processed for user `8c343f6724c045d38d6a842220e14414`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:47:11.990552 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-e8481640-0c46-40fc-916b-5311cd9d88cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:11.995946 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:11.999580 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d58ff3-8c6e-4d17-ab5c-99568e09ee7d admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:12.064810 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1330/2659] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:47:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:47:12.069907 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8481640-0c46-40fc-916b-5311cd9d88cc None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:12.073893 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf3249-beb9-460f-84cc-586cc7e5c5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:12.074659 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf3249-beb9-460f-84cc-586cc7e5c5fa admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:12.074884 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf3249-beb9-460f-84cc-586cc7e5c5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:12.075156 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf3249-beb9-460f-84cc-586cc7e5c5fa admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:12.075881 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf3249-beb9-460f-84cc-586cc7e5c5fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:12.077824 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf3249-beb9-460f-84cc-586cc7e5c5fa admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:12.080760 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8481640-0c46-40fc-916b-5311cd9d88cc None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:12.085401 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2508880e-df44-4038-beb9-0e68b5da3077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:12.086164 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508880e-df44-4038-beb9-0e68b5da3077 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:12.086439 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508880e-df44-4038-beb9-0e68b5da3077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:12.086710 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508880e-df44-4038-beb9-0e68b5da3077 admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:12.087397 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2508880e-df44-4038-beb9-0e68b5da3077 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:12.089640 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2508880e-df44-4038-beb9-0e68b5da3077 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:12.101206 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1330/2660] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:47:11 2022] POST /identity/v3/users => generated 287 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:47:12.105647 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf3249-beb9-460f-84cc-586cc7e5c5fa admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:12.115649 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf3249-beb9-460f-84cc-586cc7e5c5fa admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:12.120735 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1331/2661] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:47:12 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 17:47:12.121854 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2508880e-df44-4038-beb9-0e68b5da3077 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:12.150670 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:12.176725 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba8c9f-d46d-436c-bf39-b301206eaed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:12.177500 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba8c9f-d46d-436c-bf39-b301206eaed8 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:12.177805 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba8c9f-d46d-436c-bf39-b301206eaed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:12.178088 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba8c9f-d46d-436c-bf39-b301206eaed8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:12.178846 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ba8c9f-d46d-436c-bf39-b301206eaed8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:12.180462 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ba8c9f-d46d-436c-bf39-b301206eaed8 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:12.190701 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2508880e-df44-4038-beb9-0e68b5da3077 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:12.191235 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1331/2662] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:47:12.195258 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba8c9f-d46d-436c-bf39-b301206eaed8 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:12.195698 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf7c2a0-4d51-4887-b6df-c37e8b60266b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:12.196407 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7c2a0-4d51-4887-b6df-c37e8b60266b admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:12.196691 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7c2a0-4d51-4887-b6df-c37e8b60266b admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:12.196994 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7c2a0-4d51-4887-b6df-c37e8b60266b admin admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:12.198102 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf7c2a0-4d51-4887-b6df-c37e8b60266b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:12.200074 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf7c2a0-4d51-4887-b6df-c37e8b60266b admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:12.205486 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba8c9f-d46d-436c-bf39-b301206eaed8 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:12.210806 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0d9f1-f938-4f70-8b1c-bce2208f33a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:12.211500 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0d9f1-f938-4f70-8b1c-bce2208f33a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:12.211785 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0d9f1-f938-4f70-8b1c-bce2208f33a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:12.212089 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0d9f1-f938-4f70-8b1c-bce2208f33a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:12.213237 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c0d9f1-f938-4f70-8b1c-bce2208f33a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:12.215152 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c0d9f1-f938-4f70-8b1c-bce2208f33a5 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:12.228302 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1332/2663] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:47:12 2022] POST /identity/v3/users => generated 296 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:47:12.228690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1332/2664] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:47:12.230246 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0d9f1-f938-4f70-8b1c-bce2208f33a5 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:12.230380 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf7c2a0-4d51-4887-b6df-c37e8b60266b admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:12.240206 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0d9f1-f938-4f70-8b1c-bce2208f33a5 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:12.240369 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf7c2a0-4d51-4887-b6df-c37e8b60266b admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:12.245060 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf506d-d828-46c1-bd75-7ca98b7ebad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:12.245977 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf506d-d828-46c1-bd75-7ca98b7ebad5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:12.246259 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf506d-d828-46c1-bd75-7ca98b7ebad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:12.246373 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69b926-821a-4aa7-9e1f-94549102f08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:12.246589 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf506d-d828-46c1-bd75-7ca98b7ebad5 admin admin] PATH_INFO: `/v3/projects/84ad7cd23e5948169fe849f3dbeed56e/users/0294672967a84be48378f5e255675edc/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:12.246978 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69b926-821a-4aa7-9e1f-94549102f08a admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:12.247318 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69b926-821a-4aa7-9e1f-94549102f08a admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:12.247556 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69b926-821a-4aa7-9e1f-94549102f08a admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:12.248626 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a69b926-821a-4aa7-9e1f-94549102f08a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:12.250257 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a69b926-821a-4aa7-9e1f-94549102f08a admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:12.261001 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1333/2665] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:47:12.262192 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bf506d-d828-46c1-bd75-7ca98b7ebad5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84ad7cd23e5948169fe849f3dbeed56e, user_id=0294672967a84be48378f5e255675edc, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:12.264924 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bf506d-d828-46c1-bd75-7ca98b7ebad5 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:12.265129 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69b926-821a-4aa7-9e1f-94549102f08a admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:12.275414 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69b926-821a-4aa7-9e1f-94549102f08a admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:12.280784 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1333/2666] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:47:12 2022] PUT /identity/v3/projects/84ad7cd23e5948169fe849f3dbeed56e/users/0294672967a84be48378f5e255675edc/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:47:12.291154 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e18f3b-9e62-45a7-bcb2-60dc9e0739d8 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:12.291488 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e18f3b-9e62-45a7-bcb2-60dc9e0739d8 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:12.291761 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e18f3b-9e62-45a7-bcb2-60dc9e0739d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:12.318418 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-f9e18f3b-9e62-45a7-bcb2-60dc9e0739d8 None None] MFA Rules not processed for user `0294672967a84be48378f5e255675edc`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:47:12.319641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f9e18f3b-9e62-45a7-bcb2-60dc9e0739d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:12.336507 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec85f4-d9ec-4841-88e5-261b0240eb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:12.337341 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec85f4-d9ec-4841-88e5-261b0240eb02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:12.338541 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec85f4-d9ec-4841-88e5-261b0240eb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:12.338541 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec85f4-d9ec-4841-88e5-261b0240eb02 admin admin] PATH_INFO: `/v3/projects/48e5ed024e7a4698b3333565695f20e8/users/9fb5cdbcc2cb462395a72e7d2332bde9/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:12.341104 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:12.353698 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fec85f4-d9ec-4841-88e5-261b0240eb02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48e5ed024e7a4698b3333565695f20e8, user_id=9fb5cdbcc2cb462395a72e7d2332bde9, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:12.356408 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fec85f4-d9ec-4841-88e5-261b0240eb02 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:12.371193 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1334/2667] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:47:12 2022] PUT /identity/v3/projects/48e5ed024e7a4698b3333565695f20e8/users/9fb5cdbcc2cb462395a72e7d2332bde9/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:47:12.375246 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec85f4-d9ec-4841-88e5-261b0240eb02 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:12.385233 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1334/2668] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:47:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:47:12.396387 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e18f3b-9e62-45a7-bcb2-60dc9e0739d8 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:12.397880 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f9e18f3b-9e62-45a7-bcb2-60dc9e0739d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:12.437248 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec85f4-d9ec-4841-88e5-261b0240eb02 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:12.442376 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2371f-6592-4573-8c28-fa79c7810888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:12.443049 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2371f-6592-4573-8c28-fa79c7810888 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:12.443333 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2371f-6592-4573-8c28-fa79c7810888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:12.443595 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2371f-6592-4573-8c28-fa79c7810888 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:12.444339 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2371f-6592-4573-8c28-fa79c7810888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:12.445957 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2371f-6592-4573-8c28-fa79c7810888 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:12.453878 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e18f3b-9e62-45a7-bcb2-60dc9e0739d8 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:12.456074 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1335/2669] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 17:47:12.460186 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2371f-6592-4573-8c28-fa79c7810888 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:12.470312 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2371f-6592-4573-8c28-fa79c7810888 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:12.475232 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58400e50-56a8-4e0d-8532-9f0de349a76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:12.476537 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58400e50-56a8-4e0d-8532-9f0de349a76d admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:12.476537 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58400e50-56a8-4e0d-8532-9f0de349a76d admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:12.476737 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58400e50-56a8-4e0d-8532-9f0de349a76d admin admin] PATH_INFO: `/v3/projects/48e5ed024e7a4698b3333565695f20e8/users/9fb5cdbcc2cb462395a72e7d2332bde9/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:12.478915 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58400e50-56a8-4e0d-8532-9f0de349a76d admin admin] RBAC: Authorizing `identity:create_grant(project_id=48e5ed024e7a4698b3333565695f20e8, user_id=9fb5cdbcc2cb462395a72e7d2332bde9, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:12.481949 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58400e50-56a8-4e0d-8532-9f0de349a76d admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:12.495272 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1336/2670] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:47:12 2022] PUT /identity/v3/projects/48e5ed024e7a4698b3333565695f20e8/users/9fb5cdbcc2cb462395a72e7d2332bde9/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:47:12.505731 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75ce04-9680-439e-8216-406d50fa340e None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:12.506048 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75ce04-9680-439e-8216-406d50fa340e None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:12.506327 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75ce04-9680-439e-8216-406d50fa340e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:12.506567 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:12.511864 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64588e-5ff4-49db-b4de-d15e52ab367e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:12.512914 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64588e-5ff4-49db-b4de-d15e52ab367e service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:12.513281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64588e-5ff4-49db-b4de-d15e52ab367e service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:12.514607 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64588e-5ff4-49db-b4de-d15e52ab367e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:12.541193 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-6e75ce04-9680-439e-8216-406d50fa340e None None] MFA Rules not processed for user `9fb5cdbcc2cb462395a72e7d2332bde9`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:47:12.542635 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-6e75ce04-9680-439e-8216-406d50fa340e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:12.579641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e64588e-5ff4-49db-b4de-d15e52ab367e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:12.581403 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e64588e-5ff4-49db-b4de-d15e52ab367e service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:12.590608 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1335/2671] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:47:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 17:47:12.615011 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1337/2672] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:47:12 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:47:12.627106 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64588e-5ff4-49db-b4de-d15e52ab367e service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:12.629197 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5e64588e-5ff4-49db-b4de-d15e52ab367e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:12.641397 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64588e-5ff4-49db-b4de-d15e52ab367e service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:12.693255 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64df481-5de6-4b5a-a673-277ed9c409b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:12.694019 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64df481-5de6-4b5a-a673-277ed9c409b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:12.694348 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64df481-5de6-4b5a-a673-277ed9c409b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:12.694620 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64df481-5de6-4b5a-a673-277ed9c409b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:12.757497 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64df481-5de6-4b5a-a673-277ed9c409b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:12.759131 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64df481-5de6-4b5a-a673-277ed9c409b4 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:12.769172 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1336/2673] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:47:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:47:13.958636 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58198b8f-7a8a-4f39-a14a-463dc85e0eb3 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:13.959199 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58198b8f-7a8a-4f39-a14a-463dc85e0eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:13.959199 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58198b8f-7a8a-4f39-a14a-463dc85e0eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:13.979256 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-58198b8f-7a8a-4f39-a14a-463dc85e0eb3 None None] MFA Rules not processed for user `0294672967a84be48378f5e255675edc`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:47:13.980470 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-58198b8f-7a8a-4f39-a14a-463dc85e0eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:14.029990 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:14.039144 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1338/2674] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:47:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:47:14.138834 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64df481-5de6-4b5a-a673-277ed9c409b4 service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:14.148019 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64df481-5de6-4b5a-a673-277ed9c409b4 service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:14.152329 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d303bd-1f0d-4120-894e-5af0334ce3e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:14.152984 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d303bd-1f0d-4120-894e-5af0334ce3e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:14.153265 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d303bd-1f0d-4120-894e-5af0334ce3e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:14.153565 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d303bd-1f0d-4120-894e-5af0334ce3e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:14.164091 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d303bd-1f0d-4120-894e-5af0334ce3e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:14.165545 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d303bd-1f0d-4120-894e-5af0334ce3e3 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:14.176053 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1337/2675] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:47:14 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:47:18.019366 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58198b8f-7a8a-4f39-a14a-463dc85e0eb3 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:18.093561 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58198b8f-7a8a-4f39-a14a-463dc85e0eb3 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:18.099391 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d77d1-3489-48c2-af0f-62de4f15e82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:18.100283 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d77d1-3489-48c2-af0f-62de4f15e82e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:18.100563 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d77d1-3489-48c2-af0f-62de4f15e82e admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:18.100834 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d77d1-3489-48c2-af0f-62de4f15e82e admin admin] PATH_INFO: `/v3/users/8c343f6724c045d38d6a842220e14414` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:18.102107 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d77d1-3489-48c2-af0f-62de4f15e82e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c343f6724c045d38d6a842220e14414)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:18.104138 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d77d1-3489-48c2-af0f-62de4f15e82e admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:18.162608 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-ef9d77d1-3489-48c2-af0f-62de4f15e82e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c343f6724c045d38d6a842220e14414'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:18.162608 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-ef9d77d1-3489-48c2-af0f-62de4f15e82e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c343f6724c045d38d6a842220e14414'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:18.171563 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-ef9d77d1-3489-48c2-af0f-62de4f15e82e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c343f6724c045d38d6a842220e14414'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:18.172344 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-ef9d77d1-3489-48c2-af0f-62de4f15e82e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c343f6724c045d38d6a842220e14414'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:18.185609 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-ef9d77d1-3489-48c2-af0f-62de4f15e82e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c343f6724c045d38d6a842220e14414'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:18.202262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1339/2676] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:47:18 2022] DELETE /identity/v3/users/8c343f6724c045d38d6a842220e14414 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:47:18.207571 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf82901-4df5-4306-8312-3035da9ad82d None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:18.208102 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf82901-4df5-4306-8312-3035da9ad82d None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:18.208102 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf82901-4df5-4306-8312-3035da9ad82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:18.225887 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-5cf82901-4df5-4306-8312-3035da9ad82d None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:47:18.227082 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5cf82901-4df5-4306-8312-3035da9ad82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:18.262089 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:18.291084 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1338/2677] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:47:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:47:18.301047 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d77d1-3489-48c2-af0f-62de4f15e82e admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:18.302507 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-ef9d77d1-3489-48c2-af0f-62de4f15e82e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:18.362744 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d77d1-3489-48c2-af0f-62de4f15e82e admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:18.366983 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5db1b-36c7-4306-994a-b020653f0585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:18.367634 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5db1b-36c7-4306-994a-b020653f0585 service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:18.367914 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5db1b-36c7-4306-994a-b020653f0585 service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:18.368182 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5db1b-36c7-4306-994a-b020653f0585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:18.377880 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef5db1b-36c7-4306-994a-b020653f0585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:18.379303 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef5db1b-36c7-4306-994a-b020653f0585 service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:18.388936 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1340/2678] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:47:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:47:18.673971 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf82901-4df5-4306-8312-3035da9ad82d None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:18.675599 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5cf82901-4df5-4306-8312-3035da9ad82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:18.688586 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf82901-4df5-4306-8312-3035da9ad82d None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:18.693729 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad5db7-a8ac-4390-aa33-a0e3e9a5ae49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:18.694636 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad5db7-a8ac-4390-aa33-a0e3e9a5ae49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:18.695014 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad5db7-a8ac-4390-aa33-a0e3e9a5ae49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:18.695288 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad5db7-a8ac-4390-aa33-a0e3e9a5ae49 admin admin] PATH_INFO: `/v3/projects/33806fb6af2344a7bb5cf8736fbe01e7` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:18.696744 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad5db7-a8ac-4390-aa33-a0e3e9a5ae49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33806fb6af2344a7bb5cf8736fbe01e7)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:18.698990 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad5db7-a8ac-4390-aa33-a0e3e9a5ae49 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:18.747240 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d6ad5db7-a8ac-4390-aa33-a0e3e9a5ae49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33806fb6af2344a7bb5cf8736fbe01e7', 'request_id': 'req-d6ad5db7-a8ac-4390-aa33-a0e3e9a5ae49'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:18.755854 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d6ad5db7-a8ac-4390-aa33-a0e3e9a5ae49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33806fb6af2344a7bb5cf8736fbe01e7', 'request_id': 'req-d6ad5db7-a8ac-4390-aa33-a0e3e9a5ae49'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:18.761856 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d6ad5db7-a8ac-4390-aa33-a0e3e9a5ae49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33806fb6af2344a7bb5cf8736fbe01e7', 'request_id': 'req-d6ad5db7-a8ac-4390-aa33-a0e3e9a5ae49'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:18.772590 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d6ad5db7-a8ac-4390-aa33-a0e3e9a5ae49 admin admin] The token cache is being invalidate because project 33806fb6af2344a7bb5cf8736fbe01e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:47:18.772871 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d6ad5db7-a8ac-4390-aa33-a0e3e9a5ae49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:18.773491 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-d6ad5db7-a8ac-4390-aa33-a0e3e9a5ae49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:18.775208 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1339/2679] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:47:18 2022] DELETE /identity/v3/projects/33806fb6af2344a7bb5cf8736fbe01e7 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:47:18.780193 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5db1b-36c7-4306-994a-b020653f0585 service neutron] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:18.795558 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5db1b-36c7-4306-994a-b020653f0585 service neutron] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:18.816208 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:18.859932 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb9668-3989-4606-a2d7-e76d7ba74195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:18.860827 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb9668-3989-4606-a2d7-e76d7ba74195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:18.861105 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb9668-3989-4606-a2d7-e76d7ba74195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:18.861382 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb9668-3989-4606-a2d7-e76d7ba74195 admin admin] PATH_INFO: `/v3/users/9fb5cdbcc2cb462395a72e7d2332bde9` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:18.862641 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb9668-3989-4606-a2d7-e76d7ba74195 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fb5cdbcc2cb462395a72e7d2332bde9)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:18.864554 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb9668-3989-4606-a2d7-e76d7ba74195 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:18.916438 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-f0fb9668-3989-4606-a2d7-e76d7ba74195 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fb5cdbcc2cb462395a72e7d2332bde9'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:18.917085 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-f0fb9668-3989-4606-a2d7-e76d7ba74195 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fb5cdbcc2cb462395a72e7d2332bde9'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:18.924158 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-f0fb9668-3989-4606-a2d7-e76d7ba74195 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fb5cdbcc2cb462395a72e7d2332bde9'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:18.924785 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-f0fb9668-3989-4606-a2d7-e76d7ba74195 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fb5cdbcc2cb462395a72e7d2332bde9'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:18.936576 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-f0fb9668-3989-4606-a2d7-e76d7ba74195 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fb5cdbcc2cb462395a72e7d2332bde9'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:18.952022 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1341/2680] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:47:18 2022] DELETE /identity/v3/users/9fb5cdbcc2cb462395a72e7d2332bde9 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:47:19.242519 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad5db7-a8ac-4390-aa33-a0e3e9a5ae49 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:19.244063 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d6ad5db7-a8ac-4390-aa33-a0e3e9a5ae49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:19.257164 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad5db7-a8ac-4390-aa33-a0e3e9a5ae49 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:19.317981 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613aa711-0eb3-44a2-a276-dbdd99533733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:19.318879 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613aa711-0eb3-44a2-a276-dbdd99533733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:19.319171 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613aa711-0eb3-44a2-a276-dbdd99533733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:19.319453 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613aa711-0eb3-44a2-a276-dbdd99533733 admin admin] PATH_INFO: `/v3/projects/48e5ed024e7a4698b3333565695f20e8` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:19.320760 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613aa711-0eb3-44a2-a276-dbdd99533733 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48e5ed024e7a4698b3333565695f20e8)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:19.323047 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613aa711-0eb3-44a2-a276-dbdd99533733 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:19.385191 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-613aa711-0eb3-44a2-a276-dbdd99533733 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48e5ed024e7a4698b3333565695f20e8', 'request_id': 'req-613aa711-0eb3-44a2-a276-dbdd99533733'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:19.394941 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-613aa711-0eb3-44a2-a276-dbdd99533733 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48e5ed024e7a4698b3333565695f20e8', 'request_id': 'req-613aa711-0eb3-44a2-a276-dbdd99533733'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:19.401628 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-613aa711-0eb3-44a2-a276-dbdd99533733 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48e5ed024e7a4698b3333565695f20e8', 'request_id': 'req-613aa711-0eb3-44a2-a276-dbdd99533733'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:19.402798 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:19.417504 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-613aa711-0eb3-44a2-a276-dbdd99533733 admin admin] The token cache is being invalidate because project 48e5ed024e7a4698b3333565695f20e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:47:19.417814 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-613aa711-0eb3-44a2-a276-dbdd99533733 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:19.418564 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-613aa711-0eb3-44a2-a276-dbdd99533733 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:19.420447 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1340/2681] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:47:19 2022] DELETE /identity/v3/projects/48e5ed024e7a4698b3333565695f20e8 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:47:19.426407 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5823cb07-b999-4885-b877-055ebcd42ab6 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:19.426908 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5823cb07-b999-4885-b877-055ebcd42ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:19.427007 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5823cb07-b999-4885-b877-055ebcd42ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:19.453497 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-5823cb07-b999-4885-b877-055ebcd42ab6 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:47:19.454779 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-5823cb07-b999-4885-b877-055ebcd42ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:19.523869 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1342/2682] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:47:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:47:19.532188 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb06c8-9219-4cc9-a345-efe07261dfc0 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:19.532474 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb06c8-9219-4cc9-a345-efe07261dfc0 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:19.532797 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb06c8-9219-4cc9-a345-efe07261dfc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:19.551566 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-5beb06c8-9219-4cc9-a345-efe07261dfc0 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:47:19.552770 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5beb06c8-9219-4cc9-a345-efe07261dfc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:19.561492 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1341/2683] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:47:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:47:19.566177 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5823cb07-b999-4885-b877-055ebcd42ab6 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:19.576512 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5823cb07-b999-4885-b877-055ebcd42ab6 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:19.581424 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4cfe24-82d0-436c-8cc3-c83e76e62fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:19.582115 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4cfe24-82d0-436c-8cc3-c83e76e62fce admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:19.582393 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4cfe24-82d0-436c-8cc3-c83e76e62fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:19.582695 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4cfe24-82d0-436c-8cc3-c83e76e62fce admin admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:19.583420 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4cfe24-82d0-436c-8cc3-c83e76e62fce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:47:19.583725 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4cfe24-82d0-436c-8cc3-c83e76e62fce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:19.585320 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4cfe24-82d0-436c-8cc3-c83e76e62fce admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:19.597603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1343/2684] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:47:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:47:19.601967 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb06c8-9219-4cc9-a345-efe07261dfc0 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:19.611729 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb06c8-9219-4cc9-a345-efe07261dfc0 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:19.616658 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f55095-eb28-4a69-bda0-befcc78e5f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:19.617335 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f55095-eb28-4a69-bda0-befcc78e5f4d admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:19.617588 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f55095-eb28-4a69-bda0-befcc78e5f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:19.617887 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f55095-eb28-4a69-bda0-befcc78e5f4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:19.618782 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f55095-eb28-4a69-bda0-befcc78e5f4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:19.620699 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f55095-eb28-4a69-bda0-befcc78e5f4d admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:19.655727 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1342/2685] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:47:19 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:47:19.660177 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4cfe24-82d0-436c-8cc3-c83e76e62fce admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:19.676085 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4cfe24-82d0-436c-8cc3-c83e76e62fce admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:19.701936 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:19.740990 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b526b-70a2-44cf-badc-7fbef1c83a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:19.741937 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b526b-70a2-44cf-badc-7fbef1c83a93 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:19.742061 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b526b-70a2-44cf-badc-7fbef1c83a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:19.742229 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b526b-70a2-44cf-badc-7fbef1c83a93 admin admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:19.743097 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b526b-70a2-44cf-badc-7fbef1c83a93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:19.745339 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b526b-70a2-44cf-badc-7fbef1c83a93 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:19.767289 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1344/2686] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:47:19 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:47:19.771526 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f55095-eb28-4a69-bda0-befcc78e5f4d admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:19.782710 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f55095-eb28-4a69-bda0-befcc78e5f4d admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:19.787791 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9d46f-d717-4e6a-8e4e-f760c49b0d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:19.788453 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9d46f-d717-4e6a-8e4e-f760c49b0d82 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:19.788730 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9d46f-d717-4e6a-8e4e-f760c49b0d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:19.788996 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9d46f-d717-4e6a-8e4e-f760c49b0d82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:19.789693 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe9d46f-d717-4e6a-8e4e-f760c49b0d82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:19.791445 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe9d46f-d717-4e6a-8e4e-f760c49b0d82 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:19.807783 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1343/2687] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 17:47:19.812189 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b526b-70a2-44cf-badc-7fbef1c83a93 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:19.823097 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b526b-70a2-44cf-badc-7fbef1c83a93 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:19.828664 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34446924-2270-4e46-864a-b2d60fcb5c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:19.829336 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34446924-2270-4e46-864a-b2d60fcb5c0f admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:19.829618 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34446924-2270-4e46-864a-b2d60fcb5c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:19.829933 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34446924-2270-4e46-864a-b2d60fcb5c0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:19.830704 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34446924-2270-4e46-864a-b2d60fcb5c0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:19.832343 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34446924-2270-4e46-864a-b2d60fcb5c0f admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:19.842965 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1345/2688] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:47:19.847279 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9d46f-d717-4e6a-8e4e-f760c49b0d82 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:19.857994 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9d46f-d717-4e6a-8e4e-f760c49b0d82 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:19.862851 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b34a93-661e-49c0-9ff1-c51fbd386d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:19.863746 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b34a93-661e-49c0-9ff1-c51fbd386d78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:19.864023 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b34a93-661e-49c0-9ff1-c51fbd386d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:19.864306 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b34a93-661e-49c0-9ff1-c51fbd386d78 admin admin] PATH_INFO: `/v3/projects/c23024227ba1413688811f45b442cb49/users/1498420842b042a7b4ecd10ebf992ed3/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:19.879411 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b34a93-661e-49c0-9ff1-c51fbd386d78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c23024227ba1413688811f45b442cb49, user_id=1498420842b042a7b4ecd10ebf992ed3, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:19.882116 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b34a93-661e-49c0-9ff1-c51fbd386d78 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:19.897107 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1344/2689] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:47:19 2022] PUT /identity/v3/projects/c23024227ba1413688811f45b442cb49/users/1498420842b042a7b4ecd10ebf992ed3/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:47:19.912375 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88961989-3d37-42b7-9dd3-c755cf5bf1b4 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:19.912878 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88961989-3d37-42b7-9dd3-c755cf5bf1b4 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:19.913358 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88961989-3d37-42b7-9dd3-c755cf5bf1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:19.943914 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-88961989-3d37-42b7-9dd3-c755cf5bf1b4 None None] MFA Rules not processed for user `1498420842b042a7b4ecd10ebf992ed3`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:47:19.945228 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-88961989-3d37-42b7-9dd3-c755cf5bf1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:20.019798 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1346/2690] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:47:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:47:20.031524 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b34a93-661e-49c0-9ff1-c51fbd386d78 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:20.033716 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-43b34a93-661e-49c0-9ff1-c51fbd386d78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:20.094339 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b34a93-661e-49c0-9ff1-c51fbd386d78 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:20.098109 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db8cb7f-bf1d-49ec-a290-17026d226234 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:20.098776 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db8cb7f-bf1d-49ec-a290-17026d226234 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:20.099593 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db8cb7f-bf1d-49ec-a290-17026d226234 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:20.099593 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db8cb7f-bf1d-49ec-a290-17026d226234 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:20.109298 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db8cb7f-bf1d-49ec-a290-17026d226234 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:20.110775 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db8cb7f-bf1d-49ec-a290-17026d226234 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:20.120725 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1345/2691] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:47:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:47:23.260134 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88961989-3d37-42b7-9dd3-c755cf5bf1b4 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:23.337669 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88961989-3d37-42b7-9dd3-c755cf5bf1b4 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:23.343269 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c7edc-7852-4f47-b193-88bfa21105f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:23.344844 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c7edc-7852-4f47-b193-88bfa21105f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:23.345160 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c7edc-7852-4f47-b193-88bfa21105f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:23.345433 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c7edc-7852-4f47-b193-88bfa21105f1 admin admin] PATH_INFO: `/v3/users/1498420842b042a7b4ecd10ebf992ed3` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:23.346849 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8c7edc-7852-4f47-b193-88bfa21105f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1498420842b042a7b4ecd10ebf992ed3)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:23.348791 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8c7edc-7852-4f47-b193-88bfa21105f1 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:23.397913 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:23.409436 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-1f8c7edc-7852-4f47-b193-88bfa21105f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1498420842b042a7b4ecd10ebf992ed3'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:23.410572 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-1f8c7edc-7852-4f47-b193-88bfa21105f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1498420842b042a7b4ecd10ebf992ed3'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:23.419366 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-1f8c7edc-7852-4f47-b193-88bfa21105f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1498420842b042a7b4ecd10ebf992ed3'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:23.420098 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-1f8c7edc-7852-4f47-b193-88bfa21105f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1498420842b042a7b4ecd10ebf992ed3'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:23.434035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-1f8c7edc-7852-4f47-b193-88bfa21105f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1498420842b042a7b4ecd10ebf992ed3'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:23.450944 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1347/2692] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:47:23 2022] DELETE /identity/v3/users/1498420842b042a7b4ecd10ebf992ed3 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:47:23.455498 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d948b-e98a-4b1c-9e82-3cddff1a7bc8 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:23.455954 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d948b-e98a-4b1c-9e82-3cddff1a7bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:23.456110 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d948b-e98a-4b1c-9e82-3cddff1a7bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:23.474814 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-f44d948b-e98a-4b1c-9e82-3cddff1a7bc8 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:47:23.476052 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f44d948b-e98a-4b1c-9e82-3cddff1a7bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:23.544518 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1346/2693] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:47:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:47:23.554772 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c7edc-7852-4f47-b193-88bfa21105f1 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:23.556406 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-1f8c7edc-7852-4f47-b193-88bfa21105f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:23.616016 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c7edc-7852-4f47-b193-88bfa21105f1 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:23.620325 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a83af9-677f-4cf0-8f15-aef3a25ff94c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:23.620988 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a83af9-677f-4cf0-8f15-aef3a25ff94c service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:23.621268 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a83af9-677f-4cf0-8f15-aef3a25ff94c service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:23.621543 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a83af9-677f-4cf0-8f15-aef3a25ff94c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:23.631276 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a83af9-677f-4cf0-8f15-aef3a25ff94c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:23.632645 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a83af9-677f-4cf0-8f15-aef3a25ff94c service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:23.643249 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1348/2694] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:47:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 17:47:23.982511 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d948b-e98a-4b1c-9e82-3cddff1a7bc8 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:23.983888 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f44d948b-e98a-4b1c-9e82-3cddff1a7bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:23.997161 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d948b-e98a-4b1c-9e82-3cddff1a7bc8 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:24.003944 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3693f891-a1be-4ca6-a089-37e75bd56624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:24.004945 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693f891-a1be-4ca6-a089-37e75bd56624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:24.005228 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693f891-a1be-4ca6-a089-37e75bd56624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:24.005501 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693f891-a1be-4ca6-a089-37e75bd56624 admin admin] PATH_INFO: `/v3/projects/c23024227ba1413688811f45b442cb49` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:24.006818 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3693f891-a1be-4ca6-a089-37e75bd56624 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c23024227ba1413688811f45b442cb49)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:24.008986 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3693f891-a1be-4ca6-a089-37e75bd56624 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:24.053276 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:24.098725 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-3693f891-a1be-4ca6-a089-37e75bd56624 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c23024227ba1413688811f45b442cb49', 'request_id': 'req-3693f891-a1be-4ca6-a089-37e75bd56624'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:24.124315 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-3693f891-a1be-4ca6-a089-37e75bd56624 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c23024227ba1413688811f45b442cb49', 'request_id': 'req-3693f891-a1be-4ca6-a089-37e75bd56624'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:24.132128 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-3693f891-a1be-4ca6-a089-37e75bd56624 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c23024227ba1413688811f45b442cb49', 'request_id': 'req-3693f891-a1be-4ca6-a089-37e75bd56624'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:24.145808 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-3693f891-a1be-4ca6-a089-37e75bd56624 admin admin] The token cache is being invalidate because project c23024227ba1413688811f45b442cb49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:47:24.146284 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-3693f891-a1be-4ca6-a089-37e75bd56624 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:24.147107 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-3693f891-a1be-4ca6-a089-37e75bd56624 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:24.149200 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1347/2695] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:47:23 2022] DELETE /identity/v3/projects/c23024227ba1413688811f45b442cb49 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:47:24.155220 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c826e-0079-4fb7-b8c2-5cf0c95cd44f None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:24.155621 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c826e-0079-4fb7-b8c2-5cf0c95cd44f None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:24.155987 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c826e-0079-4fb7-b8c2-5cf0c95cd44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:24.182009 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-768c826e-0079-4fb7-b8c2-5cf0c95cd44f None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:47:24.183490 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-768c826e-0079-4fb7-b8c2-5cf0c95cd44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:24.280172 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1349/2696] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:47:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:47:24.288098 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3cfcf-2c49-4356-8542-859842066ba7 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:24.288571 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3cfcf-2c49-4356-8542-859842066ba7 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:24.288999 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3cfcf-2c49-4356-8542-859842066ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:24.312128 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-8ce3cfcf-2c49-4356-8542-859842066ba7 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:47:24.313429 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8ce3cfcf-2c49-4356-8542-859842066ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:24.326049 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1348/2697] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:47:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:47:24.330710 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c826e-0079-4fb7-b8c2-5cf0c95cd44f None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:24.345501 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c826e-0079-4fb7-b8c2-5cf0c95cd44f None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:24.350369 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78751c-8932-45ec-8403-3acc5182b3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:24.351236 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78751c-8932-45ec-8403-3acc5182b3f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:24.351522 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78751c-8932-45ec-8403-3acc5182b3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:24.351797 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78751c-8932-45ec-8403-3acc5182b3f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:24.352534 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78751c-8932-45ec-8403-3acc5182b3f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:47:24.352839 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78751c-8932-45ec-8403-3acc5182b3f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:24.355281 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78751c-8932-45ec-8403-3acc5182b3f0 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:24.369811 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1350/2698] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:47:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:47:24.372202 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3cfcf-2c49-4356-8542-859842066ba7 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:24.381577 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3cfcf-2c49-4356-8542-859842066ba7 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:24.386700 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b95a80-6562-42c2-84cb-f1e5e8a8e501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:24.387371 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b95a80-6562-42c2-84cb-f1e5e8a8e501 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:24.387652 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b95a80-6562-42c2-84cb-f1e5e8a8e501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:24.387924 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b95a80-6562-42c2-84cb-f1e5e8a8e501 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:24.388627 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b95a80-6562-42c2-84cb-f1e5e8a8e501 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:24.390636 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b95a80-6562-42c2-84cb-f1e5e8a8e501 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:24.419334 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1349/2699] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:47:24 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:47:24.423778 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78751c-8932-45ec-8403-3acc5182b3f0 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:24.434546 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78751c-8932-45ec-8403-3acc5182b3f0 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:24.480551 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:24.501724 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c455f-dfb3-486a-8c81-74f7385d5ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:24.502862 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c455f-dfb3-486a-8c81-74f7385d5ad6 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:24.503049 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c455f-dfb3-486a-8c81-74f7385d5ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:24.503317 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c455f-dfb3-486a-8c81-74f7385d5ad6 admin admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:24.504043 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c455f-dfb3-486a-8c81-74f7385d5ad6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:24.506183 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c455f-dfb3-486a-8c81-74f7385d5ad6 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:24.529363 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1351/2700] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:47:24 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 17:47:24.533457 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b95a80-6562-42c2-84cb-f1e5e8a8e501 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:24.543985 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b95a80-6562-42c2-84cb-f1e5e8a8e501 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:24.548738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736090a-7d94-42f5-b2ba-22bae0e7df1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:24.549475 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736090a-7d94-42f5-b2ba-22bae0e7df1b admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:24.550118 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736090a-7d94-42f5-b2ba-22bae0e7df1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:24.550118 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736090a-7d94-42f5-b2ba-22bae0e7df1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:24.550947 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6736090a-7d94-42f5-b2ba-22bae0e7df1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:24.552610 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6736090a-7d94-42f5-b2ba-22bae0e7df1b admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:24.564266 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1350/2701] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:47:24.568347 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c455f-dfb3-486a-8c81-74f7385d5ad6 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:24.579228 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c455f-dfb3-486a-8c81-74f7385d5ad6 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:24.584119 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ecb27-ee7d-4375-933f-016556352313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:24.584798 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ecb27-ee7d-4375-933f-016556352313 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:24.585077 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ecb27-ee7d-4375-933f-016556352313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:24.585376 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ecb27-ee7d-4375-933f-016556352313 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:24.586139 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ecb27-ee7d-4375-933f-016556352313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:24.587750 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ecb27-ee7d-4375-933f-016556352313 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:24.602560 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1352/2702] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 17:47:24.604259 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736090a-7d94-42f5-b2ba-22bae0e7df1b admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:24.617196 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736090a-7d94-42f5-b2ba-22bae0e7df1b admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:24.622295 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626ca4a-0b80-4936-8376-fc0d8ed26e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:24.623221 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626ca4a-0b80-4936-8376-fc0d8ed26e90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:24.623497 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626ca4a-0b80-4936-8376-fc0d8ed26e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:24.623766 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626ca4a-0b80-4936-8376-fc0d8ed26e90 admin admin] PATH_INFO: `/v3/projects/41621cf354da46679e7933d5c0eed397/users/95f32eacb6cd4282967ce8b928150354/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:24.639114 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1626ca4a-0b80-4936-8376-fc0d8ed26e90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41621cf354da46679e7933d5c0eed397, user_id=95f32eacb6cd4282967ce8b928150354, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:24.641840 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1626ca4a-0b80-4936-8376-fc0d8ed26e90 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:24.657028 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1351/2703] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:47:24 2022] PUT /identity/v3/projects/41621cf354da46679e7933d5c0eed397/users/95f32eacb6cd4282967ce8b928150354/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:47:24.667847 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aca22d-4e50-4ea3-91cb-eca31de9063e None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:24.668136 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aca22d-4e50-4ea3-91cb-eca31de9063e None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:24.671214 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aca22d-4e50-4ea3-91cb-eca31de9063e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:24.698179 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-d8aca22d-4e50-4ea3-91cb-eca31de9063e None None] MFA Rules not processed for user `95f32eacb6cd4282967ce8b928150354`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:47:24.699479 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-d8aca22d-4e50-4ea3-91cb-eca31de9063e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:24.776646 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1353/2704] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:47:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:47:24.788521 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626ca4a-0b80-4936-8376-fc0d8ed26e90 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:24.790530 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1626ca4a-0b80-4936-8376-fc0d8ed26e90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:24.851032 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626ca4a-0b80-4936-8376-fc0d8ed26e90 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:24.854691 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810937f-580c-42ca-a8db-6b12d3b5d17a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:24.855344 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810937f-580c-42ca-a8db-6b12d3b5d17a service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:24.855627 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810937f-580c-42ca-a8db-6b12d3b5d17a service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:24.855901 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810937f-580c-42ca-a8db-6b12d3b5d17a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:24.867248 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6810937f-580c-42ca-a8db-6b12d3b5d17a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:24.868698 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6810937f-580c-42ca-a8db-6b12d3b5d17a service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:24.878466 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1352/2705] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:47:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:47:27.115961 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aca22d-4e50-4ea3-91cb-eca31de9063e None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:27.117383 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-d8aca22d-4e50-4ea3-91cb-eca31de9063e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:27.177203 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aca22d-4e50-4ea3-91cb-eca31de9063e None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:27.181633 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f22a6-9518-4037-a3a6-1cf5de70399d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:27.182534 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f22a6-9518-4037-a3a6-1cf5de70399d service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:27.183196 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f22a6-9518-4037-a3a6-1cf5de70399d service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:27.183475 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f22a6-9518-4037-a3a6-1cf5de70399d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:27.185697 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-7d1f22a6-9518-4037-a3a6-1cf5de70399d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:27.253892 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1f22a6-9518-4037-a3a6-1cf5de70399d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:27.255358 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1f22a6-9518-4037-a3a6-1cf5de70399d service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:27.266097 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1354/2706] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:47:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:47:27.451196 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810937f-580c-42ca-a8db-6b12d3b5d17a service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:27.462959 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810937f-580c-42ca-a8db-6b12d3b5d17a service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:27.469433 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf43e5-9013-4e8e-832e-f85095c21b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:27.470480 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf43e5-9013-4e8e-832e-f85095c21b40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:27.470807 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf43e5-9013-4e8e-832e-f85095c21b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:27.471060 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf43e5-9013-4e8e-832e-f85095c21b40 admin admin] PATH_INFO: `/v3/users/95f32eacb6cd4282967ce8b928150354` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:27.472394 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bf43e5-9013-4e8e-832e-f85095c21b40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95f32eacb6cd4282967ce8b928150354)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:27.474371 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bf43e5-9013-4e8e-832e-f85095c21b40 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:27.525246 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-49bf43e5-9013-4e8e-832e-f85095c21b40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95f32eacb6cd4282967ce8b928150354'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:27.526001 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-49bf43e5-9013-4e8e-832e-f85095c21b40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95f32eacb6cd4282967ce8b928150354'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:27.528069 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:27.534902 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-49bf43e5-9013-4e8e-832e-f85095c21b40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95f32eacb6cd4282967ce8b928150354'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:27.552036 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-49bf43e5-9013-4e8e-832e-f85095c21b40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95f32eacb6cd4282967ce8b928150354'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:27.562993 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-49bf43e5-9013-4e8e-832e-f85095c21b40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95f32eacb6cd4282967ce8b928150354'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:27.570638 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1353/2707] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:47:27 2022] DELETE /identity/v3/users/95f32eacb6cd4282967ce8b928150354 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:47:27.575491 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaca4f4-2d47-4a56-bff3-5bbb5159148e None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:27.575856 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaca4f4-2d47-4a56-bff3-5bbb5159148e None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:27.576205 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaca4f4-2d47-4a56-bff3-5bbb5159148e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:27.582198 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:27.596589 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-4eaca4f4-2d47-4a56-bff3-5bbb5159148e None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:47:27.597911 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-4eaca4f4-2d47-4a56-bff3-5bbb5159148e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:27.661081 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1355/2708] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:47:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:47:27.671489 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf43e5-9013-4e8e-832e-f85095c21b40 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:27.673136 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-49bf43e5-9013-4e8e-832e-f85095c21b40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:27.731973 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf43e5-9013-4e8e-832e-f85095c21b40 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:27.735676 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f1dc6-8049-4f21-8c6b-8418d50088fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:27.736325 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f1dc6-8049-4f21-8c6b-8418d50088fd service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:27.736603 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f1dc6-8049-4f21-8c6b-8418d50088fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:27.736872 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f1dc6-8049-4f21-8c6b-8418d50088fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:27.746432 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f1dc6-8049-4f21-8c6b-8418d50088fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:27.747861 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f1dc6-8049-4f21-8c6b-8418d50088fd service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:27.757650 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1354/2709] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:47:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:47:28.093145 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaca4f4-2d47-4a56-bff3-5bbb5159148e None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:28.094766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-4eaca4f4-2d47-4a56-bff3-5bbb5159148e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:28.106992 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaca4f4-2d47-4a56-bff3-5bbb5159148e None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:28.111827 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e18689-adb1-4c01-8ad6-55a545ef6cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:28.112875 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e18689-adb1-4c01-8ad6-55a545ef6cba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:28.113253 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e18689-adb1-4c01-8ad6-55a545ef6cba admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:28.113617 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e18689-adb1-4c01-8ad6-55a545ef6cba admin admin] PATH_INFO: `/v3/projects/41621cf354da46679e7933d5c0eed397` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:28.115248 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e18689-adb1-4c01-8ad6-55a545ef6cba admin admin] RBAC: Authorizing `identity:delete_project(project_id=41621cf354da46679e7933d5c0eed397)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:28.117366 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e18689-adb1-4c01-8ad6-55a545ef6cba admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:28.173177 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-a5e18689-adb1-4c01-8ad6-55a545ef6cba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41621cf354da46679e7933d5c0eed397', 'request_id': 'req-a5e18689-adb1-4c01-8ad6-55a545ef6cba'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:28.183982 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-a5e18689-adb1-4c01-8ad6-55a545ef6cba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41621cf354da46679e7933d5c0eed397', 'request_id': 'req-a5e18689-adb1-4c01-8ad6-55a545ef6cba'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:28.191204 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-a5e18689-adb1-4c01-8ad6-55a545ef6cba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41621cf354da46679e7933d5c0eed397', 'request_id': 'req-a5e18689-adb1-4c01-8ad6-55a545ef6cba'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:28.203178 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-a5e18689-adb1-4c01-8ad6-55a545ef6cba admin admin] The token cache is being invalidate because project 41621cf354da46679e7933d5c0eed397 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80150) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:47:28.203464 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-a5e18689-adb1-4c01-8ad6-55a545ef6cba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:28.204105 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-a5e18689-adb1-4c01-8ad6-55a545ef6cba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:28.205664 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1356/2710] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:47:28 2022] DELETE /identity/v3/projects/41621cf354da46679e7933d5c0eed397 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:47:28.210851 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2b87f-7b3b-4b2a-b167-3ca6f3767f3a None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:28.211286 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2b87f-7b3b-4b2a-b167-3ca6f3767f3a None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:28.211656 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2b87f-7b3b-4b2a-b167-3ca6f3767f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:28.234432 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-b1f2b87f-7b3b-4b2a-b167-3ca6f3767f3a None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:47:28.235538 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b1f2b87f-7b3b-4b2a-b167-3ca6f3767f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:28.318127 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1355/2711] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:47:28.327354 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5a03d-3f2e-4c39-b69e-6b5ac1ac7ed9 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:28.330081 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5a03d-3f2e-4c39-b69e-6b5ac1ac7ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:28.330487 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5a03d-3f2e-4c39-b69e-6b5ac1ac7ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:28.352764 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-dfd5a03d-3f2e-4c39-b69e-6b5ac1ac7ed9 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:47:28.355215 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-dfd5a03d-3f2e-4c39-b69e-6b5ac1ac7ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:28.364283 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1357/2712] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:47:28.368586 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f2b87f-7b3b-4b2a-b167-3ca6f3767f3a None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:28.378873 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f2b87f-7b3b-4b2a-b167-3ca6f3767f3a None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:28.383679 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292473cf-12df-4747-9d27-3c1ce00b0a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:28.384360 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292473cf-12df-4747-9d27-3c1ce00b0a09 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:28.384643 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292473cf-12df-4747-9d27-3c1ce00b0a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:28.385052 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292473cf-12df-4747-9d27-3c1ce00b0a09 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:28.385911 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292473cf-12df-4747-9d27-3c1ce00b0a09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:47:28.386221 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292473cf-12df-4747-9d27-3c1ce00b0a09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:28.387836 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292473cf-12df-4747-9d27-3c1ce00b0a09 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:28.402007 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1356/2713] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:47:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:47:28.405812 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5a03d-3f2e-4c39-b69e-6b5ac1ac7ed9 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:28.415298 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5a03d-3f2e-4c39-b69e-6b5ac1ac7ed9 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:28.419996 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455533a9-598e-4a04-92e5-9eb371ec2d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:28.420659 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455533a9-598e-4a04-92e5-9eb371ec2d88 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:28.420936 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455533a9-598e-4a04-92e5-9eb371ec2d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:28.421207 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455533a9-598e-4a04-92e5-9eb371ec2d88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:28.421954 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455533a9-598e-4a04-92e5-9eb371ec2d88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:28.423931 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455533a9-598e-4a04-92e5-9eb371ec2d88 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:28.455108 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1358/2714] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:47:28 2022] POST /identity/v3/projects => generated 395 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:47:28.456230 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292473cf-12df-4747-9d27-3c1ce00b0a09 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:28.467722 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292473cf-12df-4747-9d27-3c1ce00b0a09 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:28.534516 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:28.542662 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c658e-858d-4325-b6b3-ee2e4dcb40b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:28.543553 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c658e-858d-4325-b6b3-ee2e4dcb40b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:28.543913 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c658e-858d-4325-b6b3-ee2e4dcb40b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:28.544732 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c658e-858d-4325-b6b3-ee2e4dcb40b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:28.546372 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c658e-858d-4325-b6b3-ee2e4dcb40b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:28.548494 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c658e-858d-4325-b6b3-ee2e4dcb40b2 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:28.571990 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1357/2715] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:47:28 2022] POST /identity/v3/users => generated 298 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 17:47:28.576606 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455533a9-598e-4a04-92e5-9eb371ec2d88 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:28.587607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455533a9-598e-4a04-92e5-9eb371ec2d88 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:28.593658 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa36c0-c6fd-4876-9336-3d01aeaa1570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:28.594310 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa36c0-c6fd-4876-9336-3d01aeaa1570 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:28.594590 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa36c0-c6fd-4876-9336-3d01aeaa1570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:28.594864 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa36c0-c6fd-4876-9336-3d01aeaa1570 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:28.595590 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfa36c0-c6fd-4876-9336-3d01aeaa1570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:28.597212 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfa36c0-c6fd-4876-9336-3d01aeaa1570 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:28.608569 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1359/2716] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:47:28.612697 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c658e-858d-4325-b6b3-ee2e4dcb40b2 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:28.623076 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c658e-858d-4325-b6b3-ee2e4dcb40b2 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:28.627784 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e93f8-801d-4c1a-9d13-4f2989828290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:28.628500 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e93f8-801d-4c1a-9d13-4f2989828290 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:28.628779 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e93f8-801d-4c1a-9d13-4f2989828290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:28.629048 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e93f8-801d-4c1a-9d13-4f2989828290 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:28.629796 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e93f8-801d-4c1a-9d13-4f2989828290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:28.631429 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e93f8-801d-4c1a-9d13-4f2989828290 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:28.645022 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1358/2717] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:47:28.646398 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa36c0-c6fd-4876-9336-3d01aeaa1570 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:28.657605 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa36c0-c6fd-4876-9336-3d01aeaa1570 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:28.663007 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4582e-2044-4062-bf2d-24c0903b8715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:28.664109 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4582e-2044-4062-bf2d-24c0903b8715 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:28.664464 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4582e-2044-4062-bf2d-24c0903b8715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:28.665370 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4582e-2044-4062-bf2d-24c0903b8715 admin admin] PATH_INFO: `/v3/projects/bdb808d1aa434bcc8acea91b7a806ae0/users/828b91dd3aa04f76a821b584368b851d/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:28.681029 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa4582e-2044-4062-bf2d-24c0903b8715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdb808d1aa434bcc8acea91b7a806ae0, user_id=828b91dd3aa04f76a821b584368b851d, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:28.683868 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa4582e-2044-4062-bf2d-24c0903b8715 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:28.699210 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1360/2718] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:47:28 2022] PUT /identity/v3/projects/bdb808d1aa434bcc8acea91b7a806ae0/users/828b91dd3aa04f76a821b584368b851d/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:47:28.709876 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74263b66-8266-4dc2-b7e8-24dedcf613b6 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:28.710171 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74263b66-8266-4dc2-b7e8-24dedcf613b6 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:28.710716 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74263b66-8266-4dc2-b7e8-24dedcf613b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:28.739113 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-74263b66-8266-4dc2-b7e8-24dedcf613b6 None None] MFA Rules not processed for user `828b91dd3aa04f76a821b584368b851d`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:47:28.740337 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-74263b66-8266-4dc2-b7e8-24dedcf613b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:28.812677 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1359/2719] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:47:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:47:28.825286 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4582e-2044-4062-bf2d-24c0903b8715 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:28.827305 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-baa4582e-2044-4062-bf2d-24c0903b8715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:28.855477 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:28.891554 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4582e-2044-4062-bf2d-24c0903b8715 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:28.895343 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ecacba-79cf-41cc-a042-f2e10a3b40bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:28.896007 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecacba-79cf-41cc-a042-f2e10a3b40bc service cinder] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:28.896289 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecacba-79cf-41cc-a042-f2e10a3b40bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:28.896562 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecacba-79cf-41cc-a042-f2e10a3b40bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:28.906691 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ecacba-79cf-41cc-a042-f2e10a3b40bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:28.908153 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ecacba-79cf-41cc-a042-f2e10a3b40bc service cinder] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:28.919129 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1361/2720] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:47:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 17:47:30.706141 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f089079-e98e-493c-8f10-654b03f2aa8e None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:30.706636 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f089079-e98e-493c-8f10-654b03f2aa8e None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:30.706738 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f089079-e98e-493c-8f10-654b03f2aa8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:30.727491 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-1f089079-e98e-493c-8f10-654b03f2aa8e None None] MFA Rules not processed for user `b73d09bd7c1e4753a45cfdb00cc5abe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:47:30.729454 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1f089079-e98e-493c-8f10-654b03f2aa8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:30.816118 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1360/2721] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Jul 15 17:47:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:47:30.884578 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ecacba-79cf-41cc-a042-f2e10a3b40bc service cinder] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:30.886286 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-51ecacba-79cf-41cc-a042-f2e10a3b40bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:31.001724 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ecacba-79cf-41cc-a042-f2e10a3b40bc service cinder] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:31.007010 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbedc0b-2058-4dda-b878-cd3fdcb4e760 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dea565b75784465a8ea073883261d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:31.007780 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbedc0b-2058-4dda-b878-cd3fdcb4e760 service swift] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:31.008065 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbedc0b-2058-4dda-b878-cd3fdcb4e760 service swift] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:31.008339 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbedc0b-2058-4dda-b878-cd3fdcb4e760 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:31.019723 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbedc0b-2058-4dda-b878-cd3fdcb4e760 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:31.021366 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbedc0b-2058-4dda-b878-cd3fdcb4e760 service swift] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:31.033929 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1362/2722] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Jul 15 17:47:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 17:47:31.435762 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f089079-e98e-493c-8f10-654b03f2aa8e None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:31.437278 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1f089079-e98e-493c-8f10-654b03f2aa8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:31.511974 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f089079-e98e-493c-8f10-654b03f2aa8e None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:31.516547 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a718a-1163-4d73-a956-b57e54559d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:31.517764 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a718a-1163-4d73-a956-b57e54559d19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:31.518212 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a718a-1163-4d73-a956-b57e54559d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:31.518491 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a718a-1163-4d73-a956-b57e54559d19 admin admin] PATH_INFO: `/v3/users/0f7c910cba2b48b393805fcc4df8884a` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:31.519848 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a718a-1163-4d73-a956-b57e54559d19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f7c910cba2b48b393805fcc4df8884a)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:31.521773 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a718a-1163-4d73-a956-b57e54559d19 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:31.536534 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:31.583461 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7e1a718a-1163-4d73-a956-b57e54559d19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f7c910cba2b48b393805fcc4df8884a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:31.584236 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7e1a718a-1163-4d73-a956-b57e54559d19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f7c910cba2b48b393805fcc4df8884a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:31.593674 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7e1a718a-1163-4d73-a956-b57e54559d19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f7c910cba2b48b393805fcc4df8884a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:31.606038 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7e1a718a-1163-4d73-a956-b57e54559d19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f7c910cba2b48b393805fcc4df8884a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:31.614603 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-7e1a718a-1163-4d73-a956-b57e54559d19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f7c910cba2b48b393805fcc4df8884a'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:31.621739 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1361/2723] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:47:31 2022] DELETE /identity/v3/users/0f7c910cba2b48b393805fcc4df8884a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:47:31.692316 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685aedf8-eb75-4a1b-965c-9ad9a0939084 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:31.692646 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685aedf8-eb75-4a1b-965c-9ad9a0939084 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:31.692911 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685aedf8-eb75-4a1b-965c-9ad9a0939084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:31.711654 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-685aedf8-eb75-4a1b-965c-9ad9a0939084 None None] MFA Rules not processed for user `b73d09bd7c1e4753a45cfdb00cc5abe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:47:31.712877 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-685aedf8-eb75-4a1b-965c-9ad9a0939084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:31.769503 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1363/2724] 10.222.0.27 () {58 vars in 967 bytes} [Fri Jul 15 17:47:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:47:31.782664 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a718a-1163-4d73-a956-b57e54559d19 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:31.784360 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-7e1a718a-1163-4d73-a956-b57e54559d19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:31.815743 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685aedf8-eb75-4a1b-965c-9ad9a0939084 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:31.819836 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-685aedf8-eb75-4a1b-965c-9ad9a0939084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:31.876714 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a718a-1163-4d73-a956-b57e54559d19 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:31.882858 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5faf3f-0eea-4340-b1d6-272c44a2052c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dea565b75784465a8ea073883261d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:31.883523 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5faf3f-0eea-4340-b1d6-272c44a2052c service swift] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:31.883806 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5faf3f-0eea-4340-b1d6-272c44a2052c service swift] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:31.884088 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5faf3f-0eea-4340-b1d6-272c44a2052c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:31.893185 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5faf3f-0eea-4340-b1d6-272c44a2052c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:31.894879 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5faf3f-0eea-4340-b1d6-272c44a2052c service swift] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:31.901382 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685aedf8-eb75-4a1b-965c-9ad9a0939084 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:31.906426 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c7b35-7d42-4f89-9f92-2131046afb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:31.907156 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c7b35-7d42-4f89-9f92-2131046afb02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:31.907430 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c7b35-7d42-4f89-9f92-2131046afb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:31.907666 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c7b35-7d42-4f89-9f92-2131046afb02 admin admin] PATH_INFO: `/v3/projects/9c8bc85659564a3499f69383d238c3f7` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:31.909059 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471c7b35-7d42-4f89-9f92-2131046afb02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c8bc85659564a3499f69383d238c3f7)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:31.909958 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1362/2725] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Jul 15 17:47:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 17:47:31.911175 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471c7b35-7d42-4f89-9f92-2131046afb02 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:31.913913 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:31.981652 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-471c7b35-7d42-4f89-9f92-2131046afb02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c8bc85659564a3499f69383d238c3f7', 'request_id': 'req-471c7b35-7d42-4f89-9f92-2131046afb02'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:31.991414 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-471c7b35-7d42-4f89-9f92-2131046afb02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c8bc85659564a3499f69383d238c3f7', 'request_id': 'req-471c7b35-7d42-4f89-9f92-2131046afb02'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:32.000743 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-471c7b35-7d42-4f89-9f92-2131046afb02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c8bc85659564a3499f69383d238c3f7', 'request_id': 'req-471c7b35-7d42-4f89-9f92-2131046afb02'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:32.014861 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-471c7b35-7d42-4f89-9f92-2131046afb02 admin admin] The token cache is being invalidate because project 9c8bc85659564a3499f69383d238c3f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80150) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:47:32.015121 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-471c7b35-7d42-4f89-9f92-2131046afb02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:32.015751 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-471c7b35-7d42-4f89-9f92-2131046afb02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:32.018091 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1364/2726] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:47:31 2022] DELETE /identity/v3/projects/9c8bc85659564a3499f69383d238c3f7 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:47:32.028683 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5128d4-1410-4eda-965a-5a75d1a6a112 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:32.028982 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5128d4-1410-4eda-965a-5a75d1a6a112 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:32.029159 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5128d4-1410-4eda-965a-5a75d1a6a112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:32.047965 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-9b5128d4-1410-4eda-965a-5a75d1a6a112 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:47:32.049325 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-9b5128d4-1410-4eda-965a-5a75d1a6a112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:32.111708 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1363/2727] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:47:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:47:32.119768 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972431a-ed47-4f49-bd39-887c5f33eec0 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:32.120221 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972431a-ed47-4f49-bd39-887c5f33eec0 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:32.120317 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972431a-ed47-4f49-bd39-887c5f33eec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:32.127645 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e6690-749b-4ee9-8669-fe7bbf3de5da None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:32.128028 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e6690-749b-4ee9-8669-fe7bbf3de5da None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:32.128374 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e6690-749b-4ee9-8669-fe7bbf3de5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:32.139098 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-3972431a-ed47-4f49-bd39-887c5f33eec0 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:47:32.140277 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-3972431a-ed47-4f49-bd39-887c5f33eec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:32.146833 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-5b9e6690-749b-4ee9-8669-fe7bbf3de5da None None] MFA Rules not processed for user `b73d09bd7c1e4753a45cfdb00cc5abe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:47:32.148035 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5b9e6690-749b-4ee9-8669-fe7bbf3de5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:32.148206 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1365/2728] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:47:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:47:32.152674 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3972431a-ed47-4f49-bd39-887c5f33eec0 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:32.161502 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:32.162495 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3972431a-ed47-4f49-bd39-887c5f33eec0 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:32.167342 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d1fb6-6c26-411d-a86c-ca9c3c886c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:32.168199 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d1fb6-6c26-411d-a86c-ca9c3c886c8e admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:32.168612 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d1fb6-6c26-411d-a86c-ca9c3c886c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:32.168903 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d1fb6-6c26-411d-a86c-ca9c3c886c8e admin admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:32.169628 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d1fb6-6c26-411d-a86c-ca9c3c886c8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:47:32.169994 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d1fb6-6c26-411d-a86c-ca9c3c886c8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:32.171813 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d1fb6-6c26-411d-a86c-ca9c3c886c8e admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:32.184791 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1366/2729] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:47:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:47:32.189636 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d1fb6-6c26-411d-a86c-ca9c3c886c8e admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:32.199541 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d1fb6-6c26-411d-a86c-ca9c3c886c8e admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:32.204156 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa706a09-0712-4523-8cdf-5c20f39e5c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:32.204840 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa706a09-0712-4523-8cdf-5c20f39e5c6b admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:32.205118 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa706a09-0712-4523-8cdf-5c20f39e5c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:32.205483 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa706a09-0712-4523-8cdf-5c20f39e5c6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:32.206248 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa706a09-0712-4523-8cdf-5c20f39e5c6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:32.208392 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa706a09-0712-4523-8cdf-5c20f39e5c6b admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:32.209466 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1364/2730] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Jul 15 17:47:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:47:32.222956 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e6690-749b-4ee9-8669-fe7bbf3de5da None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:32.224495 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5b9e6690-749b-4ee9-8669-fe7bbf3de5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:32.237845 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1367/2731] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:47:32 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 17:47:32.241894 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa706a09-0712-4523-8cdf-5c20f39e5c6b admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:32.297141 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e6690-749b-4ee9-8669-fe7bbf3de5da None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:32.304139 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa706a09-0712-4523-8cdf-5c20f39e5c6b admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:32.309109 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46515c64-987d-4ec5-a34b-24bbd5b163a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:32.309892 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46515c64-987d-4ec5-a34b-24bbd5b163a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:32.310284 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46515c64-987d-4ec5-a34b-24bbd5b163a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:32.310565 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46515c64-987d-4ec5-a34b-24bbd5b163a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:32.311254 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46515c64-987d-4ec5-a34b-24bbd5b163a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:32.313202 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46515c64-987d-4ec5-a34b-24bbd5b163a3 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:32.335738 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1368/2732] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:47:32 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 17:47:32.339958 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46515c64-987d-4ec5-a34b-24bbd5b163a3 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:32.349702 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46515c64-987d-4ec5-a34b-24bbd5b163a3 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:32.354411 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ce4c9-035c-4c18-84ec-a64a16b27b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:32.355133 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ce4c9-035c-4c18-84ec-a64a16b27b79 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:32.355490 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ce4c9-035c-4c18-84ec-a64a16b27b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:32.355834 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ce4c9-035c-4c18-84ec-a64a16b27b79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:32.356588 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ce4c9-035c-4c18-84ec-a64a16b27b79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:32.358213 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ce4c9-035c-4c18-84ec-a64a16b27b79 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:32.360449 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d0321-58d1-4b3e-a6d1-308bcacba918 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dea565b75784465a8ea073883261d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:32.361188 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d0321-58d1-4b3e-a6d1-308bcacba918 service swift] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:32.361541 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d0321-58d1-4b3e-a6d1-308bcacba918 service swift] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:32.361920 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d0321-58d1-4b3e-a6d1-308bcacba918 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:32.371342 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1369/2733] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 17:47:32.372789 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ce4c9-035c-4c18-84ec-a64a16b27b79 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:32.382435 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ce4c9-035c-4c18-84ec-a64a16b27b79 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:32.387578 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a425eac-c426-4879-81ba-5d60fe64a597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:32.388304 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a425eac-c426-4879-81ba-5d60fe64a597 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:32.388581 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a425eac-c426-4879-81ba-5d60fe64a597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:32.388857 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a425eac-c426-4879-81ba-5d60fe64a597 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:32.389575 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a425eac-c426-4879-81ba-5d60fe64a597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:32.391241 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a425eac-c426-4879-81ba-5d60fe64a597 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:32.402847 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1370/2734] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 17:47:32.407024 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a425eac-c426-4879-81ba-5d60fe64a597 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:32.418767 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a425eac-c426-4879-81ba-5d60fe64a597 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:32.424845 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9afdce-b7ca-4a84-9078-62a736a7ec78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:32.425841 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9afdce-b7ca-4a84-9078-62a736a7ec78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:32.426138 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9afdce-b7ca-4a84-9078-62a736a7ec78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:32.426379 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094d0321-58d1-4b3e-a6d1-308bcacba918 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:32.426537 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9afdce-b7ca-4a84-9078-62a736a7ec78 admin admin] PATH_INFO: `/v3/projects/47165c1916c24035ab8fb2c112107ec4/users/9d065c34890a4be7ab44a2552300f59b/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:32.428160 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094d0321-58d1-4b3e-a6d1-308bcacba918 service swift] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:32.437062 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1365/2735] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Jul 15 17:47:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 15 17:47:32.441360 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:32.445483 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9afdce-b7ca-4a84-9078-62a736a7ec78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47165c1916c24035ab8fb2c112107ec4, user_id=9d065c34890a4be7ab44a2552300f59b, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:32.450388 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9afdce-b7ca-4a84-9078-62a736a7ec78 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:32.476798 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1371/2736] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:47:32 2022] PUT /identity/v3/projects/47165c1916c24035ab8fb2c112107ec4/users/9d065c34890a4be7ab44a2552300f59b/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:47:32.489632 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26c500-7626-4f03-ab0f-e869e43fd0cd None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:32.489959 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26c500-7626-4f03-ab0f-e869e43fd0cd None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:32.490242 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26c500-7626-4f03-ab0f-e869e43fd0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:32.513430 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:32.525166 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-dc26c500-7626-4f03-ab0f-e869e43fd0cd None None] MFA Rules not processed for user `9d065c34890a4be7ab44a2552300f59b`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:47:32.526503 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-dc26c500-7626-4f03-ab0f-e869e43fd0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:32.606945 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1366/2737] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:47:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:47:32.611342 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9afdce-b7ca-4a84-9078-62a736a7ec78 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:32.684105 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9afdce-b7ca-4a84-9078-62a736a7ec78 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:32.689954 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6165335-98f1-403a-b339-99ae7486bdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:32.690698 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6165335-98f1-403a-b339-99ae7486bdc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:32.691052 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6165335-98f1-403a-b339-99ae7486bdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:32.691400 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6165335-98f1-403a-b339-99ae7486bdc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:32.692144 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6165335-98f1-403a-b339-99ae7486bdc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:32.694533 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6165335-98f1-403a-b339-99ae7486bdc7 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:32.725113 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1372/2738] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:47:32 2022] POST /identity/v3/projects => generated 371 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:47:32.726440 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26c500-7626-4f03-ab0f-e869e43fd0cd None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:32.737963 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26c500-7626-4f03-ab0f-e869e43fd0cd None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:32.799789 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb24359-da4a-4561-bbb5-6bdfd4e5d93c None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:32.799943 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a48635-475c-4451-a73f-3a426ac12718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:32.800412 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb24359-da4a-4561-bbb5-6bdfd4e5d93c None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:32.800412 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb24359-da4a-4561-bbb5-6bdfd4e5d93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:32.800590 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a48635-475c-4451-a73f-3a426ac12718 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:32.800785 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a48635-475c-4451-a73f-3a426ac12718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:32.801060 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a48635-475c-4451-a73f-3a426ac12718 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:32.801813 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a48635-475c-4451-a73f-3a426ac12718 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:32.803731 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a48635-475c-4451-a73f-3a426ac12718 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:32.819427 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-1fb24359-da4a-4561-bbb5-6bdfd4e5d93c None None] MFA Rules not processed for user `b73d09bd7c1e4753a45cfdb00cc5abe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:47:32.820678 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-1fb24359-da4a-4561-bbb5-6bdfd4e5d93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:32.825084 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1367/2739] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:47:32 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:47:32.828972 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a48635-475c-4451-a73f-3a426ac12718 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:32.838629 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a48635-475c-4451-a73f-3a426ac12718 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:32.843227 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068a44c-c373-4133-917d-c28d1f3bae15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:32.843882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068a44c-c373-4133-917d-c28d1f3bae15 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:32.844181 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068a44c-c373-4133-917d-c28d1f3bae15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:32.844471 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068a44c-c373-4133-917d-c28d1f3bae15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:32.845189 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d068a44c-c373-4133-917d-c28d1f3bae15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:32.846769 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d068a44c-c373-4133-917d-c28d1f3bae15 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:32.856939 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1368/2740] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 17:47:32.860999 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068a44c-c373-4133-917d-c28d1f3bae15 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:32.871048 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068a44c-c373-4133-917d-c28d1f3bae15 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:32.876077 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a643b8-5848-4142-89b2-568d978877eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:32.876959 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a643b8-5848-4142-89b2-568d978877eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:32.877242 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a643b8-5848-4142-89b2-568d978877eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:32.877520 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a643b8-5848-4142-89b2-568d978877eb admin admin] PATH_INFO: `/v3/projects/97c391d4a65f4cbfae50fd692d4724fa/users/a23355afaaf2408fa212b8f6421f746d/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:32.884827 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1373/2741] 10.222.0.27 () {58 vars in 967 bytes} [Fri Jul 15 17:47:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:47:32.892898 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a643b8-5848-4142-89b2-568d978877eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=97c391d4a65f4cbfae50fd692d4724fa, user_id=a23355afaaf2408fa212b8f6421f746d, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:32.895568 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a643b8-5848-4142-89b2-568d978877eb admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:32.898036 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb24359-da4a-4561-bbb5-6bdfd4e5d93c None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:32.913185 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1369/2742] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:47:32 2022] PUT /identity/v3/projects/97c391d4a65f4cbfae50fd692d4724fa/users/a23355afaaf2408fa212b8f6421f746d/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:47:32.917235 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a643b8-5848-4142-89b2-568d978877eb admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:32.971455 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb24359-da4a-4561-bbb5-6bdfd4e5d93c None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:32.978571 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:32.987272 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a643b8-5848-4142-89b2-568d978877eb admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:32.992776 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae53e2f5-865f-4bf4-ae89-b8c7dccc405a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:32.993614 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53e2f5-865f-4bf4-ae89-b8c7dccc405a admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:32.994084 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53e2f5-865f-4bf4-ae89-b8c7dccc405a admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:32.994420 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53e2f5-865f-4bf4-ae89-b8c7dccc405a admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:32.995424 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae53e2f5-865f-4bf4-ae89-b8c7dccc405a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:32.997067 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae53e2f5-865f-4bf4-ae89-b8c7dccc405a admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:32.997692 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:33.007624 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1370/2743] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 17:47:33.012014 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae53e2f5-865f-4bf4-ae89-b8c7dccc405a admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:33.021810 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae53e2f5-865f-4bf4-ae89-b8c7dccc405a admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:33.028933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b35dd-9faf-4450-b021-4c23b6a79382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:33.028933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b35dd-9faf-4450-b021-4c23b6a79382 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:33.028933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b35dd-9faf-4450-b021-4c23b6a79382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:33.029281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b35dd-9faf-4450-b021-4c23b6a79382 admin admin] PATH_INFO: `/v3/projects/97c391d4a65f4cbfae50fd692d4724fa/users/a23355afaaf2408fa212b8f6421f746d/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:33.031146 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8b35dd-9faf-4450-b021-4c23b6a79382 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97c391d4a65f4cbfae50fd692d4724fa, user_id=a23355afaaf2408fa212b8f6421f746d, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:33.033865 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8b35dd-9faf-4450-b021-4c23b6a79382 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:33.044203 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e0038-d3b8-4e6a-ba5a-4e7bb8f322fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dea565b75784465a8ea073883261d7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:33.044936 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e0038-d3b8-4e6a-ba5a-4e7bb8f322fa service swift] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:33.045217 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e0038-d3b8-4e6a-ba5a-4e7bb8f322fa service swift] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:33.045612 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e0038-d3b8-4e6a-ba5a-4e7bb8f322fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:33.049343 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1371/2744] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:47:33 2022] PUT /identity/v3/projects/97c391d4a65f4cbfae50fd692d4724fa/users/a23355afaaf2408fa212b8f6421f746d/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:47:33.056906 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e0032-fac2-4275-8fbe-3648fc9599ab None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:33.057272 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e0032-fac2-4275-8fbe-3648fc9599ab None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:33.057601 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e0032-fac2-4275-8fbe-3648fc9599ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:33.085524 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-039e0032-fac2-4275-8fbe-3648fc9599ab None None] MFA Rules not processed for user `a23355afaaf2408fa212b8f6421f746d`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:47:33.086794 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-039e0032-fac2-4275-8fbe-3648fc9599ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:33.118478 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e0038-d3b8-4e6a-ba5a-4e7bb8f322fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:33.120512 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e0038-d3b8-4e6a-ba5a-4e7bb8f322fa service swift] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:33.130327 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1374/2745] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Jul 15 17:47:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 17:47:33.169947 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1372/2746] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:47:33 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:47:33.182571 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e0038-d3b8-4e6a-ba5a-4e7bb8f322fa service swift] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:33.184576 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-566e0038-d3b8-4e6a-ba5a-4e7bb8f322fa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:33.253376 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e0038-d3b8-4e6a-ba5a-4e7bb8f322fa service swift] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:33.322030 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90da5d-e15d-4c9d-96c8-37d563a27cbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:33.322847 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90da5d-e15d-4c9d-96c8-37d563a27cbc service cinder] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:33.323119 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90da5d-e15d-4c9d-96c8-37d563a27cbc service cinder] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:33.323433 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90da5d-e15d-4c9d-96c8-37d563a27cbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:33.334377 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90da5d-e15d-4c9d-96c8-37d563a27cbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:33.335826 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90da5d-e15d-4c9d-96c8-37d563a27cbc service cinder] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:33.346964 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1375/2747] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:47:33 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:47:33.427099 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e0032-fac2-4275-8fbe-3648fc9599ab None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:33.437126 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e0032-fac2-4275-8fbe-3648fc9599ab None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:33.441093 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e17142-fef7-4171-895a-ba14f7df2d02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:33.441749 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e17142-fef7-4171-895a-ba14f7df2d02 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:33.442059 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e17142-fef7-4171-895a-ba14f7df2d02 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:33.442330 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e17142-fef7-4171-895a-ba14f7df2d02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:33.510490 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e17142-fef7-4171-895a-ba14f7df2d02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:33.512082 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e17142-fef7-4171-895a-ba14f7df2d02 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:33.521360 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1373/2748] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:47:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:47:34.211361 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90da5d-e15d-4c9d-96c8-37d563a27cbc service cinder] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:34.213162 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-9a90da5d-e15d-4c9d-96c8-37d563a27cbc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:34.245344 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=100 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:34.290402 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90da5d-e15d-4c9d-96c8-37d563a27cbc service cinder] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:34.295390 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95623e7-8e0b-4850-9b81-109c7f258ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:34.296274 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95623e7-8e0b-4850-9b81-109c7f258ede admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:34.296549 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95623e7-8e0b-4850-9b81-109c7f258ede admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:34.296815 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95623e7-8e0b-4850-9b81-109c7f258ede admin admin] PATH_INFO: `/v3/users/828b91dd3aa04f76a821b584368b851d` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:34.298075 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95623e7-8e0b-4850-9b81-109c7f258ede admin admin] RBAC: Authorizing `identity:delete_user(user_id=828b91dd3aa04f76a821b584368b851d)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:34.300049 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95623e7-8e0b-4850-9b81-109c7f258ede admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:34.350213 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-f95623e7-8e0b-4850-9b81-109c7f258ede admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '828b91dd3aa04f76a821b584368b851d'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:34.350847 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-f95623e7-8e0b-4850-9b81-109c7f258ede admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '828b91dd3aa04f76a821b584368b851d'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:34.358329 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-f95623e7-8e0b-4850-9b81-109c7f258ede admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '828b91dd3aa04f76a821b584368b851d'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:34.359015 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-f95623e7-8e0b-4850-9b81-109c7f258ede admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '828b91dd3aa04f76a821b584368b851d'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:34.375092 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-f95623e7-8e0b-4850-9b81-109c7f258ede admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '828b91dd3aa04f76a821b584368b851d'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:34.391904 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1376/2749] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:47:34 2022] DELETE /identity/v3/users/828b91dd3aa04f76a821b584368b851d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:47:34.396750 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f6fca-d573-45c6-b83c-c81ce2cef146 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:34.397228 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f6fca-d573-45c6-b83c-c81ce2cef146 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:34.397338 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f6fca-d573-45c6-b83c-c81ce2cef146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:34.417065 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-b24f6fca-d573-45c6-b83c-c81ce2cef146 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:47:34.418330 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b24f6fca-d573-45c6-b83c-c81ce2cef146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:34.470780 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:34.480937 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1374/2750] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:47:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:47:34.490846 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95623e7-8e0b-4850-9b81-109c7f258ede admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:34.492385 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-f95623e7-8e0b-4850-9b81-109c7f258ede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:34.551324 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95623e7-8e0b-4850-9b81-109c7f258ede admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:34.555712 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48300f2d-a312-4930-a1f4-d5ffe589dbe4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:34.556345 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48300f2d-a312-4930-a1f4-d5ffe589dbe4 service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:34.556616 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48300f2d-a312-4930-a1f4-d5ffe589dbe4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:34.556884 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48300f2d-a312-4930-a1f4-d5ffe589dbe4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:34.567400 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48300f2d-a312-4930-a1f4-d5ffe589dbe4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:34.568759 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48300f2d-a312-4930-a1f4-d5ffe589dbe4 service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:34.578571 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1377/2751] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:47:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:47:34.868941 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f6fca-d573-45c6-b83c-c81ce2cef146 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:34.870716 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b24f6fca-d573-45c6-b83c-c81ce2cef146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:34.889156 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f6fca-d573-45c6-b83c-c81ce2cef146 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:34.898855 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a2821-2af6-468f-96a5-4a8eab589386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:34.899856 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a2821-2af6-468f-96a5-4a8eab589386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:34.900214 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a2821-2af6-468f-96a5-4a8eab589386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:34.900488 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a2821-2af6-468f-96a5-4a8eab589386 admin admin] PATH_INFO: `/v3/projects/bdb808d1aa434bcc8acea91b7a806ae0` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:34.901746 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a2821-2af6-468f-96a5-4a8eab589386 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdb808d1aa434bcc8acea91b7a806ae0)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:34.903682 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a2821-2af6-468f-96a5-4a8eab589386 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:34.958213 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-014a2821-2af6-468f-96a5-4a8eab589386 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdb808d1aa434bcc8acea91b7a806ae0', 'request_id': 'req-014a2821-2af6-468f-96a5-4a8eab589386'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:34.967037 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-014a2821-2af6-468f-96a5-4a8eab589386 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdb808d1aa434bcc8acea91b7a806ae0', 'request_id': 'req-014a2821-2af6-468f-96a5-4a8eab589386'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:34.973365 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-014a2821-2af6-468f-96a5-4a8eab589386 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdb808d1aa434bcc8acea91b7a806ae0', 'request_id': 'req-014a2821-2af6-468f-96a5-4a8eab589386'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:34.987443 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-014a2821-2af6-468f-96a5-4a8eab589386 admin admin] The token cache is being invalidate because project bdb808d1aa434bcc8acea91b7a806ae0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:47:34.987962 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-014a2821-2af6-468f-96a5-4a8eab589386 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:34.988582 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-014a2821-2af6-468f-96a5-4a8eab589386 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:34.993027 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1375/2752] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:47:34 2022] DELETE /identity/v3/projects/bdb808d1aa434bcc8acea91b7a806ae0 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:47:34.998459 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24696c85-6858-44f4-95dc-f8bc6a9e9ecb None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:34.998788 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24696c85-6858-44f4-95dc-f8bc6a9e9ecb None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:34.999049 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24696c85-6858-44f4-95dc-f8bc6a9e9ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:35.021806 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-24696c85-6858-44f4-95dc-f8bc6a9e9ecb None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:47:35.023028 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-24696c85-6858-44f4-95dc-f8bc6a9e9ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:35.075589 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:35.102430 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1378/2753] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:47:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:47:35.110770 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3d965-e051-40a3-9285-21617ed2d44b None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:35.111183 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3d965-e051-40a3-9285-21617ed2d44b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:35.111353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3d965-e051-40a3-9285-21617ed2d44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:35.135773 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-07e3d965-e051-40a3-9285-21617ed2d44b None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:47:35.136996 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-07e3d965-e051-40a3-9285-21617ed2d44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:35.145596 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1376/2754] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:47:35.150381 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24696c85-6858-44f4-95dc-f8bc6a9e9ecb None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:35.160490 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24696c85-6858-44f4-95dc-f8bc6a9e9ecb None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:35.165333 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86786c-7f2c-4e51-b6d8-844301548977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:35.166057 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86786c-7f2c-4e51-b6d8-844301548977 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:35.166299 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86786c-7f2c-4e51-b6d8-844301548977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:35.166569 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86786c-7f2c-4e51-b6d8-844301548977 admin admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:35.167462 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd86786c-7f2c-4e51-b6d8-844301548977 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:47:35.167761 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd86786c-7f2c-4e51-b6d8-844301548977 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:35.169337 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd86786c-7f2c-4e51-b6d8-844301548977 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:35.181221 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1379/2755] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:47:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:47:35.186923 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e3d965-e051-40a3-9285-21617ed2d44b None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:35.200890 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e3d965-e051-40a3-9285-21617ed2d44b None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:35.206364 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68a812-ffe4-4d5f-bf18-41e74c2bc92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:35.207069 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68a812-ffe4-4d5f-bf18-41e74c2bc92e admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:35.207309 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68a812-ffe4-4d5f-bf18-41e74c2bc92e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:35.207582 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68a812-ffe4-4d5f-bf18-41e74c2bc92e admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:35.208279 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db68a812-ffe4-4d5f-bf18-41e74c2bc92e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:35.210211 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db68a812-ffe4-4d5f-bf18-41e74c2bc92e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:35.238366 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1377/2756] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:47:35 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:47:35.242811 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86786c-7f2c-4e51-b6d8-844301548977 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:35.253696 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86786c-7f2c-4e51-b6d8-844301548977 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:35.282629 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68a812-ffe4-4d5f-bf18-41e74c2bc92e admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:35.284940 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-db68a812-ffe4-4d5f-bf18-41e74c2bc92e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:35.318005 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927095f8-7279-4d33-9d87-04f2f156f6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:35.318676 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927095f8-7279-4d33-9d87-04f2f156f6c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:35.318952 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927095f8-7279-4d33-9d87-04f2f156f6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:35.319222 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927095f8-7279-4d33-9d87-04f2f156f6c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:35.319909 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927095f8-7279-4d33-9d87-04f2f156f6c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:35.321874 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927095f8-7279-4d33-9d87-04f2f156f6c7 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:35.348334 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1380/2757] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:47:35 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:47:35.349387 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927095f8-7279-4d33-9d87-04f2f156f6c7 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:35.353622 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68a812-ffe4-4d5f-bf18-41e74c2bc92e admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:35.358609 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e04440-255c-4c06-a622-26af66b3d455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:35.359360 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927095f8-7279-4d33-9d87-04f2f156f6c7 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:35.359549 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e04440-255c-4c06-a622-26af66b3d455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:35.359830 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e04440-255c-4c06-a622-26af66b3d455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:35.360109 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e04440-255c-4c06-a622-26af66b3d455 admin admin] PATH_INFO: `/v3/users/0294672967a84be48378f5e255675edc` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:35.361320 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e04440-255c-4c06-a622-26af66b3d455 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0294672967a84be48378f5e255675edc)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:35.363285 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e04440-255c-4c06-a622-26af66b3d455 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:35.364641 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e9b01f-4348-4b0c-a88e-fddf79b77367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:35.365298 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9b01f-4348-4b0c-a88e-fddf79b77367 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:35.365581 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9b01f-4348-4b0c-a88e-fddf79b77367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:35.365901 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9b01f-4348-4b0c-a88e-fddf79b77367 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:35.366669 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e9b01f-4348-4b0c-a88e-fddf79b77367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:35.368251 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e9b01f-4348-4b0c-a88e-fddf79b77367 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:35.378808 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1381/2758] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:47:35.382871 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e9b01f-4348-4b0c-a88e-fddf79b77367 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:35.393044 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e9b01f-4348-4b0c-a88e-fddf79b77367 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:35.398074 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd5935-38e9-4323-8703-e9de6c21b1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:35.398732 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd5935-38e9-4323-8703-e9de6c21b1da admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:35.399017 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd5935-38e9-4323-8703-e9de6c21b1da admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:35.399288 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd5935-38e9-4323-8703-e9de6c21b1da admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:35.400317 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd5935-38e9-4323-8703-e9de6c21b1da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:35.401657 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd5935-38e9-4323-8703-e9de6c21b1da admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:35.411883 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1382/2759] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:47:35.415096 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-34e04440-255c-4c06-a622-26af66b3d455 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0294672967a84be48378f5e255675edc'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:35.415096 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-34e04440-255c-4c06-a622-26af66b3d455 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0294672967a84be48378f5e255675edc'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:35.416000 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd5935-38e9-4323-8703-e9de6c21b1da admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:35.420446 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-34e04440-255c-4c06-a622-26af66b3d455 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0294672967a84be48378f5e255675edc'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:35.421741 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:35.426620 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd5935-38e9-4323-8703-e9de6c21b1da admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:35.432632 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b9c03-8364-4970-9035-bcf525985ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:35.433689 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b9c03-8364-4970-9035-bcf525985ad5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:35.434002 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b9c03-8364-4970-9035-bcf525985ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:35.434276 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b9c03-8364-4970-9035-bcf525985ad5 admin admin] PATH_INFO: `/v3/projects/565c6a28899d4190a048fa762c84751a/users/7973259c53bb4553883f61bef4eda02f/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:35.436257 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-34e04440-255c-4c06-a622-26af66b3d455 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0294672967a84be48378f5e255675edc'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:35.444755 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-34e04440-255c-4c06-a622-26af66b3d455 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0294672967a84be48378f5e255675edc'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:35.451160 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708b9c03-8364-4970-9035-bcf525985ad5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=565c6a28899d4190a048fa762c84751a, user_id=7973259c53bb4553883f61bef4eda02f, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:35.452868 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1378/2760] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:47:35 2022] DELETE /identity/v3/users/0294672967a84be48378f5e255675edc => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:47:35.456921 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708b9c03-8364-4970-9035-bcf525985ad5 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:35.457504 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02c41e-9d8e-433a-9209-5d5785e4f8d1 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:35.457818 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02c41e-9d8e-433a-9209-5d5785e4f8d1 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:35.458101 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02c41e-9d8e-433a-9209-5d5785e4f8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:35.471875 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1383/2761] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:47:35 2022] PUT /identity/v3/projects/565c6a28899d4190a048fa762c84751a/users/7973259c53bb4553883f61bef4eda02f/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:47:35.478580 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0a5fe-d9a3-4738-9bdb-32b6fa54a88b None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:35.478786 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-0a02c41e-9d8e-433a-9209-5d5785e4f8d1 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:47:35.478883 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0a5fe-d9a3-4738-9bdb-32b6fa54a88b None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:35.479133 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0a5fe-d9a3-4738-9bdb-32b6fa54a88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:35.480479 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-0a02c41e-9d8e-433a-9209-5d5785e4f8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:35.497575 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-77c0a5fe-d9a3-4738-9bdb-32b6fa54a88b None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:47:35.498826 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-77c0a5fe-d9a3-4738-9bdb-32b6fa54a88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:35.541724 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1379/2762] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:47:35.551621 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02c41e-9d8e-433a-9209-5d5785e4f8d1 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:35.553048 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-0a02c41e-9d8e-433a-9209-5d5785e4f8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:35.560415 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1384/2763] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:47:35.569814 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0a5fe-d9a3-4738-9bdb-32b6fa54a88b None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:35.571481 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-77c0a5fe-d9a3-4738-9bdb-32b6fa54a88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:35.592634 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:35.617752 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02c41e-9d8e-433a-9209-5d5785e4f8d1 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:35.621675 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86047e5b-90b5-4619-b0ce-9ce831f7873d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:35.622372 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86047e5b-90b5-4619-b0ce-9ce831f7873d service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:35.622648 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86047e5b-90b5-4619-b0ce-9ce831f7873d service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:35.622914 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86047e5b-90b5-4619-b0ce-9ce831f7873d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:35.632750 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86047e5b-90b5-4619-b0ce-9ce831f7873d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:35.634234 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86047e5b-90b5-4619-b0ce-9ce831f7873d service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:35.636020 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0a5fe-d9a3-4738-9bdb-32b6fa54a88b None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:35.639592 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e46f8-e2de-4029-a531-b540e54ef99a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:35.640271 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e46f8-e2de-4029-a531-b540e54ef99a service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:35.640549 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e46f8-e2de-4029-a531-b540e54ef99a service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:35.640811 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e46f8-e2de-4029-a531-b540e54ef99a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:35.645570 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1380/2764] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:47:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 17:47:35.650200 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e46f8-e2de-4029-a531-b540e54ef99a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:35.651652 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e46f8-e2de-4029-a531-b540e54ef99a service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:35.661398 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1385/2765] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:47:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 17:47:35.918613 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86047e5b-90b5-4619-b0ce-9ce831f7873d service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:35.920207 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-86047e5b-90b5-4619-b0ce-9ce831f7873d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:35.934802 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86047e5b-90b5-4619-b0ce-9ce831f7873d service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:35.940699 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6391e-488f-4dcf-9fca-d4c34ed2fdb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:35.941565 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6391e-488f-4dcf-9fca-d4c34ed2fdb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:35.941877 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6391e-488f-4dcf-9fca-d4c34ed2fdb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:35.942312 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6391e-488f-4dcf-9fca-d4c34ed2fdb4 admin admin] PATH_INFO: `/v3/projects/84ad7cd23e5948169fe849f3dbeed56e` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:35.943800 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab6391e-488f-4dcf-9fca-d4c34ed2fdb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84ad7cd23e5948169fe849f3dbeed56e)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:35.945854 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab6391e-488f-4dcf-9fca-d4c34ed2fdb4 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:36.000271 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-fab6391e-488f-4dcf-9fca-d4c34ed2fdb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84ad7cd23e5948169fe849f3dbeed56e', 'request_id': 'req-fab6391e-488f-4dcf-9fca-d4c34ed2fdb4'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:36.009500 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-fab6391e-488f-4dcf-9fca-d4c34ed2fdb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84ad7cd23e5948169fe849f3dbeed56e', 'request_id': 'req-fab6391e-488f-4dcf-9fca-d4c34ed2fdb4'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:36.015782 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-fab6391e-488f-4dcf-9fca-d4c34ed2fdb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84ad7cd23e5948169fe849f3dbeed56e', 'request_id': 'req-fab6391e-488f-4dcf-9fca-d4c34ed2fdb4'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:36.024494 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:36.029513 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-fab6391e-488f-4dcf-9fca-d4c34ed2fdb4 admin admin] The token cache is being invalidate because project 84ad7cd23e5948169fe849f3dbeed56e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:47:36.029858 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-fab6391e-488f-4dcf-9fca-d4c34ed2fdb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:36.031869 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-fab6391e-488f-4dcf-9fca-d4c34ed2fdb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:47:36.033771 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1381/2766] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:47:35 2022] DELETE /identity/v3/projects/84ad7cd23e5948169fe849f3dbeed56e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:47:39.769728 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41dce1-c96e-41a5-8aff-7b86f21599f4 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:39.770242 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41dce1-c96e-41a5-8aff-7b86f21599f4 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:39.770326 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41dce1-c96e-41a5-8aff-7b86f21599f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:39.799987 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-0c41dce1-c96e-41a5-8aff-7b86f21599f4 None None] MFA Rules not processed for user `7973259c53bb4553883f61bef4eda02f`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:47:39.801231 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-0c41dce1-c96e-41a5-8aff-7b86f21599f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:39.882082 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1386/2767] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:47:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:47:39.887400 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6391e-488f-4dcf-9fca-d4c34ed2fdb4 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:39.889881 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-fab6391e-488f-4dcf-9fca-d4c34ed2fdb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:39.958446 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6391e-488f-4dcf-9fca-d4c34ed2fdb4 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:39.963086 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81128564-03ca-486a-871c-85e389d59ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:39.963765 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81128564-03ca-486a-871c-85e389d59ac3 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:39.964102 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81128564-03ca-486a-871c-85e389d59ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:39.964377 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81128564-03ca-486a-871c-85e389d59ac3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:39.965110 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81128564-03ca-486a-871c-85e389d59ac3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:39.967085 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81128564-03ca-486a-871c-85e389d59ac3 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:39.996361 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1382/2768] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:47:39 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:47:40.000368 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41dce1-c96e-41a5-8aff-7b86f21599f4 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:40.012614 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41dce1-c96e-41a5-8aff-7b86f21599f4 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:40.071393 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef06bd49-b084-4732-94fc-f8880a587642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:40.072246 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06bd49-b084-4732-94fc-f8880a587642 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:40.072526 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06bd49-b084-4732-94fc-f8880a587642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:40.072798 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06bd49-b084-4732-94fc-f8880a587642 admin admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:40.073601 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef06bd49-b084-4732-94fc-f8880a587642 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:40.075657 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef06bd49-b084-4732-94fc-f8880a587642 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:40.100131 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1387/2769] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:47:39 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:47:40.104217 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81128564-03ca-486a-871c-85e389d59ac3 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:40.115271 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81128564-03ca-486a-871c-85e389d59ac3 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:40.120048 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0aa135-9d0e-4279-84ae-9719d68c330e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:40.120811 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0aa135-9d0e-4279-84ae-9719d68c330e admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:40.121093 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0aa135-9d0e-4279-84ae-9719d68c330e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:40.121500 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0aa135-9d0e-4279-84ae-9719d68c330e admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:40.122404 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0aa135-9d0e-4279-84ae-9719d68c330e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:40.124022 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0aa135-9d0e-4279-84ae-9719d68c330e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:40.136239 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1383/2770] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:47:40.140702 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef06bd49-b084-4732-94fc-f8880a587642 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:40.151996 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef06bd49-b084-4732-94fc-f8880a587642 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:40.156649 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d84bb-69ae-4e0a-9731-92848d19d8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:40.157581 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d84bb-69ae-4e0a-9731-92848d19d8d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:40.157894 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d84bb-69ae-4e0a-9731-92848d19d8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:40.158164 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d84bb-69ae-4e0a-9731-92848d19d8d3 admin admin] PATH_INFO: `/v3/projects/58bbbdcc8cf347e1bcee758500b4e27f/users/18128d7347e640568d9511840116e1db/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:40.174245 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3d84bb-69ae-4e0a-9731-92848d19d8d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58bbbdcc8cf347e1bcee758500b4e27f, user_id=18128d7347e640568d9511840116e1db, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:40.176900 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3d84bb-69ae-4e0a-9731-92848d19d8d3 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:40.191795 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1388/2771] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:47:40 2022] PUT /identity/v3/projects/58bbbdcc8cf347e1bcee758500b4e27f/users/18128d7347e640568d9511840116e1db/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:47:40.195888 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0aa135-9d0e-4279-84ae-9719d68c330e admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:40.211715 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0aa135-9d0e-4279-84ae-9719d68c330e admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:40.280223 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86972b-df66-4754-9834-cb21d85d8726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:40.280928 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86972b-df66-4754-9834-cb21d85d8726 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:40.281200 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86972b-df66-4754-9834-cb21d85d8726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:40.281469 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86972b-df66-4754-9834-cb21d85d8726 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:40.282240 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f86972b-df66-4754-9834-cb21d85d8726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:40.283834 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f86972b-df66-4754-9834-cb21d85d8726 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:40.293978 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1384/2772] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:47:40.298328 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d84bb-69ae-4e0a-9731-92848d19d8d3 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:40.310139 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d84bb-69ae-4e0a-9731-92848d19d8d3 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:40.315219 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45480059-483e-4179-b2ab-e7cb0c0658fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:40.316119 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45480059-483e-4179-b2ab-e7cb0c0658fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:40.316405 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45480059-483e-4179-b2ab-e7cb0c0658fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:40.316676 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45480059-483e-4179-b2ab-e7cb0c0658fa admin admin] PATH_INFO: `/v3/projects/58bbbdcc8cf347e1bcee758500b4e27f/users/18128d7347e640568d9511840116e1db/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:40.318742 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45480059-483e-4179-b2ab-e7cb0c0658fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=58bbbdcc8cf347e1bcee758500b4e27f, user_id=18128d7347e640568d9511840116e1db, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:40.321382 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45480059-483e-4179-b2ab-e7cb0c0658fa admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:40.333188 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1389/2773] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:47:40 2022] PUT /identity/v3/projects/58bbbdcc8cf347e1bcee758500b4e27f/users/18128d7347e640568d9511840116e1db/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:47:45.318637 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fdaa9f-27c9-4133-9bf8-db937eb3d1f5 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:45.319039 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fdaa9f-27c9-4133-9bf8-db937eb3d1f5 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:45.319039 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fdaa9f-27c9-4133-9bf8-db937eb3d1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:45.353926 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-17fdaa9f-27c9-4133-9bf8-db937eb3d1f5 None None] MFA Rules not processed for user `18128d7347e640568d9511840116e1db`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:47:45.355419 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-17fdaa9f-27c9-4133-9bf8-db937eb3d1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:45.461978 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:45.486476 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1385/2774] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:47:45 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:47:45.497369 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45480059-483e-4179-b2ab-e7cb0c0658fa admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:47:45.499977 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-45480059-483e-4179-b2ab-e7cb0c0658fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:45.506562 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:45.597482 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45480059-483e-4179-b2ab-e7cb0c0658fa admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:47:45.603027 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee43781-651c-46d2-9369-3287c5d74a8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:47:45.603703 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee43781-651c-46d2-9369-3287c5d74a8f service nova] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:45.603990 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee43781-651c-46d2-9369-3287c5d74a8f service nova] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:45.604263 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee43781-651c-46d2-9369-3287c5d74a8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:45.669611 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee43781-651c-46d2-9369-3287c5d74a8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:47:45.671272 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee43781-651c-46d2-9369-3287c5d74a8f service nova] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:47:45.681019 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1390/2775] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:47:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 17:47:46.703046 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93af27d-8cfb-4b34-be82-9e4db2d585d1 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:47:46.703567 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93af27d-8cfb-4b34-be82-9e4db2d585d1 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:47:46.703567 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93af27d-8cfb-4b34-be82-9e4db2d585d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:47:46.721360 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-f93af27d-8cfb-4b34-be82-9e4db2d585d1 None None] MFA Rules not processed for user `7973259c53bb4553883f61bef4eda02f`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:47:46.722667 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f93af27d-8cfb-4b34-be82-9e4db2d585d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:47:46.729913 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1386/2776] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:47:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:47:55.676631 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=55 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:47:56.716028 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=5 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:48:04.160105 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee43781-651c-46d2-9369-3287c5d74a8f service nova] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:04.161756 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-8ee43781-651c-46d2-9369-3287c5d74a8f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:04.235722 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee43781-651c-46d2-9369-3287c5d74a8f service nova] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:04.240395 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66bda66-58e6-4928-a09d-4c47b801ad76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:04.241281 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bda66-58e6-4928-a09d-4c47b801ad76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:04.241559 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bda66-58e6-4928-a09d-4c47b801ad76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:04.241881 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bda66-58e6-4928-a09d-4c47b801ad76 admin admin] PATH_INFO: `/v3/users/9d065c34890a4be7ab44a2552300f59b` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:04.243105 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66bda66-58e6-4928-a09d-4c47b801ad76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d065c34890a4be7ab44a2552300f59b)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:04.245022 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66bda66-58e6-4928-a09d-4c47b801ad76 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:04.297469 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-c66bda66-58e6-4928-a09d-4c47b801ad76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d065c34890a4be7ab44a2552300f59b'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:04.298150 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-c66bda66-58e6-4928-a09d-4c47b801ad76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d065c34890a4be7ab44a2552300f59b'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:04.305449 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-c66bda66-58e6-4928-a09d-4c47b801ad76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d065c34890a4be7ab44a2552300f59b'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:04.306144 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-c66bda66-58e6-4928-a09d-4c47b801ad76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d065c34890a4be7ab44a2552300f59b'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:04.319683 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-c66bda66-58e6-4928-a09d-4c47b801ad76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d065c34890a4be7ab44a2552300f59b'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:04.335880 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1391/2777] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:48:04 2022] DELETE /identity/v3/users/9d065c34890a4be7ab44a2552300f59b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:48:04.340960 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41719f19-611f-4bf7-9aca-6c1c4f857f50 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:04.341470 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41719f19-611f-4bf7-9aca-6c1c4f857f50 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:04.341573 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41719f19-611f-4bf7-9aca-6c1c4f857f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:04.359617 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-41719f19-611f-4bf7-9aca-6c1c4f857f50 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:48:04.360856 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-41719f19-611f-4bf7-9aca-6c1c4f857f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:04.424325 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1387/2778] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:48:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:48:04.434457 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66bda66-58e6-4928-a09d-4c47b801ad76 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:04.435899 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-c66bda66-58e6-4928-a09d-4c47b801ad76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:04.495536 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66bda66-58e6-4928-a09d-4c47b801ad76 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:04.500010 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f6a3b-478b-4165-b1e3-da2ed210ab4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:04.500718 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f6a3b-478b-4165-b1e3-da2ed210ab4a service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:04.500970 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f6a3b-478b-4165-b1e3-da2ed210ab4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:04.501241 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f6a3b-478b-4165-b1e3-da2ed210ab4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:04.511345 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121f6a3b-478b-4165-b1e3-da2ed210ab4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:04.512792 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121f6a3b-478b-4165-b1e3-da2ed210ab4a service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:04.523687 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1392/2779] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:48:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:48:04.811269 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41719f19-611f-4bf7-9aca-6c1c4f857f50 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:04.812766 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-41719f19-611f-4bf7-9aca-6c1c4f857f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:04.825535 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41719f19-611f-4bf7-9aca-6c1c4f857f50 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:04.830936 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6da88b-d67e-4bca-a918-02a68a33302e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:04.831822 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6da88b-d67e-4bca-a918-02a68a33302e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:04.832100 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6da88b-d67e-4bca-a918-02a68a33302e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:04.833044 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6da88b-d67e-4bca-a918-02a68a33302e admin admin] PATH_INFO: `/v3/projects/47165c1916c24035ab8fb2c112107ec4` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:04.833607 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6da88b-d67e-4bca-a918-02a68a33302e admin admin] RBAC: Authorizing `identity:delete_project(project_id=47165c1916c24035ab8fb2c112107ec4)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:04.835554 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6da88b-d67e-4bca-a918-02a68a33302e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:04.885273 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6f6da88b-d67e-4bca-a918-02a68a33302e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47165c1916c24035ab8fb2c112107ec4', 'request_id': 'req-6f6da88b-d67e-4bca-a918-02a68a33302e'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:04.895079 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6f6da88b-d67e-4bca-a918-02a68a33302e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47165c1916c24035ab8fb2c112107ec4', 'request_id': 'req-6f6da88b-d67e-4bca-a918-02a68a33302e'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:04.901220 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6f6da88b-d67e-4bca-a918-02a68a33302e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47165c1916c24035ab8fb2c112107ec4', 'request_id': 'req-6f6da88b-d67e-4bca-a918-02a68a33302e'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:04.913731 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6f6da88b-d67e-4bca-a918-02a68a33302e admin admin] The token cache is being invalidate because project 47165c1916c24035ab8fb2c112107ec4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:48:04.914034 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6f6da88b-d67e-4bca-a918-02a68a33302e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:04.914690 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6f6da88b-d67e-4bca-a918-02a68a33302e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:04.916237 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1388/2780] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:48:04 2022] DELETE /identity/v3/projects/47165c1916c24035ab8fb2c112107ec4 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:48:04.920385 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f6a3b-478b-4165-b1e3-da2ed210ab4a service neutron] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:04.932531 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f6a3b-478b-4165-b1e3-da2ed210ab4a service neutron] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:04.955087 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:48:05.001646 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68adc6c4-084d-41c7-8179-f0f3ce1d7b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:05.002558 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adc6c4-084d-41c7-8179-f0f3ce1d7b75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:05.002836 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adc6c4-084d-41c7-8179-f0f3ce1d7b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:05.003112 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adc6c4-084d-41c7-8179-f0f3ce1d7b75 admin admin] PATH_INFO: `/v3/users/a23355afaaf2408fa212b8f6421f746d` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:05.004305 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68adc6c4-084d-41c7-8179-f0f3ce1d7b75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a23355afaaf2408fa212b8f6421f746d)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:05.006252 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68adc6c4-084d-41c7-8179-f0f3ce1d7b75 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:05.065666 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-68adc6c4-084d-41c7-8179-f0f3ce1d7b75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a23355afaaf2408fa212b8f6421f746d'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:05.066334 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-68adc6c4-084d-41c7-8179-f0f3ce1d7b75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a23355afaaf2408fa212b8f6421f746d'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:05.073550 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-68adc6c4-084d-41c7-8179-f0f3ce1d7b75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a23355afaaf2408fa212b8f6421f746d'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:05.074220 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-68adc6c4-084d-41c7-8179-f0f3ce1d7b75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a23355afaaf2408fa212b8f6421f746d'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:05.086248 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-68adc6c4-084d-41c7-8179-f0f3ce1d7b75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a23355afaaf2408fa212b8f6421f746d'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:05.101011 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1393/2781] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:48:04 2022] DELETE /identity/v3/users/a23355afaaf2408fa212b8f6421f746d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:48:05.194619 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6da88b-d67e-4bca-a918-02a68a33302e admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:05.196278 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-6f6da88b-d67e-4bca-a918-02a68a33302e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:05.271028 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6da88b-d67e-4bca-a918-02a68a33302e admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:05.313740 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:48:05.326528 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d748e2d-d5a8-4fd8-af5f-b7fcfa625680 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:05.327403 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d748e2d-d5a8-4fd8-af5f-b7fcfa625680 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:05.327912 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d748e2d-d5a8-4fd8-af5f-b7fcfa625680 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:05.328455 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d748e2d-d5a8-4fd8-af5f-b7fcfa625680 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:05.330500 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-4d748e2d-d5a8-4fd8-af5f-b7fcfa625680 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:05.392944 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68adc6c4-084d-41c7-8179-f0f3ce1d7b75 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:05.394487 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-68adc6c4-084d-41c7-8179-f0f3ce1d7b75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:05.406430 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d748e2d-d5a8-4fd8-af5f-b7fcfa625680 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:05.408539 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d748e2d-d5a8-4fd8-af5f-b7fcfa625680 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:05.421442 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1389/2782] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:48:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:48:05.474199 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68adc6c4-084d-41c7-8179-f0f3ce1d7b75 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:05.479101 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa59fe1-e465-4296-b003-1102d9d3260c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:05.479985 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa59fe1-e465-4296-b003-1102d9d3260c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:05.480260 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa59fe1-e465-4296-b003-1102d9d3260c admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:05.480527 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa59fe1-e465-4296-b003-1102d9d3260c admin admin] PATH_INFO: `/v3/projects/97c391d4a65f4cbfae50fd692d4724fa` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:05.481710 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa59fe1-e465-4296-b003-1102d9d3260c admin admin] RBAC: Authorizing `identity:delete_project(project_id=97c391d4a65f4cbfae50fd692d4724fa)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:05.483639 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa59fe1-e465-4296-b003-1102d9d3260c admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:05.530604 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:48:05.535211 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-6aa59fe1-e465-4296-b003-1102d9d3260c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97c391d4a65f4cbfae50fd692d4724fa', 'request_id': 'req-6aa59fe1-e465-4296-b003-1102d9d3260c'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:05.545889 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-6aa59fe1-e465-4296-b003-1102d9d3260c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97c391d4a65f4cbfae50fd692d4724fa', 'request_id': 'req-6aa59fe1-e465-4296-b003-1102d9d3260c'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:05.553007 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-6aa59fe1-e465-4296-b003-1102d9d3260c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97c391d4a65f4cbfae50fd692d4724fa', 'request_id': 'req-6aa59fe1-e465-4296-b003-1102d9d3260c'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:05.564620 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-6aa59fe1-e465-4296-b003-1102d9d3260c admin admin] The token cache is being invalidate because project 97c391d4a65f4cbfae50fd692d4724fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80150) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:48:05.564912 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-6aa59fe1-e465-4296-b003-1102d9d3260c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:05.565944 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-6aa59fe1-e465-4296-b003-1102d9d3260c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:05.568079 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1394/2783] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:48:05 2022] DELETE /identity/v3/projects/97c391d4a65f4cbfae50fd692d4724fa => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:48:05.572882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d6f97-eb07-4e48-822a-f27cfb59f209 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:05.573178 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d6f97-eb07-4e48-822a-f27cfb59f209 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:05.573458 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d6f97-eb07-4e48-822a-f27cfb59f209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:05.594020 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-d78d6f97-eb07-4e48-822a-f27cfb59f209 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:48:05.595931 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-d78d6f97-eb07-4e48-822a-f27cfb59f209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:05.658703 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1390/2784] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:48:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:48:05.666204 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4dfa0d-ecae-4ffb-82cc-da9cab203f95 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:05.666495 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4dfa0d-ecae-4ffb-82cc-da9cab203f95 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:05.666776 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4dfa0d-ecae-4ffb-82cc-da9cab203f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:05.685982 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-ba4dfa0d-ecae-4ffb-82cc-da9cab203f95 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:48:05.687201 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-ba4dfa0d-ecae-4ffb-82cc-da9cab203f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:05.696409 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1395/2785] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:48:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:48:05.700801 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d6f97-eb07-4e48-822a-f27cfb59f209 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:05.711497 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d6f97-eb07-4e48-822a-f27cfb59f209 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:05.716749 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0abe63-c2c9-4d79-ad07-a7c4c7f990d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:05.717290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0abe63-c2c9-4d79-ad07-a7c4c7f990d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:05.717568 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0abe63-c2c9-4d79-ad07-a7c4c7f990d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:05.717933 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0abe63-c2c9-4d79-ad07-a7c4c7f990d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:05.718660 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0abe63-c2c9-4d79-ad07-a7c4c7f990d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:48:05.718959 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0abe63-c2c9-4d79-ad07-a7c4c7f990d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:05.720700 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0abe63-c2c9-4d79-ad07-a7c4c7f990d6 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:05.732827 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1391/2786] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:48:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:48:05.737808 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4dfa0d-ecae-4ffb-82cc-da9cab203f95 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:05.747543 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4dfa0d-ecae-4ffb-82cc-da9cab203f95 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:05.753439 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b8e6e-5fc5-4de4-9a4d-b7ac5a52473f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:05.754297 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b8e6e-5fc5-4de4-9a4d-b7ac5a52473f admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:05.754575 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b8e6e-5fc5-4de4-9a4d-b7ac5a52473f admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:05.754846 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b8e6e-5fc5-4de4-9a4d-b7ac5a52473f admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:05.755578 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b8e6e-5fc5-4de4-9a4d-b7ac5a52473f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:05.757506 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b8e6e-5fc5-4de4-9a4d-b7ac5a52473f admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:05.795561 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1396/2787] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:48:05 2022] POST /identity/v3/projects => generated 355 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:48:05.800499 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0abe63-c2c9-4d79-ad07-a7c4c7f990d6 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:05.811432 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0abe63-c2c9-4d79-ad07-a7c4c7f990d6 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:05.869622 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275422d-006b-4f76-b548-a54f36978db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:05.870381 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275422d-006b-4f76-b548-a54f36978db3 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:05.870654 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275422d-006b-4f76-b548-a54f36978db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:05.871548 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275422d-006b-4f76-b548-a54f36978db3 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:05.871669 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d275422d-006b-4f76-b548-a54f36978db3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:05.877055 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d275422d-006b-4f76-b548-a54f36978db3 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:05.889112 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:48:05.900502 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1392/2788] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:48:05 2022] POST /identity/v3/users => generated 278 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:48:05.901768 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b8e6e-5fc5-4de4-9a4d-b7ac5a52473f admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:05.912676 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b8e6e-5fc5-4de4-9a4d-b7ac5a52473f admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:05.917566 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721643d-465e-48cd-9d0e-d9176593004a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:05.918276 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721643d-465e-48cd-9d0e-d9176593004a admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:05.918595 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721643d-465e-48cd-9d0e-d9176593004a admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:05.919012 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721643d-465e-48cd-9d0e-d9176593004a admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:05.919754 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721643d-465e-48cd-9d0e-d9176593004a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:05.921378 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721643d-465e-48cd-9d0e-d9176593004a admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:05.932584 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1397/2789] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:48:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:48:05.936548 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275422d-006b-4f76-b548-a54f36978db3 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:05.947516 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275422d-006b-4f76-b548-a54f36978db3 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:05.952589 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ec0d4-2c6b-40b2-aea1-24ceb501e509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:05.953259 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ec0d4-2c6b-40b2-aea1-24ceb501e509 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:05.953543 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ec0d4-2c6b-40b2-aea1-24ceb501e509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:05.953824 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ec0d4-2c6b-40b2-aea1-24ceb501e509 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:05.954758 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ec0d4-2c6b-40b2-aea1-24ceb501e509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:05.956368 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ec0d4-2c6b-40b2-aea1-24ceb501e509 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:05.969828 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1393/2790] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:48:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:48:05.971248 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721643d-465e-48cd-9d0e-d9176593004a admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:05.981392 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721643d-465e-48cd-9d0e-d9176593004a admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:05.986355 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304a689-dd1e-4d19-a519-d3f2c2313b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:05.987263 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304a689-dd1e-4d19-a519-d3f2c2313b64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:05.987543 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304a689-dd1e-4d19-a519-d3f2c2313b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:05.987815 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304a689-dd1e-4d19-a519-d3f2c2313b64 admin admin] PATH_INFO: `/v3/projects/5bbfa64a9853450097cbb370fef7b357/users/ca4714c2c7e54041b4828a514c1cb621/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:06.005425 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4304a689-dd1e-4d19-a519-d3f2c2313b64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bbfa64a9853450097cbb370fef7b357, user_id=ca4714c2c7e54041b4828a514c1cb621, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:06.007998 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4304a689-dd1e-4d19-a519-d3f2c2313b64 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:06.024412 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1398/2791] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:48:05 2022] PUT /identity/v3/projects/5bbfa64a9853450097cbb370fef7b357/users/ca4714c2c7e54041b4828a514c1cb621/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:48:06.036230 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d56d55-a8be-4d45-9e8c-240bf4fe8c07 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:06.036593 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d56d55-a8be-4d45-9e8c-240bf4fe8c07 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:06.036935 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d56d55-a8be-4d45-9e8c-240bf4fe8c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:06.068371 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-06d56d55-a8be-4d45-9e8c-240bf4fe8c07 None None] MFA Rules not processed for user `ca4714c2c7e54041b4828a514c1cb621`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:48:06.069617 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-06d56d55-a8be-4d45-9e8c-240bf4fe8c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:06.140038 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1394/2792] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:48:06 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:48:06.145351 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304a689-dd1e-4d19-a519-d3f2c2313b64 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:06.204351 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d56d55-a8be-4d45-9e8c-240bf4fe8c07 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:06.206061 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-06d56d55-a8be-4d45-9e8c-240bf4fe8c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:06.223011 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304a689-dd1e-4d19-a519-d3f2c2313b64 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:06.228111 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd96d0-5658-46c6-b9d7-9dd81a99f9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:06.228774 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd96d0-5658-46c6-b9d7-9dd81a99f9b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:06.229051 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd96d0-5658-46c6-b9d7-9dd81a99f9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:06.229322 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd96d0-5658-46c6-b9d7-9dd81a99f9b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:06.230074 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd96d0-5658-46c6-b9d7-9dd81a99f9b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:06.231981 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd96d0-5658-46c6-b9d7-9dd81a99f9b4 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:06.261451 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1399/2793] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:48:06 2022] POST /identity/v3/projects => generated 357 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:48:06.265358 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd96d0-5658-46c6-b9d7-9dd81a99f9b4 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:06.275856 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d56d55-a8be-4d45-9e8c-240bf4fe8c07 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:06.328744 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:48:06.341147 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca1810-dd32-460c-8d9e-61b2dc9f6b28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:06.342163 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca1810-dd32-460c-8d9e-61b2dc9f6b28 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:06.342486 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca1810-dd32-460c-8d9e-61b2dc9f6b28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:06.342826 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca1810-dd32-460c-8d9e-61b2dc9f6b28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:06.344774 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a3ca1810-dd32-460c-8d9e-61b2dc9f6b28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:06.352208 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd96d0-5658-46c6-b9d7-9dd81a99f9b4 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:06.357361 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a997e3-cfbe-46f7-96f5-5068c3c6a28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:06.358091 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a997e3-cfbe-46f7-96f5-5068c3c6a28b admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:06.358378 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a997e3-cfbe-46f7-96f5-5068c3c6a28b admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:06.358650 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a997e3-cfbe-46f7-96f5-5068c3c6a28b admin admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:06.359426 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a997e3-cfbe-46f7-96f5-5068c3c6a28b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:06.361486 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a997e3-cfbe-46f7-96f5-5068c3c6a28b admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:06.388698 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1400/2794] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:48:06 2022] POST /identity/v3/users => generated 285 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 17:48:06.395139 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a997e3-cfbe-46f7-96f5-5068c3c6a28b admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:06.398237 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:48:06.408364 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a997e3-cfbe-46f7-96f5-5068c3c6a28b admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:06.413432 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82fa7c4-7a20-44b1-a7bd-537d6133798e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:06.414972 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82fa7c4-7a20-44b1-a7bd-537d6133798e admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:06.415327 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82fa7c4-7a20-44b1-a7bd-537d6133798e admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:06.415660 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82fa7c4-7a20-44b1-a7bd-537d6133798e admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:06.416463 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82fa7c4-7a20-44b1-a7bd-537d6133798e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:06.418232 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82fa7c4-7a20-44b1-a7bd-537d6133798e admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:06.426788 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca1810-dd32-460c-8d9e-61b2dc9f6b28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:06.428267 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca1810-dd32-460c-8d9e-61b2dc9f6b28 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:06.429212 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1401/2795] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:48:06.433496 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82fa7c4-7a20-44b1-a7bd-537d6133798e admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:06.442036 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1395/2796] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:48:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 17:48:06.444753 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82fa7c4-7a20-44b1-a7bd-537d6133798e admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:06.450966 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a3ed6-9958-489c-b037-874b367282b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:06.452211 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a3ed6-9958-489c-b037-874b367282b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:06.452527 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a3ed6-9958-489c-b037-874b367282b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:06.452836 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a3ed6-9958-489c-b037-874b367282b7 admin admin] PATH_INFO: `/v3/projects/470586f12f824d90a8febfce409a9fde/users/a7fdd76147184a6eba6867c3d972c253/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:06.472674 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12a3ed6-9958-489c-b037-874b367282b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=470586f12f824d90a8febfce409a9fde, user_id=a7fdd76147184a6eba6867c3d972c253, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:06.476035 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12a3ed6-9958-489c-b037-874b367282b7 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:06.498538 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1402/2797] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:48:06 2022] PUT /identity/v3/projects/470586f12f824d90a8febfce409a9fde/users/a7fdd76147184a6eba6867c3d972c253/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:48:06.502940 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca1810-dd32-460c-8d9e-61b2dc9f6b28 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:06.514115 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca1810-dd32-460c-8d9e-61b2dc9f6b28 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:06.574608 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccda23b-3354-4539-bc66-d5b49c7b8d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:06.575375 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccda23b-3354-4539-bc66-d5b49c7b8d30 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:06.575657 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccda23b-3354-4539-bc66-d5b49c7b8d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:06.575927 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccda23b-3354-4539-bc66-d5b49c7b8d30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:06.576652 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccda23b-3354-4539-bc66-d5b49c7b8d30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:06.579511 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccda23b-3354-4539-bc66-d5b49c7b8d30 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:06.589993 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1396/2798] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:48:06.594287 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a3ed6-9958-489c-b037-874b367282b7 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:06.605125 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a3ed6-9958-489c-b037-874b367282b7 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:06.609900 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2f327-84be-4aa3-99e3-bcbc6392f7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:06.610819 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2f327-84be-4aa3-99e3-bcbc6392f7a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:06.611099 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2f327-84be-4aa3-99e3-bcbc6392f7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:06.611490 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2f327-84be-4aa3-99e3-bcbc6392f7a3 admin admin] PATH_INFO: `/v3/projects/470586f12f824d90a8febfce409a9fde/users/a7fdd76147184a6eba6867c3d972c253/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:06.613469 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2f327-84be-4aa3-99e3-bcbc6392f7a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=470586f12f824d90a8febfce409a9fde, user_id=a7fdd76147184a6eba6867c3d972c253, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:06.616134 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2f327-84be-4aa3-99e3-bcbc6392f7a3 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:06.627244 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1403/2799] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:48:06 2022] PUT /identity/v3/projects/470586f12f824d90a8febfce409a9fde/users/a7fdd76147184a6eba6867c3d972c253/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:48:06.637364 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5e6a8-8ffb-47a9-a7de-e57580cbb6ad None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:06.637762 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5e6a8-8ffb-47a9-a7de-e57580cbb6ad None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:06.638166 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5e6a8-8ffb-47a9-a7de-e57580cbb6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:06.665684 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-8aa5e6a8-8ffb-47a9-a7de-e57580cbb6ad None None] MFA Rules not processed for user `a7fdd76147184a6eba6867c3d972c253`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:48:06.667115 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8aa5e6a8-8ffb-47a9-a7de-e57580cbb6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:06.740995 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1397/2800] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:48:06 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:48:06.753392 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2f327-84be-4aa3-99e3-bcbc6392f7a3 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:06.755468 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-cae2f327-84be-4aa3-99e3-bcbc6392f7a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:06.819557 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2f327-84be-4aa3-99e3-bcbc6392f7a3 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:06.823873 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6b6d9-a7de-4aa3-8718-ea88269235b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:06.824532 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6b6d9-a7de-4aa3-8718-ea88269235b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:06.824811 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6b6d9-a7de-4aa3-8718-ea88269235b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:06.825085 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6b6d9-a7de-4aa3-8718-ea88269235b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:06.835198 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6b6d9-a7de-4aa3-8718-ea88269235b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:06.836639 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6b6d9-a7de-4aa3-8718-ea88269235b9 service cinder] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:06.846578 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1404/2801] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:48:06 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:48:06.934033 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5e6a8-8ffb-47a9-a7de-e57580cbb6ad None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:06.944470 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5e6a8-8ffb-47a9-a7de-e57580cbb6ad None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:06.948251 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ca838-f15e-4af2-b33e-bc123644de22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:06.948922 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ca838-f15e-4af2-b33e-bc123644de22 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:06.949197 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ca838-f15e-4af2-b33e-bc123644de22 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:06.949468 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ca838-f15e-4af2-b33e-bc123644de22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:07.005202 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:48:07.009223 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805ca838-f15e-4af2-b33e-bc123644de22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:07.011032 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805ca838-f15e-4af2-b33e-bc123644de22 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:07.021508 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1398/2802] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:48:06 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:48:16.841918 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=55,keystone:INSERT=5 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:48:17.017339 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:48:17.244247 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6b6d9-a7de-4aa3-8718-ea88269235b9 service cinder] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:17.245653 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-cce6b6d9-a7de-4aa3-8718-ea88269235b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:17.308699 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6b6d9-a7de-4aa3-8718-ea88269235b9 service cinder] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:17.313061 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca181ba-600b-4993-97f0-71c763fb6b35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:17.313721 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca181ba-600b-4993-97f0-71c763fb6b35 service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:17.314048 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca181ba-600b-4993-97f0-71c763fb6b35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:17.314319 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca181ba-600b-4993-97f0-71c763fb6b35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:17.316633 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-aca181ba-600b-4993-97f0-71c763fb6b35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:17.382815 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca181ba-600b-4993-97f0-71c763fb6b35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:17.384277 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca181ba-600b-4993-97f0-71c763fb6b35 service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:17.394693 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1405/2803] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:48:17 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:48:22.073808 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ca838-f15e-4af2-b33e-bc123644de22 service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:22.138829 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ca838-f15e-4af2-b33e-bc123644de22 service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:22.143527 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec79cf-c8fa-4c2b-833c-7f5babfff511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:22.144405 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec79cf-c8fa-4c2b-833c-7f5babfff511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:22.144692 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec79cf-c8fa-4c2b-833c-7f5babfff511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:22.144972 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec79cf-c8fa-4c2b-833c-7f5babfff511 admin admin] PATH_INFO: `/v3/users/ca4714c2c7e54041b4828a514c1cb621` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:22.146326 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec79cf-c8fa-4c2b-833c-7f5babfff511 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca4714c2c7e54041b4828a514c1cb621)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:22.148240 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec79cf-c8fa-4c2b-833c-7f5babfff511 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:22.199781 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-83ec79cf-c8fa-4c2b-833c-7f5babfff511 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca4714c2c7e54041b4828a514c1cb621'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:22.200437 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-83ec79cf-c8fa-4c2b-833c-7f5babfff511 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca4714c2c7e54041b4828a514c1cb621'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:22.207244 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-83ec79cf-c8fa-4c2b-833c-7f5babfff511 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca4714c2c7e54041b4828a514c1cb621'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:22.219737 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-83ec79cf-c8fa-4c2b-833c-7f5babfff511 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca4714c2c7e54041b4828a514c1cb621'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:22.228559 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-83ec79cf-c8fa-4c2b-833c-7f5babfff511 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca4714c2c7e54041b4828a514c1cb621'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:22.234650 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1399/2804] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:48:22 2022] DELETE /identity/v3/users/ca4714c2c7e54041b4828a514c1cb621 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:48:22.239385 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90893785-8c38-420e-bac7-605f00adfdbd None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:22.239978 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90893785-8c38-420e-bac7-605f00adfdbd None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:22.240090 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90893785-8c38-420e-bac7-605f00adfdbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:22.258744 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-90893785-8c38-420e-bac7-605f00adfdbd None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:48:22.259960 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-90893785-8c38-420e-bac7-605f00adfdbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:22.323400 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1406/2805] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:48:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:48:22.333595 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec79cf-c8fa-4c2b-833c-7f5babfff511 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:22.335119 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-83ec79cf-c8fa-4c2b-833c-7f5babfff511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:22.391175 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec79cf-c8fa-4c2b-833c-7f5babfff511 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:22.394964 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324616a-1248-41e5-a206-d8ecdd37eba9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:22.395649 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324616a-1248-41e5-a206-d8ecdd37eba9 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:22.395992 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324616a-1248-41e5-a206-d8ecdd37eba9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:22.396328 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324616a-1248-41e5-a206-d8ecdd37eba9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:22.405516 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5324616a-1248-41e5-a206-d8ecdd37eba9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:22.406965 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5324616a-1248-41e5-a206-d8ecdd37eba9 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:22.416564 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1400/2806] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:48:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:48:22.697086 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90893785-8c38-420e-bac7-605f00adfdbd None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:22.698807 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-90893785-8c38-420e-bac7-605f00adfdbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:22.718774 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90893785-8c38-420e-bac7-605f00adfdbd None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:22.724627 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1ead4-8c13-42fc-a79a-6c79f28a3267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:22.725539 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1ead4-8c13-42fc-a79a-6c79f28a3267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:22.725825 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1ead4-8c13-42fc-a79a-6c79f28a3267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:22.726090 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1ead4-8c13-42fc-a79a-6c79f28a3267 admin admin] PATH_INFO: `/v3/projects/5bbfa64a9853450097cbb370fef7b357` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:22.727326 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1ead4-8c13-42fc-a79a-6c79f28a3267 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bbfa64a9853450097cbb370fef7b357)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:22.729304 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1ead4-8c13-42fc-a79a-6c79f28a3267 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:22.781553 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:48:22.784876 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-04f1ead4-8c13-42fc-a79a-6c79f28a3267 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bbfa64a9853450097cbb370fef7b357', 'request_id': 'req-04f1ead4-8c13-42fc-a79a-6c79f28a3267'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:22.795658 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-04f1ead4-8c13-42fc-a79a-6c79f28a3267 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bbfa64a9853450097cbb370fef7b357', 'request_id': 'req-04f1ead4-8c13-42fc-a79a-6c79f28a3267'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:22.801636 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-04f1ead4-8c13-42fc-a79a-6c79f28a3267 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bbfa64a9853450097cbb370fef7b357', 'request_id': 'req-04f1ead4-8c13-42fc-a79a-6c79f28a3267'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:22.813101 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-04f1ead4-8c13-42fc-a79a-6c79f28a3267 admin admin] The token cache is being invalidate because project 5bbfa64a9853450097cbb370fef7b357 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80150) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:48:22.813388 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-04f1ead4-8c13-42fc-a79a-6c79f28a3267 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:22.814066 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-04f1ead4-8c13-42fc-a79a-6c79f28a3267 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:22.815632 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1407/2807] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:48:22 2022] DELETE /identity/v3/projects/5bbfa64a9853450097cbb370fef7b357 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:48:22.820808 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324616a-1248-41e5-a206-d8ecdd37eba9 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:22.831008 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324616a-1248-41e5-a206-d8ecdd37eba9 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:22.852781 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:48:22.895756 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34bc2d-2794-45b2-85cb-d9d84ffdfd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:22.896789 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34bc2d-2794-45b2-85cb-d9d84ffdfd43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:22.897123 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34bc2d-2794-45b2-85cb-d9d84ffdfd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:22.897508 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34bc2d-2794-45b2-85cb-d9d84ffdfd43 admin admin] PATH_INFO: `/v3/users/a7fdd76147184a6eba6867c3d972c253` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:22.898999 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a34bc2d-2794-45b2-85cb-d9d84ffdfd43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7fdd76147184a6eba6867c3d972c253)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:22.900952 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a34bc2d-2794-45b2-85cb-d9d84ffdfd43 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:22.952050 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0a34bc2d-2794-45b2-85cb-d9d84ffdfd43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7fdd76147184a6eba6867c3d972c253'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:22.952696 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0a34bc2d-2794-45b2-85cb-d9d84ffdfd43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7fdd76147184a6eba6867c3d972c253'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:22.960167 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0a34bc2d-2794-45b2-85cb-d9d84ffdfd43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7fdd76147184a6eba6867c3d972c253'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:22.972985 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0a34bc2d-2794-45b2-85cb-d9d84ffdfd43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7fdd76147184a6eba6867c3d972c253'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:22.983000 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-0a34bc2d-2794-45b2-85cb-d9d84ffdfd43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7fdd76147184a6eba6867c3d972c253'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:22.989425 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1401/2808] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:48:22 2022] DELETE /identity/v3/users/a7fdd76147184a6eba6867c3d972c253 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:48:23.270605 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1ead4-8c13-42fc-a79a-6c79f28a3267 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:23.272098 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-04f1ead4-8c13-42fc-a79a-6c79f28a3267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:23.285321 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1ead4-8c13-42fc-a79a-6c79f28a3267 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:23.353694 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371fe436-ff2c-44d9-9c3a-e375870acea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:23.354562 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371fe436-ff2c-44d9-9c3a-e375870acea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:23.354869 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371fe436-ff2c-44d9-9c3a-e375870acea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:23.355142 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371fe436-ff2c-44d9-9c3a-e375870acea9 admin admin] PATH_INFO: `/v3/projects/470586f12f824d90a8febfce409a9fde` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:23.356442 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371fe436-ff2c-44d9-9c3a-e375870acea9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=470586f12f824d90a8febfce409a9fde)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:23.358617 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371fe436-ff2c-44d9-9c3a-e375870acea9 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:23.414646 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-371fe436-ff2c-44d9-9c3a-e375870acea9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '470586f12f824d90a8febfce409a9fde', 'request_id': 'req-371fe436-ff2c-44d9-9c3a-e375870acea9'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:23.425872 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-371fe436-ff2c-44d9-9c3a-e375870acea9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '470586f12f824d90a8febfce409a9fde', 'request_id': 'req-371fe436-ff2c-44d9-9c3a-e375870acea9'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:23.432518 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-371fe436-ff2c-44d9-9c3a-e375870acea9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '470586f12f824d90a8febfce409a9fde', 'request_id': 'req-371fe436-ff2c-44d9-9c3a-e375870acea9'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:23.444397 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-371fe436-ff2c-44d9-9c3a-e375870acea9 admin admin] The token cache is being invalidate because project 470586f12f824d90a8febfce409a9fde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80150) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:48:23.444727 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-371fe436-ff2c-44d9-9c3a-e375870acea9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:23.445423 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-371fe436-ff2c-44d9-9c3a-e375870acea9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:23.447078 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1408/2809] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:48:23 2022] DELETE /identity/v3/projects/470586f12f824d90a8febfce409a9fde => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:48:23.452924 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bd294-3595-4c6d-9cb7-e4562013afcd None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:23.453420 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bd294-3595-4c6d-9cb7-e4562013afcd None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:23.453537 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bd294-3595-4c6d-9cb7-e4562013afcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:23.480151 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-0d3bd294-3595-4c6d-9cb7-e4562013afcd None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:48:23.481355 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-0d3bd294-3595-4c6d-9cb7-e4562013afcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:23.554010 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1402/2810] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:48:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:48:23.563029 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b0858-ec14-4796-ab40-0a012ef7f6b2 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:23.563320 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b0858-ec14-4796-ab40-0a012ef7f6b2 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:23.563596 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b0858-ec14-4796-ab40-0a012ef7f6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:23.584072 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-ed6b0858-ec14-4796-ab40-0a012ef7f6b2 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:48:23.585462 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-ed6b0858-ec14-4796-ab40-0a012ef7f6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:23.594798 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1409/2811] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:48:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:48:23.599223 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3bd294-3595-4c6d-9cb7-e4562013afcd None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:23.609716 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3bd294-3595-4c6d-9cb7-e4562013afcd None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:23.615644 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f87f1-67ec-4950-bbde-020cacc560e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:23.616304 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f87f1-67ec-4950-bbde-020cacc560e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:23.616585 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f87f1-67ec-4950-bbde-020cacc560e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:23.616855 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f87f1-67ec-4950-bbde-020cacc560e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:23.617584 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f87f1-67ec-4950-bbde-020cacc560e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:48:23.617937 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f87f1-67ec-4950-bbde-020cacc560e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:23.619550 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f87f1-67ec-4950-bbde-020cacc560e1 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:23.632500 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1403/2812] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:48:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:48:23.636907 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b0858-ec14-4796-ab40-0a012ef7f6b2 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:23.646287 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b0858-ec14-4796-ab40-0a012ef7f6b2 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:23.651407 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348986e-e8de-4637-bd39-f8485932d65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:23.652083 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348986e-e8de-4637-bd39-f8485932d65e admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:23.652339 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348986e-e8de-4637-bd39-f8485932d65e admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:23.652622 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348986e-e8de-4637-bd39-f8485932d65e admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:23.653325 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348986e-e8de-4637-bd39-f8485932d65e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:23.655256 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348986e-e8de-4637-bd39-f8485932d65e admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:23.684107 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1410/2813] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:48:23 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 17:48:23.688507 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f87f1-67ec-4950-bbde-020cacc560e1 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:23.700125 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f87f1-67ec-4950-bbde-020cacc560e1 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:23.726746 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:48:23.759463 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8cad9-0413-4fb3-9723-fc9dbb6a634c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:23.760143 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8cad9-0413-4fb3-9723-fc9dbb6a634c admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:23.760424 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8cad9-0413-4fb3-9723-fc9dbb6a634c admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:23.760698 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8cad9-0413-4fb3-9723-fc9dbb6a634c admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:23.761391 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b8cad9-0413-4fb3-9723-fc9dbb6a634c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:23.763542 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b8cad9-0413-4fb3-9723-fc9dbb6a634c admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:23.787464 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1404/2814] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:48:23 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:48:23.793598 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348986e-e8de-4637-bd39-f8485932d65e admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:23.807854 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348986e-e8de-4637-bd39-f8485932d65e admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:23.813709 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e26c21-22f8-47dc-be61-23a645f04654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:23.814410 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e26c21-22f8-47dc-be61-23a645f04654 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:23.814689 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e26c21-22f8-47dc-be61-23a645f04654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:23.814963 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e26c21-22f8-47dc-be61-23a645f04654 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:23.815689 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e26c21-22f8-47dc-be61-23a645f04654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:23.817644 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e26c21-22f8-47dc-be61-23a645f04654 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:23.828580 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1411/2815] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:48:23.833317 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8cad9-0413-4fb3-9723-fc9dbb6a634c admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:23.843742 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8cad9-0413-4fb3-9723-fc9dbb6a634c admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:23.848539 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916fc604-873e-4115-ba4b-81de25e67911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:23.849192 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fc604-873e-4115-ba4b-81de25e67911 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:23.849446 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fc604-873e-4115-ba4b-81de25e67911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:23.849818 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fc604-873e-4115-ba4b-81de25e67911 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:23.850464 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916fc604-873e-4115-ba4b-81de25e67911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:23.852045 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916fc604-873e-4115-ba4b-81de25e67911 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:23.861923 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1405/2816] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:48:23.866084 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e26c21-22f8-47dc-be61-23a645f04654 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:23.876253 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e26c21-22f8-47dc-be61-23a645f04654 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:23.881591 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d0558-305b-4198-8b30-9cbb7f4b0264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:23.882505 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d0558-305b-4198-8b30-9cbb7f4b0264 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:23.882777 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d0558-305b-4198-8b30-9cbb7f4b0264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:23.883043 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d0558-305b-4198-8b30-9cbb7f4b0264 admin admin] PATH_INFO: `/v3/projects/2da9f8bc4f8a4d7aa2a24864a15f2e51/users/a6d304f1e5a743d587b04fdb1c73942e/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:23.903532 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d0558-305b-4198-8b30-9cbb7f4b0264 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2da9f8bc4f8a4d7aa2a24864a15f2e51, user_id=a6d304f1e5a743d587b04fdb1c73942e, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:23.906241 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d0558-305b-4198-8b30-9cbb7f4b0264 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:23.918018 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:48:23.925244 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1412/2817] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:48:23 2022] PUT /identity/v3/projects/2da9f8bc4f8a4d7aa2a24864a15f2e51/users/a6d304f1e5a743d587b04fdb1c73942e/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:48:23.935987 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bac181-162c-469c-96f8-8274e362bdd0 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:23.936281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bac181-162c-469c-96f8-8274e362bdd0 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:23.936586 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bac181-162c-469c-96f8-8274e362bdd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:23.964599 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-c1bac181-162c-469c-96f8-8274e362bdd0 None None] MFA Rules not processed for user `a6d304f1e5a743d587b04fdb1c73942e`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:48:23.965834 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-c1bac181-162c-469c-96f8-8274e362bdd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:24.034905 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1406/2818] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:48:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:48:24.039628 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d0558-305b-4198-8b30-9cbb7f4b0264 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:24.108500 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d0558-305b-4198-8b30-9cbb7f4b0264 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:24.114454 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63084fa-83fb-4485-9a86-fc81d37b0e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:24.115043 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63084fa-83fb-4485-9a86-fc81d37b0e51 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:24.115899 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63084fa-83fb-4485-9a86-fc81d37b0e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:24.116142 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63084fa-83fb-4485-9a86-fc81d37b0e51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:24.116841 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63084fa-83fb-4485-9a86-fc81d37b0e51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:24.118797 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63084fa-83fb-4485-9a86-fc81d37b0e51 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:24.146199 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1413/2819] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:48:24 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:48:24.151116 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bac181-162c-469c-96f8-8274e362bdd0 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:24.162585 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bac181-162c-469c-96f8-8274e362bdd0 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:24.230104 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e0a22-d81e-4d36-911e-4dc86c501b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:24.230786 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e0a22-d81e-4d36-911e-4dc86c501b7a admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:24.231066 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e0a22-d81e-4d36-911e-4dc86c501b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:24.231325 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e0a22-d81e-4d36-911e-4dc86c501b7a admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:24.232013 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e0a22-d81e-4d36-911e-4dc86c501b7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:24.233984 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e0a22-d81e-4d36-911e-4dc86c501b7a admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:24.256785 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1407/2820] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:48:24 2022] POST /identity/v3/users => generated 299 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:48:24.261022 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63084fa-83fb-4485-9a86-fc81d37b0e51 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:24.272178 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63084fa-83fb-4485-9a86-fc81d37b0e51 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:24.277254 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968ca0e-4ec4-4f66-8a04-e702c5472774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:24.277960 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968ca0e-4ec4-4f66-8a04-e702c5472774 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:24.278241 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968ca0e-4ec4-4f66-8a04-e702c5472774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:24.278512 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968ca0e-4ec4-4f66-8a04-e702c5472774 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:24.279241 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c968ca0e-4ec4-4f66-8a04-e702c5472774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:24.280843 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c968ca0e-4ec4-4f66-8a04-e702c5472774 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:24.292472 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1414/2821] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:48:24.297070 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e0a22-d81e-4d36-911e-4dc86c501b7a admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:24.309296 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e0a22-d81e-4d36-911e-4dc86c501b7a admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:24.316235 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7488445-5920-4def-84eb-ffe604d366c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:24.317167 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7488445-5920-4def-84eb-ffe604d366c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:24.317443 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7488445-5920-4def-84eb-ffe604d366c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:24.317734 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7488445-5920-4def-84eb-ffe604d366c0 admin admin] PATH_INFO: `/v3/projects/bd1b3d8735554a74b95a93f5c85eab41/users/607b35d349cb4d0b921b3b5eee582bcb/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:24.334807 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7488445-5920-4def-84eb-ffe604d366c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd1b3d8735554a74b95a93f5c85eab41, user_id=607b35d349cb4d0b921b3b5eee582bcb, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:24.337486 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7488445-5920-4def-84eb-ffe604d366c0 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:24.353251 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1408/2822] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:48:24 2022] PUT /identity/v3/projects/bd1b3d8735554a74b95a93f5c85eab41/users/607b35d349cb4d0b921b3b5eee582bcb/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:48:24.357396 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968ca0e-4ec4-4f66-8a04-e702c5472774 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:24.367698 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968ca0e-4ec4-4f66-8a04-e702c5472774 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:24.424556 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc46c3-4f23-43ba-a7e6-423294310e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:24.425318 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc46c3-4f23-43ba-a7e6-423294310e27 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:24.425607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc46c3-4f23-43ba-a7e6-423294310e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:24.425915 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc46c3-4f23-43ba-a7e6-423294310e27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:24.426651 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc46c3-4f23-43ba-a7e6-423294310e27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:24.428308 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc46c3-4f23-43ba-a7e6-423294310e27 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:24.438744 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1415/2823] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 17:48:24.443405 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7488445-5920-4def-84eb-ffe604d366c0 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:24.449023 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:48:24.454676 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7488445-5920-4def-84eb-ffe604d366c0 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:24.460031 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a57fc69-1c5a-4d40-85bf-ff9e38c44fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:24.460906 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57fc69-1c5a-4d40-85bf-ff9e38c44fae admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:24.461181 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57fc69-1c5a-4d40-85bf-ff9e38c44fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:24.461441 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57fc69-1c5a-4d40-85bf-ff9e38c44fae admin admin] PATH_INFO: `/v3/projects/bd1b3d8735554a74b95a93f5c85eab41/users/607b35d349cb4d0b921b3b5eee582bcb/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:24.463475 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a57fc69-1c5a-4d40-85bf-ff9e38c44fae admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd1b3d8735554a74b95a93f5c85eab41, user_id=607b35d349cb4d0b921b3b5eee582bcb, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:24.466191 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a57fc69-1c5a-4d40-85bf-ff9e38c44fae admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:24.476792 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1409/2824] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:48:24 2022] PUT /identity/v3/projects/bd1b3d8735554a74b95a93f5c85eab41/users/607b35d349cb4d0b921b3b5eee582bcb/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:48:24.487300 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba1151-ee10-42c1-9338-59cc14502ba0 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:24.487595 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba1151-ee10-42c1-9338-59cc14502ba0 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:24.487872 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba1151-ee10-42c1-9338-59cc14502ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:24.515386 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-f2ba1151-ee10-42c1-9338-59cc14502ba0 None None] MFA Rules not processed for user `607b35d349cb4d0b921b3b5eee582bcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:48:24.516939 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-f2ba1151-ee10-42c1-9338-59cc14502ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:24.580696 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:48:24.591194 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1416/2825] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:48:24 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:48:24.602555 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a57fc69-1c5a-4d40-85bf-ff9e38c44fae admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:24.604504 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-6a57fc69-1c5a-4d40-85bf-ff9e38c44fae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:24.667281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a57fc69-1c5a-4d40-85bf-ff9e38c44fae admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:24.671311 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a2e01-b143-46bd-9b06-771f260dcb70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:24.671959 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a2e01-b143-46bd-9b06-771f260dcb70 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:24.672213 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a2e01-b143-46bd-9b06-771f260dcb70 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:24.672489 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a2e01-b143-46bd-9b06-771f260dcb70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:24.682775 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a2e01-b143-46bd-9b06-771f260dcb70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:24.684208 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a2e01-b143-46bd-9b06-771f260dcb70 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:24.694621 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1410/2826] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:48:24 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:48:24.776249 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba1151-ee10-42c1-9338-59cc14502ba0 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:24.842026 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba1151-ee10-42c1-9338-59cc14502ba0 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:24.847447 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bada81-1c68-44f1-b1ca-4292304ca285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:24.848334 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bada81-1c68-44f1-b1ca-4292304ca285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:24.848612 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bada81-1c68-44f1-b1ca-4292304ca285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:24.848877 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bada81-1c68-44f1-b1ca-4292304ca285 admin admin] PATH_INFO: `/v3/users/a6d304f1e5a743d587b04fdb1c73942e` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:24.850405 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bada81-1c68-44f1-b1ca-4292304ca285 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6d304f1e5a743d587b04fdb1c73942e)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:24.852366 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bada81-1c68-44f1-b1ca-4292304ca285 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:24.906195 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-f6bada81-1c68-44f1-b1ca-4292304ca285 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6d304f1e5a743d587b04fdb1c73942e'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:24.906917 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-f6bada81-1c68-44f1-b1ca-4292304ca285 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6d304f1e5a743d587b04fdb1c73942e'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:24.913788 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-f6bada81-1c68-44f1-b1ca-4292304ca285 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6d304f1e5a743d587b04fdb1c73942e'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:24.914502 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-f6bada81-1c68-44f1-b1ca-4292304ca285 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6d304f1e5a743d587b04fdb1c73942e'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:24.927325 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-f6bada81-1c68-44f1-b1ca-4292304ca285 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6d304f1e5a743d587b04fdb1c73942e'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:24.942468 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1417/2827] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:48:24 2022] DELETE /identity/v3/users/a6d304f1e5a743d587b04fdb1c73942e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:48:24.947483 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461308d7-93e8-4f31-a119-7fbaf42699ed None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:24.947798 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461308d7-93e8-4f31-a119-7fbaf42699ed None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:24.948076 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461308d7-93e8-4f31-a119-7fbaf42699ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:24.972813 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-461308d7-93e8-4f31-a119-7fbaf42699ed None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:48:24.974634 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-461308d7-93e8-4f31-a119-7fbaf42699ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:25.039124 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1411/2828] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:48:25.051478 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bada81-1c68-44f1-b1ca-4292304ca285 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:25.053078 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-f6bada81-1c68-44f1-b1ca-4292304ca285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:25.113553 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bada81-1c68-44f1-b1ca-4292304ca285 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:25.117748 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d94de-3778-4ad0-80d4-398d7a2d9bd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:25.118439 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d94de-3778-4ad0-80d4-398d7a2d9bd8 service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:25.118714 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d94de-3778-4ad0-80d4-398d7a2d9bd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:25.118986 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d94de-3778-4ad0-80d4-398d7a2d9bd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:25.128639 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d94de-3778-4ad0-80d4-398d7a2d9bd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:25.130104 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d94de-3778-4ad0-80d4-398d7a2d9bd8 service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:25.139614 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1418/2829] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:48:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:48:25.423548 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461308d7-93e8-4f31-a119-7fbaf42699ed None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:25.425304 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-461308d7-93e8-4f31-a119-7fbaf42699ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:25.440238 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461308d7-93e8-4f31-a119-7fbaf42699ed None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:25.446048 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986bcbcb-4d25-4d15-811f-eacff0ad2342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:25.446916 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bcbcb-4d25-4d15-811f-eacff0ad2342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:25.447329 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bcbcb-4d25-4d15-811f-eacff0ad2342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:25.447608 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bcbcb-4d25-4d15-811f-eacff0ad2342 admin admin] PATH_INFO: `/v3/projects/2da9f8bc4f8a4d7aa2a24864a15f2e51` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:25.448801 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986bcbcb-4d25-4d15-811f-eacff0ad2342 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2da9f8bc4f8a4d7aa2a24864a15f2e51)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:25.450754 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986bcbcb-4d25-4d15-811f-eacff0ad2342 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:25.501736 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-986bcbcb-4d25-4d15-811f-eacff0ad2342 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2da9f8bc4f8a4d7aa2a24864a15f2e51', 'request_id': 'req-986bcbcb-4d25-4d15-811f-eacff0ad2342'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:25.511911 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-986bcbcb-4d25-4d15-811f-eacff0ad2342 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2da9f8bc4f8a4d7aa2a24864a15f2e51', 'request_id': 'req-986bcbcb-4d25-4d15-811f-eacff0ad2342'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:25.518032 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-986bcbcb-4d25-4d15-811f-eacff0ad2342 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2da9f8bc4f8a4d7aa2a24864a15f2e51', 'request_id': 'req-986bcbcb-4d25-4d15-811f-eacff0ad2342'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:25.528979 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-986bcbcb-4d25-4d15-811f-eacff0ad2342 admin admin] The token cache is being invalidate because project 2da9f8bc4f8a4d7aa2a24864a15f2e51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:48:25.529263 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-986bcbcb-4d25-4d15-811f-eacff0ad2342 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:25.529940 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-986bcbcb-4d25-4d15-811f-eacff0ad2342 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:25.531518 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1412/2830] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:48:25 2022] DELETE /identity/v3/projects/2da9f8bc4f8a4d7aa2a24864a15f2e51 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:48:25.535744 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d94de-3778-4ad0-80d4-398d7a2d9bd8 service neutron] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:25.545862 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d94de-3778-4ad0-80d4-398d7a2d9bd8 service neutron] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:25.559057 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:48:25.607712 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dbf9ca-1048-468a-a5db-284479631ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:25.608602 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbf9ca-1048-468a-a5db-284479631ca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:25.608876 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbf9ca-1048-468a-a5db-284479631ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:25.609143 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbf9ca-1048-468a-a5db-284479631ca0 admin admin] PATH_INFO: `/v3/users/607b35d349cb4d0b921b3b5eee582bcb` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:25.610420 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dbf9ca-1048-468a-a5db-284479631ca0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=607b35d349cb4d0b921b3b5eee582bcb)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:25.612357 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dbf9ca-1048-468a-a5db-284479631ca0 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:25.662333 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-98dbf9ca-1048-468a-a5db-284479631ca0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '607b35d349cb4d0b921b3b5eee582bcb'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:25.663070 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-98dbf9ca-1048-468a-a5db-284479631ca0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '607b35d349cb4d0b921b3b5eee582bcb'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:25.670725 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-98dbf9ca-1048-468a-a5db-284479631ca0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '607b35d349cb4d0b921b3b5eee582bcb'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:25.671452 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-98dbf9ca-1048-468a-a5db-284479631ca0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '607b35d349cb4d0b921b3b5eee582bcb'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:25.685094 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-98dbf9ca-1048-468a-a5db-284479631ca0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '607b35d349cb4d0b921b3b5eee582bcb'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:25.703832 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1419/2831] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:48:25 2022] DELETE /identity/v3/users/607b35d349cb4d0b921b3b5eee582bcb => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:48:25.996432 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986bcbcb-4d25-4d15-811f-eacff0ad2342 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:25.998101 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-986bcbcb-4d25-4d15-811f-eacff0ad2342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:26.014580 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986bcbcb-4d25-4d15-811f-eacff0ad2342 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:26.028150 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:48:26.083992 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de76f17-dd22-4b90-b1f7-2d87a32280d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:26.084808 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de76f17-dd22-4b90-b1f7-2d87a32280d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:26.085090 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de76f17-dd22-4b90-b1f7-2d87a32280d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:26.085365 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de76f17-dd22-4b90-b1f7-2d87a32280d7 admin admin] PATH_INFO: `/v3/projects/bd1b3d8735554a74b95a93f5c85eab41` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:26.086872 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de76f17-dd22-4b90-b1f7-2d87a32280d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd1b3d8735554a74b95a93f5c85eab41)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:26.088794 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de76f17-dd22-4b90-b1f7-2d87a32280d7 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:26.139040 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6de76f17-dd22-4b90-b1f7-2d87a32280d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd1b3d8735554a74b95a93f5c85eab41', 'request_id': 'req-6de76f17-dd22-4b90-b1f7-2d87a32280d7'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:26.149267 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6de76f17-dd22-4b90-b1f7-2d87a32280d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd1b3d8735554a74b95a93f5c85eab41', 'request_id': 'req-6de76f17-dd22-4b90-b1f7-2d87a32280d7'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:26.154839 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6de76f17-dd22-4b90-b1f7-2d87a32280d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd1b3d8735554a74b95a93f5c85eab41', 'request_id': 'req-6de76f17-dd22-4b90-b1f7-2d87a32280d7'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:26.166200 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6de76f17-dd22-4b90-b1f7-2d87a32280d7 admin admin] The token cache is being invalidate because project bd1b3d8735554a74b95a93f5c85eab41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:48:26.166470 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6de76f17-dd22-4b90-b1f7-2d87a32280d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:26.167133 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-6de76f17-dd22-4b90-b1f7-2d87a32280d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:26.168733 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1413/2832] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:48:25 2022] DELETE /identity/v3/projects/bd1b3d8735554a74b95a93f5c85eab41 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:48:26.173814 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e5834-f269-462f-8e25-3413a565d317 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:26.174121 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e5834-f269-462f-8e25-3413a565d317 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:26.174398 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e5834-f269-462f-8e25-3413a565d317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:26.193355 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-096e5834-f269-462f-8e25-3413a565d317 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:48:26.194598 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-096e5834-f269-462f-8e25-3413a565d317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:26.257101 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1420/2833] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:48:26.266724 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55358ff4-86da-4903-99bb-e1081538a3eb None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:26.267041 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55358ff4-86da-4903-99bb-e1081538a3eb None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:26.267293 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55358ff4-86da-4903-99bb-e1081538a3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:26.286969 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-55358ff4-86da-4903-99bb-e1081538a3eb None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:48:26.288179 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-55358ff4-86da-4903-99bb-e1081538a3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:26.297464 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1414/2834] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:48:26.301794 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e5834-f269-462f-8e25-3413a565d317 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:26.312537 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e5834-f269-462f-8e25-3413a565d317 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:26.317599 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e633a31-d930-4041-a796-9b725a703750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:26.318295 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e633a31-d930-4041-a796-9b725a703750 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:26.318576 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e633a31-d930-4041-a796-9b725a703750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:26.318845 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e633a31-d930-4041-a796-9b725a703750 admin admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:26.319572 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e633a31-d930-4041-a796-9b725a703750 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:48:26.319873 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e633a31-d930-4041-a796-9b725a703750 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:26.322158 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e633a31-d930-4041-a796-9b725a703750 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:26.335223 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1421/2835] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:48:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:48:26.340379 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55358ff4-86da-4903-99bb-e1081538a3eb None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:26.350217 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55358ff4-86da-4903-99bb-e1081538a3eb None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:26.356389 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10eab6e-6335-48fd-8d6b-5bbb2be9c05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:26.357048 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10eab6e-6335-48fd-8d6b-5bbb2be9c05c admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:26.357323 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10eab6e-6335-48fd-8d6b-5bbb2be9c05c admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:26.357594 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10eab6e-6335-48fd-8d6b-5bbb2be9c05c admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:26.358319 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10eab6e-6335-48fd-8d6b-5bbb2be9c05c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:26.360202 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10eab6e-6335-48fd-8d6b-5bbb2be9c05c admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:26.391144 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1415/2836] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:48:26 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:48:26.395321 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e633a31-d930-4041-a796-9b725a703750 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:26.406349 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e633a31-d930-4041-a796-9b725a703750 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:26.426557 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:48:26.468055 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c829258-b33a-4370-be21-adc6d5352086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:26.468725 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c829258-b33a-4370-be21-adc6d5352086 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:26.469008 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c829258-b33a-4370-be21-adc6d5352086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:26.469283 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c829258-b33a-4370-be21-adc6d5352086 admin admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:26.469998 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c829258-b33a-4370-be21-adc6d5352086 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:26.471915 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c829258-b33a-4370-be21-adc6d5352086 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:26.496633 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1422/2837] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:48:26 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:48:26.502304 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10eab6e-6335-48fd-8d6b-5bbb2be9c05c admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:26.517338 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10eab6e-6335-48fd-8d6b-5bbb2be9c05c admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:26.524230 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c81f4a7-f8f8-428b-81b5-1d0e1a8fe0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:26.524918 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81f4a7-f8f8-428b-81b5-1d0e1a8fe0cf admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:26.525178 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81f4a7-f8f8-428b-81b5-1d0e1a8fe0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:26.525456 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81f4a7-f8f8-428b-81b5-1d0e1a8fe0cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:26.526240 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c81f4a7-f8f8-428b-81b5-1d0e1a8fe0cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:26.527886 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c81f4a7-f8f8-428b-81b5-1d0e1a8fe0cf admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:26.540250 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1416/2838] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 17:48:26.544769 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c829258-b33a-4370-be21-adc6d5352086 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:26.555753 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c829258-b33a-4370-be21-adc6d5352086 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:26.560924 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626c8fc-042e-4229-b335-72edcf6d13ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:26.561754 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626c8fc-042e-4229-b335-72edcf6d13ec admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:26.562091 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626c8fc-042e-4229-b335-72edcf6d13ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:26.562358 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626c8fc-042e-4229-b335-72edcf6d13ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:26.563079 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e626c8fc-042e-4229-b335-72edcf6d13ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:26.564670 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e626c8fc-042e-4229-b335-72edcf6d13ec admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:26.576410 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1423/2839] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:48:26.580692 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c81f4a7-f8f8-428b-81b5-1d0e1a8fe0cf admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:26.591723 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c81f4a7-f8f8-428b-81b5-1d0e1a8fe0cf admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:26.597544 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b42493-e6ce-4173-a9bd-1e9512ae099d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:26.598519 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b42493-e6ce-4173-a9bd-1e9512ae099d admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:26.598795 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b42493-e6ce-4173-a9bd-1e9512ae099d admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:26.599065 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b42493-e6ce-4173-a9bd-1e9512ae099d admin admin] PATH_INFO: `/v3/projects/bd88c83f43e043a29004f3072c3061bf/users/e13595850a8e485cab3f9c929620ecc6/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:26.615222 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b42493-e6ce-4173-a9bd-1e9512ae099d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd88c83f43e043a29004f3072c3061bf, user_id=e13595850a8e485cab3f9c929620ecc6, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:26.618638 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b42493-e6ce-4173-a9bd-1e9512ae099d admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:26.634133 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1417/2840] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:48:26 2022] PUT /identity/v3/projects/bd88c83f43e043a29004f3072c3061bf/users/e13595850a8e485cab3f9c929620ecc6/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:48:26.644697 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f61a08-9b33-4019-9c86-d78ba9a94364 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:26.644989 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f61a08-9b33-4019-9c86-d78ba9a94364 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:26.645278 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f61a08-9b33-4019-9c86-d78ba9a94364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:26.673068 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-77f61a08-9b33-4019-9c86-d78ba9a94364 None None] MFA Rules not processed for user `e13595850a8e485cab3f9c929620ecc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:48:26.674303 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-77f61a08-9b33-4019-9c86-d78ba9a94364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:26.751571 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1424/2841] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:48:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:48:26.758287 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b42493-e6ce-4173-a9bd-1e9512ae099d admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:26.804520 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:48:26.836247 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b42493-e6ce-4173-a9bd-1e9512ae099d admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:26.842546 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbce2c4e-c943-4262-a11d-92b186acaa9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:26.843149 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce2c4e-c943-4262-a11d-92b186acaa9a admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:26.843430 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce2c4e-c943-4262-a11d-92b186acaa9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:26.843702 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce2c4e-c943-4262-a11d-92b186acaa9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:26.844396 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbce2c4e-c943-4262-a11d-92b186acaa9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:26.846332 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbce2c4e-c943-4262-a11d-92b186acaa9a admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:26.875196 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1418/2842] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:48:26 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:48:26.879383 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f61a08-9b33-4019-9c86-d78ba9a94364 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:26.890853 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f61a08-9b33-4019-9c86-d78ba9a94364 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:26.948020 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a8b976-e72a-4d1b-9e57-26c9c17e4c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:26.948692 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8b976-e72a-4d1b-9e57-26c9c17e4c49 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:26.948973 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8b976-e72a-4d1b-9e57-26c9c17e4c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:26.949218 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8b976-e72a-4d1b-9e57-26c9c17e4c49 admin admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:26.949946 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a8b976-e72a-4d1b-9e57-26c9c17e4c49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:26.951866 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a8b976-e72a-4d1b-9e57-26c9c17e4c49 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:26.975178 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1425/2843] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:48:26 2022] POST /identity/v3/users => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 17:48:26.980301 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbce2c4e-c943-4262-a11d-92b186acaa9a admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:26.990923 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbce2c4e-c943-4262-a11d-92b186acaa9a admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:26.996109 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5227a-26fd-4218-8047-9c97dca1636c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:26.996788 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5227a-26fd-4218-8047-9c97dca1636c admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:26.997035 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5227a-26fd-4218-8047-9c97dca1636c admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:26.997317 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5227a-26fd-4218-8047-9c97dca1636c admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:26.998267 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a5227a-26fd-4218-8047-9c97dca1636c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:26.999872 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a5227a-26fd-4218-8047-9c97dca1636c admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:27.010428 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1419/2844] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:48:27.014656 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a8b976-e72a-4d1b-9e57-26c9c17e4c49 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:27.025042 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a8b976-e72a-4d1b-9e57-26c9c17e4c49 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:27.031808 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c671dd-d06e-4e97-81f9-b8b2a1f7f785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:27.032694 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c671dd-d06e-4e97-81f9-b8b2a1f7f785 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:27.032968 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c671dd-d06e-4e97-81f9-b8b2a1f7f785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:27.033237 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c671dd-d06e-4e97-81f9-b8b2a1f7f785 admin admin] PATH_INFO: `/v3/projects/df4335f8c520447cbd710cb013b15b7c/users/f6de4297a65a42f380bd030f0beb9014/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:27.050532 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c671dd-d06e-4e97-81f9-b8b2a1f7f785 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df4335f8c520447cbd710cb013b15b7c, user_id=f6de4297a65a42f380bd030f0beb9014, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:27.053277 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c671dd-d06e-4e97-81f9-b8b2a1f7f785 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:27.064077 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:48:27.070276 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1426/2845] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:48:27 2022] PUT /identity/v3/projects/df4335f8c520447cbd710cb013b15b7c/users/f6de4297a65a42f380bd030f0beb9014/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:48:27.074766 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5227a-26fd-4218-8047-9c97dca1636c admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:27.084882 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5227a-26fd-4218-8047-9c97dca1636c admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:27.144646 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5214fe4-ddd1-47c1-8383-16cd7fa2848d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:27.145235 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5214fe4-ddd1-47c1-8383-16cd7fa2848d admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:27.145638 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5214fe4-ddd1-47c1-8383-16cd7fa2848d admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:27.145949 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5214fe4-ddd1-47c1-8383-16cd7fa2848d admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:27.146703 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5214fe4-ddd1-47c1-8383-16cd7fa2848d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:27.148337 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5214fe4-ddd1-47c1-8383-16cd7fa2848d admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:27.159491 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1420/2846] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:48:27.163857 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c671dd-d06e-4e97-81f9-b8b2a1f7f785 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:27.175733 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c671dd-d06e-4e97-81f9-b8b2a1f7f785 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:27.181363 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8716661-1364-4dab-9ffd-139ec3301db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:27.182277 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8716661-1364-4dab-9ffd-139ec3301db8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:27.182552 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8716661-1364-4dab-9ffd-139ec3301db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:27.182822 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8716661-1364-4dab-9ffd-139ec3301db8 admin admin] PATH_INFO: `/v3/projects/df4335f8c520447cbd710cb013b15b7c/users/f6de4297a65a42f380bd030f0beb9014/roles/70d242b29ede4648b639c7ddae5eaead` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:27.185269 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8716661-1364-4dab-9ffd-139ec3301db8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df4335f8c520447cbd710cb013b15b7c, user_id=f6de4297a65a42f380bd030f0beb9014, role_id=70d242b29ede4648b639c7ddae5eaead)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:27.187978 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8716661-1364-4dab-9ffd-139ec3301db8 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:27.203209 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1427/2847] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:48:27 2022] PUT /identity/v3/projects/df4335f8c520447cbd710cb013b15b7c/users/f6de4297a65a42f380bd030f0beb9014/roles/70d242b29ede4648b639c7ddae5eaead => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:48:27.219023 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfcc7b-45b9-4aba-872c-24997e254016 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:27.219329 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfcc7b-45b9-4aba-872c-24997e254016 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:27.219724 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfcc7b-45b9-4aba-872c-24997e254016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:27.249540 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-55bfcc7b-45b9-4aba-872c-24997e254016 None None] MFA Rules not processed for user `f6de4297a65a42f380bd030f0beb9014`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:48:27.250788 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-55bfcc7b-45b9-4aba-872c-24997e254016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:27.331227 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1421/2848] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:48:27 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:48:27.342260 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8716661-1364-4dab-9ffd-139ec3301db8 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:27.344105 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-b8716661-1364-4dab-9ffd-139ec3301db8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:27.414698 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8716661-1364-4dab-9ffd-139ec3301db8 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:27.419397 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb95c1c-3f5c-4cd2-b553-99fc1c039076 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:27.420047 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb95c1c-3f5c-4cd2-b553-99fc1c039076 service cinder] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:27.420298 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb95c1c-3f5c-4cd2-b553-99fc1c039076 service cinder] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:27.420600 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb95c1c-3f5c-4cd2-b553-99fc1c039076 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:27.430702 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb95c1c-3f5c-4cd2-b553-99fc1c039076 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:27.432132 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb95c1c-3f5c-4cd2-b553-99fc1c039076 service cinder] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:27.442219 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1428/2849] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:48:27 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:48:28.018236 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfcc7b-45b9-4aba-872c-24997e254016 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:28.061424 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:48:28.085803 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfcc7b-45b9-4aba-872c-24997e254016 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:28.091218 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f6a6b7-1ae4-4a19-9d07-31f9df057815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:28.092107 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f6a6b7-1ae4-4a19-9d07-31f9df057815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:28.092390 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f6a6b7-1ae4-4a19-9d07-31f9df057815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:28.092663 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f6a6b7-1ae4-4a19-9d07-31f9df057815 admin admin] PATH_INFO: `/v3/users/e13595850a8e485cab3f9c929620ecc6` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:28.093917 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f6a6b7-1ae4-4a19-9d07-31f9df057815 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e13595850a8e485cab3f9c929620ecc6)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:28.095855 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f6a6b7-1ae4-4a19-9d07-31f9df057815 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:28.159662 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-57f6a6b7-1ae4-4a19-9d07-31f9df057815 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e13595850a8e485cab3f9c929620ecc6'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:28.160712 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-57f6a6b7-1ae4-4a19-9d07-31f9df057815 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e13595850a8e485cab3f9c929620ecc6'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:28.170573 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-57f6a6b7-1ae4-4a19-9d07-31f9df057815 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e13595850a8e485cab3f9c929620ecc6'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:28.183353 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-57f6a6b7-1ae4-4a19-9d07-31f9df057815 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e13595850a8e485cab3f9c929620ecc6'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:28.193627 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-57f6a6b7-1ae4-4a19-9d07-31f9df057815 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e13595850a8e485cab3f9c929620ecc6'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:28.200415 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1422/2850] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:48:28 2022] DELETE /identity/v3/users/e13595850a8e485cab3f9c929620ecc6 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:48:28.205211 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7228570-5222-4b05-a176-59718d9a2b31 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:28.205726 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7228570-5222-4b05-a176-59718d9a2b31 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:28.205844 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7228570-5222-4b05-a176-59718d9a2b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:28.224590 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-f7228570-5222-4b05-a176-59718d9a2b31 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:48:28.225851 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-f7228570-5222-4b05-a176-59718d9a2b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:28.288585 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1429/2851] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:48:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:48:28.299191 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f6a6b7-1ae4-4a19-9d07-31f9df057815 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:28.301112 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-57f6a6b7-1ae4-4a19-9d07-31f9df057815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:28.362703 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f6a6b7-1ae4-4a19-9d07-31f9df057815 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:28.366908 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65dea8c-959e-4835-b0a5-88e5757b6616 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:28.367618 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65dea8c-959e-4835-b0a5-88e5757b6616 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:28.367923 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65dea8c-959e-4835-b0a5-88e5757b6616 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:28.368200 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65dea8c-959e-4835-b0a5-88e5757b6616 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:28.378046 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65dea8c-959e-4835-b0a5-88e5757b6616 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:28.379487 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65dea8c-959e-4835-b0a5-88e5757b6616 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:28.389807 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1423/2852] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:48:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:48:28.679747 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7228570-5222-4b05-a176-59718d9a2b31 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:28.681621 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-f7228570-5222-4b05-a176-59718d9a2b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:28.700046 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7228570-5222-4b05-a176-59718d9a2b31 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:28.705125 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc2a14b-e246-4d8d-aa49-948555b3275a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:28.706053 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2a14b-e246-4d8d-aa49-948555b3275a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:28.706342 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2a14b-e246-4d8d-aa49-948555b3275a admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:28.706620 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2a14b-e246-4d8d-aa49-948555b3275a admin admin] PATH_INFO: `/v3/projects/bd88c83f43e043a29004f3072c3061bf` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:28.707840 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc2a14b-e246-4d8d-aa49-948555b3275a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd88c83f43e043a29004f3072c3061bf)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:28.709875 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc2a14b-e246-4d8d-aa49-948555b3275a admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:28.760622 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-efc2a14b-e246-4d8d-aa49-948555b3275a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd88c83f43e043a29004f3072c3061bf', 'request_id': 'req-efc2a14b-e246-4d8d-aa49-948555b3275a'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:28.769420 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-efc2a14b-e246-4d8d-aa49-948555b3275a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd88c83f43e043a29004f3072c3061bf', 'request_id': 'req-efc2a14b-e246-4d8d-aa49-948555b3275a'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:28.775711 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-efc2a14b-e246-4d8d-aa49-948555b3275a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd88c83f43e043a29004f3072c3061bf', 'request_id': 'req-efc2a14b-e246-4d8d-aa49-948555b3275a'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:28.787843 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-efc2a14b-e246-4d8d-aa49-948555b3275a admin admin] The token cache is being invalidate because project bd88c83f43e043a29004f3072c3061bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80150) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:48:28.788128 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-efc2a14b-e246-4d8d-aa49-948555b3275a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:28.788895 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-efc2a14b-e246-4d8d-aa49-948555b3275a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:28.790696 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1430/2853] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:48:28 2022] DELETE /identity/v3/projects/bd88c83f43e043a29004f3072c3061bf => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:48:28.794924 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65dea8c-959e-4835-b0a5-88e5757b6616 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:28.806510 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65dea8c-959e-4835-b0a5-88e5757b6616 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:28.891809 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d8141-54fa-42a5-917a-03371a400599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:28.892852 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d8141-54fa-42a5-917a-03371a400599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:28.893132 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d8141-54fa-42a5-917a-03371a400599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:28.893402 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d8141-54fa-42a5-917a-03371a400599 admin admin] PATH_INFO: `/v3/users/f6de4297a65a42f380bd030f0beb9014` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:28.894911 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156d8141-54fa-42a5-917a-03371a400599 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6de4297a65a42f380bd030f0beb9014)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:28.897396 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156d8141-54fa-42a5-917a-03371a400599 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:28.899197 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:48:28.961584 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-156d8141-54fa-42a5-917a-03371a400599 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6de4297a65a42f380bd030f0beb9014'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:28.962406 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-156d8141-54fa-42a5-917a-03371a400599 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6de4297a65a42f380bd030f0beb9014'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:28.972186 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-156d8141-54fa-42a5-917a-03371a400599 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6de4297a65a42f380bd030f0beb9014'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:28.986476 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-156d8141-54fa-42a5-917a-03371a400599 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6de4297a65a42f380bd030f0beb9014'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:29.000774 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-156d8141-54fa-42a5-917a-03371a400599 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6de4297a65a42f380bd030f0beb9014'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:29.007414 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1424/2854] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:48:28 2022] DELETE /identity/v3/users/f6de4297a65a42f380bd030f0beb9014 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:48:29.293477 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc2a14b-e246-4d8d-aa49-948555b3275a admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:29.295360 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-efc2a14b-e246-4d8d-aa49-948555b3275a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:29.318084 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc2a14b-e246-4d8d-aa49-948555b3275a admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:29.327535 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:48:29.376406 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2702b5-41ba-49b1-9443-c651d6317d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:29.377278 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2702b5-41ba-49b1-9443-c651d6317d2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:29.377603 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2702b5-41ba-49b1-9443-c651d6317d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:29.377848 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2702b5-41ba-49b1-9443-c651d6317d2a admin admin] PATH_INFO: `/v3/projects/df4335f8c520447cbd710cb013b15b7c` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:29.379016 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2702b5-41ba-49b1-9443-c651d6317d2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=df4335f8c520447cbd710cb013b15b7c)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:29.380911 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2702b5-41ba-49b1-9443-c651d6317d2a admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:29.432580 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-fb2702b5-41ba-49b1-9443-c651d6317d2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df4335f8c520447cbd710cb013b15b7c', 'request_id': 'req-fb2702b5-41ba-49b1-9443-c651d6317d2a'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:29.443063 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-fb2702b5-41ba-49b1-9443-c651d6317d2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df4335f8c520447cbd710cb013b15b7c', 'request_id': 'req-fb2702b5-41ba-49b1-9443-c651d6317d2a'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:29.449911 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-fb2702b5-41ba-49b1-9443-c651d6317d2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df4335f8c520447cbd710cb013b15b7c', 'request_id': 'req-fb2702b5-41ba-49b1-9443-c651d6317d2a'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:29.462189 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-fb2702b5-41ba-49b1-9443-c651d6317d2a admin admin] The token cache is being invalidate because project df4335f8c520447cbd710cb013b15b7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80150) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:48:29.462518 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-fb2702b5-41ba-49b1-9443-c651d6317d2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:29.463155 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-fb2702b5-41ba-49b1-9443-c651d6317d2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:29.464730 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1431/2855] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:48:29 2022] DELETE /identity/v3/projects/df4335f8c520447cbd710cb013b15b7c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:48:29.470269 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820b558-e8ac-44b2-8225-e11872dbcadc None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:29.470769 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820b558-e8ac-44b2-8225-e11872dbcadc None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:29.470869 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820b558-e8ac-44b2-8225-e11872dbcadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:29.489816 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-8820b558-e8ac-44b2-8225-e11872dbcadc None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:48:29.491037 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8820b558-e8ac-44b2-8225-e11872dbcadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:29.556900 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1425/2856] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:48:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:48:29.568262 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdb55d-e4b6-4741-ba0e-013d29ba5089 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:29.568633 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdb55d-e4b6-4741-ba0e-013d29ba5089 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:29.568958 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdb55d-e4b6-4741-ba0e-013d29ba5089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:29.588565 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-e9fdb55d-e4b6-4741-ba0e-013d29ba5089 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:48:29.589790 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-e9fdb55d-e4b6-4741-ba0e-013d29ba5089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:29.598785 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1432/2857] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:48:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:48:29.603701 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820b558-e8ac-44b2-8225-e11872dbcadc None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:29.614605 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820b558-e8ac-44b2-8225-e11872dbcadc None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:29.621404 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ba66d-cb28-49be-adc0-e718c4b97c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:29.622499 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ba66d-cb28-49be-adc0-e718c4b97c8c admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:29.622909 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ba66d-cb28-49be-adc0-e718c4b97c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:29.623356 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ba66d-cb28-49be-adc0-e718c4b97c8c admin admin] PATH_INFO: `/v3/domains` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:29.624543 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ba66d-cb28-49be-adc0-e718c4b97c8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80149) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:48:29.625036 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ba66d-cb28-49be-adc0-e718c4b97c8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:29.627650 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ba66d-cb28-49be-adc0-e718c4b97c8c admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:29.641879 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1426/2858] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:48:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 17:48:29.646869 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fdb55d-e4b6-4741-ba0e-013d29ba5089 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:29.661119 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fdb55d-e4b6-4741-ba0e-013d29ba5089 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:29.668199 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b381eb-64e2-4172-b94d-3680a8821507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:29.668879 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b381eb-64e2-4172-b94d-3680a8821507 admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:29.669151 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b381eb-64e2-4172-b94d-3680a8821507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:29.669420 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b381eb-64e2-4172-b94d-3680a8821507 admin admin] PATH_INFO: `/v3/projects` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:29.670162 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b381eb-64e2-4172-b94d-3680a8821507 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:29.672083 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b381eb-64e2-4172-b94d-3680a8821507 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:29.704769 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1433/2859] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:48:29 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:48:29.709155 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ba66d-cb28-49be-adc0-e718c4b97c8c admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:29.720021 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ba66d-cb28-49be-adc0-e718c4b97c8c admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:29.776883 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834df2b7-5073-47c0-bad2-638aafcf11d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:29.777549 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834df2b7-5073-47c0-bad2-638aafcf11d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:29.777828 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834df2b7-5073-47c0-bad2-638aafcf11d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:29.778243 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834df2b7-5073-47c0-bad2-638aafcf11d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:29.778928 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834df2b7-5073-47c0-bad2-638aafcf11d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:29.780840 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834df2b7-5073-47c0-bad2-638aafcf11d9 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:29.791173 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:48:29.806301 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1427/2860] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:48:29 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:48:29.810474 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b381eb-64e2-4172-b94d-3680a8821507 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:29.822905 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b381eb-64e2-4172-b94d-3680a8821507 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:29.829012 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d9499-6e9a-42ba-94ea-76bdb474080c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:29.829686 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d9499-6e9a-42ba-94ea-76bdb474080c admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:29.829995 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d9499-6e9a-42ba-94ea-76bdb474080c admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:29.830269 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d9499-6e9a-42ba-94ea-76bdb474080c admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:29.830997 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d9499-6e9a-42ba-94ea-76bdb474080c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:29.832604 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d9499-6e9a-42ba-94ea-76bdb474080c admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:29.844562 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1434/2861] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:48:29.848974 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834df2b7-5073-47c0-bad2-638aafcf11d9 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:29.860423 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834df2b7-5073-47c0-bad2-638aafcf11d9 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:29.865838 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ee5d1-a7a9-4539-9887-5eb5a58b32c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:29.866531 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ee5d1-a7a9-4539-9887-5eb5a58b32c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:29.866818 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ee5d1-a7a9-4539-9887-5eb5a58b32c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:29.867084 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ee5d1-a7a9-4539-9887-5eb5a58b32c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:29.867985 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ee5d1-a7a9-4539-9887-5eb5a58b32c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:29.869704 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ee5d1-a7a9-4539-9887-5eb5a58b32c0 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:29.879957 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1428/2862] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:48:29.884432 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d9499-6e9a-42ba-94ea-76bdb474080c admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:29.899043 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d9499-6e9a-42ba-94ea-76bdb474080c admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:29.905404 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3113c9b-e348-483f-bf80-f2533ab88231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:29.906345 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3113c9b-e348-483f-bf80-f2533ab88231 admin admin] REQUEST_METHOD: `PUT` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:29.906626 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3113c9b-e348-483f-bf80-f2533ab88231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:29.906929 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3113c9b-e348-483f-bf80-f2533ab88231 admin admin] PATH_INFO: `/v3/projects/4bf1b49d0b7a4d4d955db6a502a44434/users/9c754d71d18348ef906176987f6ef8b5/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:29.922492 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3113c9b-e348-483f-bf80-f2533ab88231 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bf1b49d0b7a4d4d955db6a502a44434, user_id=9c754d71d18348ef906176987f6ef8b5, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:29.925744 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3113c9b-e348-483f-bf80-f2533ab88231 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:29.942831 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1435/2863] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:48:29 2022] PUT /identity/v3/projects/4bf1b49d0b7a4d4d955db6a502a44434/users/9c754d71d18348ef906176987f6ef8b5/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:48:29.954257 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb52ce-654c-4c18-a460-984b7a729f34 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:29.954565 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb52ce-654c-4c18-a460-984b7a729f34 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:29.954844 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb52ce-654c-4c18-a460-984b7a729f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:29.988151 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-69bb52ce-654c-4c18-a460-984b7a729f34 None None] MFA Rules not processed for user `9c754d71d18348ef906176987f6ef8b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:48:29.990071 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-69bb52ce-654c-4c18-a460-984b7a729f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:30.072636 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1429/2864] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:48:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 17:48:30.084458 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3113c9b-e348-483f-bf80-f2533ab88231 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:30.086820 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-b3113c9b-e348-483f-bf80-f2533ab88231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:30.130534 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:48:30.148796 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3113c9b-e348-483f-bf80-f2533ab88231 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:30.153327 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11463b30-8177-4e77-b0bf-913103a9e108 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14775984c9d4463a8e8848dcf189714b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:30.154014 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11463b30-8177-4e77-b0bf-913103a9e108 service glance] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:30.154296 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11463b30-8177-4e77-b0bf-913103a9e108 service glance] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:30.154606 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11463b30-8177-4e77-b0bf-913103a9e108 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:30.163078 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11463b30-8177-4e77-b0bf-913103a9e108 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:30.164688 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11463b30-8177-4e77-b0bf-913103a9e108 service glance] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:30.174154 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1436/2865] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:48:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:48:40.069239 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=39 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:48:40.169939 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=9 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:48:43.978158 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb52ce-654c-4c18-a460-984b7a729f34 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:43.980112 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-69bb52ce-654c-4c18-a460-984b7a729f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:44.042394 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb52ce-654c-4c18-a460-984b7a729f34 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:44.047156 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38890ff8-6a2a-4178-b26a-95a577831abd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:44.047817 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38890ff8-6a2a-4178-b26a-95a577831abd service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:44.048081 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38890ff8-6a2a-4178-b26a-95a577831abd service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:44.048345 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38890ff8-6a2a-4178-b26a-95a577831abd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:44.050422 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-38890ff8-6a2a-4178-b26a-95a577831abd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:44.060529 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38890ff8-6a2a-4178-b26a-95a577831abd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:44.061989 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38890ff8-6a2a-4178-b26a-95a577831abd service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:44.070681 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1430/2866] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:48:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:48:48.960349 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11463b30-8177-4e77-b0bf-913103a9e108 service glance] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:49.024091 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11463b30-8177-4e77-b0bf-913103a9e108 service glance] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:49.030374 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42ae93-aedd-4b91-89fe-a3f3dc9ad424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:49.031289 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42ae93-aedd-4b91-89fe-a3f3dc9ad424 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:49.031535 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42ae93-aedd-4b91-89fe-a3f3dc9ad424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:49.031804 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42ae93-aedd-4b91-89fe-a3f3dc9ad424 admin admin] PATH_INFO: `/v3/users/9c754d71d18348ef906176987f6ef8b5` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:49.033089 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a42ae93-aedd-4b91-89fe-a3f3dc9ad424 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c754d71d18348ef906176987f6ef8b5)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:49.035020 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a42ae93-aedd-4b91-89fe-a3f3dc9ad424 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:49.086315 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-3a42ae93-aedd-4b91-89fe-a3f3dc9ad424 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c754d71d18348ef906176987f6ef8b5'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:49.086971 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-3a42ae93-aedd-4b91-89fe-a3f3dc9ad424 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c754d71d18348ef906176987f6ef8b5'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:49.093700 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-3a42ae93-aedd-4b91-89fe-a3f3dc9ad424 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c754d71d18348ef906176987f6ef8b5'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:49.094348 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-3a42ae93-aedd-4b91-89fe-a3f3dc9ad424 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c754d71d18348ef906176987f6ef8b5'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:49.106369 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-3a42ae93-aedd-4b91-89fe-a3f3dc9ad424 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c754d71d18348ef906176987f6ef8b5'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:49.121653 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1437/2867] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:48:48 2022] DELETE /identity/v3/users/9c754d71d18348ef906176987f6ef8b5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:48:49.126701 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27fa0a6-3748-4685-af05-edb23daec5ae None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:49.127281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27fa0a6-3748-4685-af05-edb23daec5ae None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:49.127281 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27fa0a6-3748-4685-af05-edb23daec5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:49.144547 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-b27fa0a6-3748-4685-af05-edb23daec5ae None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:48:49.145919 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b27fa0a6-3748-4685-af05-edb23daec5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:49.209261 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1431/2868] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:48:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:48:49.220478 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42ae93-aedd-4b91-89fe-a3f3dc9ad424 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:49.223048 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-3a42ae93-aedd-4b91-89fe-a3f3dc9ad424 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:49.285031 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42ae93-aedd-4b91-89fe-a3f3dc9ad424 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:49.288941 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318a4dd-eedc-4209-89de-40a8c0d0b9b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:49.289592 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318a4dd-eedc-4209-89de-40a8c0d0b9b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:49.289897 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318a4dd-eedc-4209-89de-40a8c0d0b9b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:49.290167 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318a4dd-eedc-4209-89de-40a8c0d0b9b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:49.300501 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318a4dd-eedc-4209-89de-40a8c0d0b9b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:49.302041 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318a4dd-eedc-4209-89de-40a8c0d0b9b9 service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:49.312144 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1438/2869] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:48:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:48:49.597711 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27fa0a6-3748-4685-af05-edb23daec5ae None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:49.599253 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-b27fa0a6-3748-4685-af05-edb23daec5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:49.612185 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27fa0a6-3748-4685-af05-edb23daec5ae None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:49.617339 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393b333-b5bf-4ca2-9968-d0f232c42815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:49.618263 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393b333-b5bf-4ca2-9968-d0f232c42815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:49.618539 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393b333-b5bf-4ca2-9968-d0f232c42815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:49.618813 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393b333-b5bf-4ca2-9968-d0f232c42815 admin admin] PATH_INFO: `/v3/projects/4bf1b49d0b7a4d4d955db6a502a44434` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:49.620656 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393b333-b5bf-4ca2-9968-d0f232c42815 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bf1b49d0b7a4d4d955db6a502a44434)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:49.622238 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393b333-b5bf-4ca2-9968-d0f232c42815 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:49.681950 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f393b333-b5bf-4ca2-9968-d0f232c42815 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bf1b49d0b7a4d4d955db6a502a44434', 'request_id': 'req-f393b333-b5bf-4ca2-9968-d0f232c42815'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:49.694200 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f393b333-b5bf-4ca2-9968-d0f232c42815 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bf1b49d0b7a4d4d955db6a502a44434', 'request_id': 'req-f393b333-b5bf-4ca2-9968-d0f232c42815'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:49.700571 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f393b333-b5bf-4ca2-9968-d0f232c42815 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bf1b49d0b7a4d4d955db6a502a44434', 'request_id': 'req-f393b333-b5bf-4ca2-9968-d0f232c42815'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:49.712344 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f393b333-b5bf-4ca2-9968-d0f232c42815 admin admin] The token cache is being invalidate because project 4bf1b49d0b7a4d4d955db6a502a44434 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:48:49.712522 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f393b333-b5bf-4ca2-9968-d0f232c42815 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:49.713229 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-f393b333-b5bf-4ca2-9968-d0f232c42815 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:48:49.714862 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1432/2870] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:48:49 2022] DELETE /identity/v3/projects/4bf1b49d0b7a4d4d955db6a502a44434 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:48:49.721224 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29c71a-79d3-44a2-a6bd-3fa732b55a51 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:49.721512 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29c71a-79d3-44a2-a6bd-3fa732b55a51 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:49.721872 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29c71a-79d3-44a2-a6bd-3fa732b55a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:49.741211 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-0f29c71a-79d3-44a2-a6bd-3fa732b55a51 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:48:49.742455 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-0f29c71a-79d3-44a2-a6bd-3fa732b55a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:49.761410 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:48:49.810580 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1439/2871] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:48:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:48:49.876100 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d00eda-9396-492b-8566-dccfe0423cf6 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:49.876778 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d00eda-9396-492b-8566-dccfe0423cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:49.877462 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d00eda-9396-492b-8566-dccfe0423cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:49.903222 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-38d00eda-9396-492b-8566-dccfe0423cf6 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:48:49.904441 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-38d00eda-9396-492b-8566-dccfe0423cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:49.914600 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1433/2872] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:48:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:48:49.919425 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29c71a-79d3-44a2-a6bd-3fa732b55a51 None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:49.930208 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29c71a-79d3-44a2-a6bd-3fa732b55a51 None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:49.935158 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca5454-f0d4-496d-8c9c-7ab850f478e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:49.935811 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca5454-f0d4-496d-8c9c-7ab850f478e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:49.936084 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca5454-f0d4-496d-8c9c-7ab850f478e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:49.936356 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca5454-f0d4-496d-8c9c-7ab850f478e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:49.937081 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ca5454-f0d4-496d-8c9c-7ab850f478e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80150) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 17:48:49.937381 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ca5454-f0d4-496d-8c9c-7ab850f478e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:49.939010 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ca5454-f0d4-496d-8c9c-7ab850f478e4 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:49.951959 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1440/2873] 10.222.0.27 () {58 vars in 1152 bytes} [Fri Jul 15 17:48:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 17:48:49.956546 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d00eda-9396-492b-8566-dccfe0423cf6 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:49.966516 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d00eda-9396-492b-8566-dccfe0423cf6 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:49.972344 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc53182-e7f7-46b2-915f-a4b29a05802c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:49.973004 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc53182-e7f7-46b2-915f-a4b29a05802c admin admin] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:49.973286 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc53182-e7f7-46b2-915f-a4b29a05802c admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:49.973558 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc53182-e7f7-46b2-915f-a4b29a05802c admin admin] PATH_INFO: `/v3/projects` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:49.974312 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc53182-e7f7-46b2-915f-a4b29a05802c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:49.976220 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc53182-e7f7-46b2-915f-a4b29a05802c admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:50.006006 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:48:50.015414 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1434/2874] 10.222.0.27 () {60 vars in 1152 bytes} [Fri Jul 15 17:48:49 2022] POST /identity/v3/projects => generated 381 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 17:48:50.020161 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca5454-f0d4-496d-8c9c-7ab850f478e4 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:50.030445 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca5454-f0d4-496d-8c9c-7ab850f478e4 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:50.092180 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128fcab5-2430-492c-ba8d-20568b8351ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:50.092860 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fcab5-2430-492c-ba8d-20568b8351ea admin admin] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:50.093139 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fcab5-2430-492c-ba8d-20568b8351ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:50.093417 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fcab5-2430-492c-ba8d-20568b8351ea admin admin] PATH_INFO: `/v3/users` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:50.094267 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128fcab5-2430-492c-ba8d-20568b8351ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:50.096608 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128fcab5-2430-492c-ba8d-20568b8351ea admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:50.120079 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1441/2875] 10.222.0.27 () {60 vars in 1143 bytes} [Fri Jul 15 17:48:50 2022] POST /identity/v3/users => generated 291 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 17:48:50.124557 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc53182-e7f7-46b2-915f-a4b29a05802c admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:50.137200 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc53182-e7f7-46b2-915f-a4b29a05802c admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:50.142022 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d6b922-0caf-4086-8a3c-f0c902d3de3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:50.142706 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6b922-0caf-4086-8a3c-f0c902d3de3f admin admin] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:50.142995 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6b922-0caf-4086-8a3c-f0c902d3de3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:50.143336 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6b922-0caf-4086-8a3c-f0c902d3de3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:50.144076 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d6b922-0caf-4086-8a3c-f0c902d3de3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:50.145719 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d6b922-0caf-4086-8a3c-f0c902d3de3f admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:50.157384 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1435/2876] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:48:50.161979 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128fcab5-2430-492c-ba8d-20568b8351ea admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:50.172417 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128fcab5-2430-492c-ba8d-20568b8351ea admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:50.177765 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81fcaa-9057-4967-8271-cf8fa9e9e4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:50.178458 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81fcaa-9057-4967-8271-cf8fa9e9e4b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:50.178772 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81fcaa-9057-4967-8271-cf8fa9e9e4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:50.179045 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81fcaa-9057-4967-8271-cf8fa9e9e4b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:50.179775 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81fcaa-9057-4967-8271-cf8fa9e9e4b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:50.181365 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81fcaa-9057-4967-8271-cf8fa9e9e4b2 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:50.191799 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1442/2877] 10.222.0.27 () {58 vars in 1121 bytes} [Fri Jul 15 17:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 17:48:50.196376 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d6b922-0caf-4086-8a3c-f0c902d3de3f admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:50.210744 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d6b922-0caf-4086-8a3c-f0c902d3de3f admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:50.216290 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90534166-de98-40e8-9b77-e82bcb49e21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:50.217344 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90534166-de98-40e8-9b77-e82bcb49e21e admin admin] REQUEST_METHOD: `PUT` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:50.217553 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90534166-de98-40e8-9b77-e82bcb49e21e admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:50.217855 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90534166-de98-40e8-9b77-e82bcb49e21e admin admin] PATH_INFO: `/v3/projects/7a6db2ae2b7f496c9a20cde7844a8e6c/users/633932aeedd64b05b9c2e492c037fd90/roles/d8d52b8fc62e44cd9d551b855f2ac84b` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:50.233486 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90534166-de98-40e8-9b77-e82bcb49e21e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a6db2ae2b7f496c9a20cde7844a8e6c, user_id=633932aeedd64b05b9c2e492c037fd90, role_id=d8d52b8fc62e44cd9d551b855f2ac84b)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:50.236250 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90534166-de98-40e8-9b77-e82bcb49e21e admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:50.252668 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1436/2878] 10.222.0.27 () {60 vars in 1482 bytes} [Fri Jul 15 17:48:50 2022] PUT /identity/v3/projects/7a6db2ae2b7f496c9a20cde7844a8e6c/users/633932aeedd64b05b9c2e492c037fd90/roles/d8d52b8fc62e44cd9d551b855f2ac84b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:48:50.257917 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83339260-baca-46c9-bb2c-2b482cc6d74f None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:50.258207 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83339260-baca-46c9-bb2c-2b482cc6d74f None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:50.258485 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83339260-baca-46c9-bb2c-2b482cc6d74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:50.276377 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-83339260-baca-46c9-bb2c-2b482cc6d74f None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:48:50.277571 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-83339260-baca-46c9-bb2c-2b482cc6d74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:50.347847 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1443/2879] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:48:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:48:50.358477 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90534166-de98-40e8-9b77-e82bcb49e21e admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:50.360859 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-90534166-de98-40e8-9b77-e82bcb49e21e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:50.426560 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90534166-de98-40e8-9b77-e82bcb49e21e admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:50.431236 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd91df9a-2a7e-479d-9329-7a270a52e082 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:50.431890 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91df9a-2a7e-479d-9329-7a270a52e082 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:50.432172 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91df9a-2a7e-479d-9329-7a270a52e082 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:50.432441 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91df9a-2a7e-479d-9329-7a270a52e082 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:50.443405 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd91df9a-2a7e-479d-9329-7a270a52e082 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:50.444851 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd91df9a-2a7e-479d-9329-7a270a52e082 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:50.454905 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1437/2880] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:48:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:48:51.365104 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67011a-68a6-498e-9ff0-6b919c49fb3f None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:51.365625 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67011a-68a6-498e-9ff0-6b919c49fb3f None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:51.365625 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67011a-68a6-498e-9ff0-6b919c49fb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:51.396348 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-4d67011a-68a6-498e-9ff0-6b919c49fb3f None None] MFA Rules not processed for user `633932aeedd64b05b9c2e492c037fd90`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:48:51.397574 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-4d67011a-68a6-498e-9ff0-6b919c49fb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:51.416175 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:48:51.467530 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1444/2881] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:48:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:48:51.479112 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd91df9a-2a7e-479d-9329-7a270a52e082 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:51.480820 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-dd91df9a-2a7e-479d-9329-7a270a52e082 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:51.543651 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd91df9a-2a7e-479d-9329-7a270a52e082 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:51.548895 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f6135c-920f-48fe-9390-2b31ad912cc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b8121d0b0d4eef818b2a8b3508df18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:51.549792 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6135c-920f-48fe-9390-2b31ad912cc4 service cinder] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:51.550087 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6135c-920f-48fe-9390-2b31ad912cc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:51.550362 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6135c-920f-48fe-9390-2b31ad912cc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:51.560926 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f6135c-920f-48fe-9390-2b31ad912cc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:51.562666 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f6135c-920f-48fe-9390-2b31ad912cc4 service cinder] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:51.572714 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1438/2882] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:48:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:48:52.927105 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7f816-8692-45be-a052-0415633b996f None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:52.927658 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7f816-8692-45be-a052-0415633b996f None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:52.927658 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7f816-8692-45be-a052-0415633b996f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:52.946740 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-11b7f816-8692-45be-a052-0415633b996f None None] MFA Rules not processed for user `633932aeedd64b05b9c2e492c037fd90`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:48:52.947950 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-11b7f816-8692-45be-a052-0415633b996f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:52.956299 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1445/2883] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:48:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:48:53.193236 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f6135c-920f-48fe-9390-2b31ad912cc4 service cinder] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:53.194752 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-53f6135c-920f-48fe-9390-2b31ad912cc4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:53.207277 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f6135c-920f-48fe-9390-2b31ad912cc4 service cinder] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:53.211647 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87ff3c-1ef2-45d5-916a-95d2dd06def8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:53.212301 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87ff3c-1ef2-45d5-916a-95d2dd06def8 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:53.212583 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87ff3c-1ef2-45d5-916a-95d2dd06def8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:53.212857 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87ff3c-1ef2-45d5-916a-95d2dd06def8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:53.214816 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-db87ff3c-1ef2-45d5-916a-95d2dd06def8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:53.226694 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db87ff3c-1ef2-45d5-916a-95d2dd06def8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:53.228380 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db87ff3c-1ef2-45d5-916a-95d2dd06def8 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:53.237999 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1439/2884] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:48:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:48:53.568391 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7f816-8692-45be-a052-0415633b996f None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:53.569976 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-11b7f816-8692-45be-a052-0415633b996f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:53.642884 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7f816-8692-45be-a052-0415633b996f None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:53.648396 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682794c-f59f-45a4-a1ca-ba7486045652 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96b2105f8d29443383ed51a8fd5cec6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:53.649045 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682794c-f59f-45a4-a1ca-ba7486045652 service placement] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:53.649323 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682794c-f59f-45a4-a1ca-ba7486045652 service placement] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:53.649594 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682794c-f59f-45a4-a1ca-ba7486045652 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:53.651489 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-a682794c-f59f-45a4-a1ca-ba7486045652 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:53.663147 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a682794c-f59f-45a4-a1ca-ba7486045652 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:53.664713 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a682794c-f59f-45a4-a1ca-ba7486045652 service placement] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:53.674463 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1446/2885] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:48:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:48:55.944080 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87ff3c-1ef2-45d5-916a-95d2dd06def8 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:48:55.945818 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-db87ff3c-1ef2-45d5-916a-95d2dd06def8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:56.003726 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:48:56.025525 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87ff3c-1ef2-45d5-916a-95d2dd06def8 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:48:56.031373 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ffd36-2d86-4a97-83dd-6dd90b5f9d82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:48:56.032043 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ffd36-2d86-4a97-83dd-6dd90b5f9d82 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:48:56.032321 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ffd36-2d86-4a97-83dd-6dd90b5f9d82 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:48:56.032586 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ffd36-2d86-4a97-83dd-6dd90b5f9d82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:48:56.034473 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5b8ffd36-2d86-4a97-83dd-6dd90b5f9d82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:48:56.048177 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ffd36-2d86-4a97-83dd-6dd90b5f9d82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:48:56.049759 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ffd36-2d86-4a97-83dd-6dd90b5f9d82 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:48:56.060745 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1440/2886] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:48:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:49:02.660232 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682794c-f59f-45a4-a1ca-ba7486045652 service placement] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:49:02.677745 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682794c-f59f-45a4-a1ca-ba7486045652 service placement] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:49:02.684298 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c97b1-fc5c-4d09-a204-19edfd9fa2ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:49:02.684949 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c97b1-fc5c-4d09-a204-19edfd9fa2ef service nova] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:49:02.685231 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c97b1-fc5c-4d09-a204-19edfd9fa2ef service nova] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:49:02.685498 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c97b1-fc5c-4d09-a204-19edfd9fa2ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:49:02.687532 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-509c97b1-fc5c-4d09-a204-19edfd9fa2ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:49:02.700672 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c97b1-fc5c-4d09-a204-19edfd9fa2ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:49:02.702299 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c97b1-fc5c-4d09-a204-19edfd9fa2ef service nova] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:49:02.713493 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1447/2887] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:49:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:49:06.056170 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=9 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:49:12.709609 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=60 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:49:25.700694 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762c0c0-3981-4d3e-9f94-5d85711425ce None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:49:25.701270 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762c0c0-3981-4d3e-9f94-5d85711425ce None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:49:25.701270 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762c0c0-3981-4d3e-9f94-5d85711425ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:49:25.721325 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-8762c0c0-3981-4d3e-9f94-5d85711425ce None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:49:25.722578 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-8762c0c0-3981-4d3e-9f94-5d85711425ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:49:25.731920 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1441/2888] 10.222.0.69 () {58 vars in 1016 bytes} [Fri Jul 15 17:49:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:49:25.750885 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c97b1-fc5c-4d09-a204-19edfd9fa2ef service nova] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:49:25.752647 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-509c97b1-fc5c-4d09-a204-19edfd9fa2ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:49:25.767310 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c97b1-fc5c-4d09-a204-19edfd9fa2ef service nova] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:49:25.774421 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73891a-e750-49c7-9f9d-eb4b630232c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:49:25.775071 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73891a-e750-49c7-9f9d-eb4b630232c9 service nova] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:49:25.775360 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73891a-e750-49c7-9f9d-eb4b630232c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:49:25.775634 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73891a-e750-49c7-9f9d-eb4b630232c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:49:25.784537 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c73891a-e750-49c7-9f9d-eb4b630232c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:49:25.786766 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c73891a-e750-49c7-9f9d-eb4b630232c9 service nova] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:49:25.796394 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1448/2889] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:49:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:49:29.789065 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a4449-f816-4722-b0c0-f084621b2d6b None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:49:29.789703 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a4449-f816-4722-b0c0-f084621b2d6b None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:49:29.789703 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a4449-f816-4722-b0c0-f084621b2d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:49:29.809452 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-116a4449-f816-4722-b0c0-f084621b2d6b None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:49:29.810721 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-116a4449-f816-4722-b0c0-f084621b2d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:49:29.820749 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1442/2890] 10.222.0.69 () {58 vars in 1016 bytes} [Fri Jul 15 17:49:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:49:29.846085 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73891a-e750-49c7-9f9d-eb4b630232c9 service nova] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:49:29.860975 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73891a-e750-49c7-9f9d-eb4b630232c9 service nova] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:49:29.869446 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47633e4f-52d7-4641-b61b-95af8ef2314f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:49:29.870137 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47633e4f-52d7-4641-b61b-95af8ef2314f service nova] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:49:29.870411 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47633e4f-52d7-4641-b61b-95af8ef2314f service nova] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:49:29.870685 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47633e4f-52d7-4641-b61b-95af8ef2314f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:49:29.880293 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47633e4f-52d7-4641-b61b-95af8ef2314f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:49:29.882054 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47633e4f-52d7-4641-b61b-95af8ef2314f service nova] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:49:29.893073 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1449/2891] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:49:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:49:33.063420 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfa8ae-1d05-470a-9287-c7157226e19f None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:49:33.064025 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfa8ae-1d05-470a-9287-c7157226e19f None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:49:33.064025 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfa8ae-1d05-470a-9287-c7157226e19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:49:33.084526 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-f5cfa8ae-1d05-470a-9287-c7157226e19f None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:49:33.085803 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-f5cfa8ae-1d05-470a-9287-c7157226e19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:49:33.095568 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1443/2892] 10.222.0.69 () {58 vars in 1016 bytes} [Fri Jul 15 17:49:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:49:33.114000 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47633e4f-52d7-4641-b61b-95af8ef2314f service nova] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:49:33.126750 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47633e4f-52d7-4641-b61b-95af8ef2314f service nova] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:49:33.134949 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c5b2d-e0df-436b-90b5-dc786c62305c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:49:33.135585 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c5b2d-e0df-436b-90b5-dc786c62305c service nova] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:49:33.135869 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c5b2d-e0df-436b-90b5-dc786c62305c service nova] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:49:33.136133 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c5b2d-e0df-436b-90b5-dc786c62305c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:49:33.145240 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953c5b2d-e0df-436b-90b5-dc786c62305c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:49:33.146860 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953c5b2d-e0df-436b-90b5-dc786c62305c service nova] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:49:33.156883 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1450/2893] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:49:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:49:36.219473 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f4266-6a64-412d-95db-3587fa2e0916 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:49:36.220040 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f4266-6a64-412d-95db-3587fa2e0916 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:49:36.220040 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f4266-6a64-412d-95db-3587fa2e0916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:49:36.239528 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-683f4266-6a64-412d-95db-3587fa2e0916 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:49:36.240734 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-683f4266-6a64-412d-95db-3587fa2e0916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:49:36.249990 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1444/2894] 10.222.0.69 () {58 vars in 1016 bytes} [Fri Jul 15 17:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:49:36.266290 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c5b2d-e0df-436b-90b5-dc786c62305c service nova] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:49:36.278327 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c5b2d-e0df-436b-90b5-dc786c62305c service nova] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:49:36.284851 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2036954-df13-477b-b02c-e8c0f7ebea08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:49:36.285491 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2036954-df13-477b-b02c-e8c0f7ebea08 service nova] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:49:36.285793 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2036954-df13-477b-b02c-e8c0f7ebea08 service nova] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:49:36.286089 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2036954-df13-477b-b02c-e8c0f7ebea08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:49:36.295585 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2036954-df13-477b-b02c-e8c0f7ebea08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:49:36.297104 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2036954-df13-477b-b02c-e8c0f7ebea08 service nova] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:49:36.307977 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1451/2895] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:49:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:49:40.397742 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84551e65-21a9-496e-8275-fb8fb161885f None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:49:40.398299 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84551e65-21a9-496e-8275-fb8fb161885f None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:49:40.398404 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84551e65-21a9-496e-8275-fb8fb161885f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:49:40.418024 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-84551e65-21a9-496e-8275-fb8fb161885f None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:49:40.419237 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-84551e65-21a9-496e-8275-fb8fb161885f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:49:40.428274 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1445/2896] 10.222.0.69 () {58 vars in 1016 bytes} [Fri Jul 15 17:49:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:49:40.446468 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2036954-df13-477b-b02c-e8c0f7ebea08 service nova] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:49:40.458727 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2036954-df13-477b-b02c-e8c0f7ebea08 service nova] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:49:40.466459 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29eaa8-f76a-4391-a190-b86b96c8f152 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:49:40.467389 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29eaa8-f76a-4391-a190-b86b96c8f152 service nova] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:49:40.467811 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29eaa8-f76a-4391-a190-b86b96c8f152 service nova] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:49:40.468216 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29eaa8-f76a-4391-a190-b86b96c8f152 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:49:40.479814 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f29eaa8-f76a-4391-a190-b86b96c8f152 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:49:40.481501 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f29eaa8-f76a-4391-a190-b86b96c8f152 service nova] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:49:40.491435 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1452/2897] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:49:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:49:43.586326 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe72b7d-d761-4781-89a8-b0d59cd0d65a None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:49:43.586841 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe72b7d-d761-4781-89a8-b0d59cd0d65a None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:49:43.586942 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe72b7d-d761-4781-89a8-b0d59cd0d65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:49:43.605555 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-1fe72b7d-d761-4781-89a8-b0d59cd0d65a None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:49:43.606807 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-1fe72b7d-d761-4781-89a8-b0d59cd0d65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:49:43.614809 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1446/2898] 10.222.0.69 () {58 vars in 1016 bytes} [Fri Jul 15 17:49:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:49:43.631225 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29eaa8-f76a-4391-a190-b86b96c8f152 service nova] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:49:43.642625 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29eaa8-f76a-4391-a190-b86b96c8f152 service nova] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:49:43.648390 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a26e7-dedf-4d80-abc8-2f7136acebb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:49:43.649051 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a26e7-dedf-4d80-abc8-2f7136acebb8 service nova] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:49:43.649329 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a26e7-dedf-4d80-abc8-2f7136acebb8 service nova] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:49:43.649597 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a26e7-dedf-4d80-abc8-2f7136acebb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:49:43.658113 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a26e7-dedf-4d80-abc8-2f7136acebb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:49:43.659681 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a26e7-dedf-4d80-abc8-2f7136acebb8 service nova] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:49:43.669129 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1453/2899] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:49:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:49:53.600410 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=18 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:49:53.664811 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=36 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:49:57.994159 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7471c38-83bd-4c45-a733-7eda0e94d819 None None] REQUEST_METHOD: `POST` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:49:57.994679 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7471c38-83bd-4c45-a733-7eda0e94d819 None None] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:49:57.994679 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7471c38-83bd-4c45-a733-7eda0e94d819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:49:58.013879 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.auth.core [None req-a7471c38-83bd-4c45-a733-7eda0e94d819 None None] MFA Rules not processed for user `633932aeedd64b05b9c2e492c037fd90`. Rule list: `[]` (Enabled: `True`). {{(pid=80149) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:49:58.015077 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-a7471c38-83bd-4c45-a733-7eda0e94d819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:49:58.023402 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1447/2900] 10.222.0.27 () {58 vars in 957 bytes} [Fri Jul 15 17:49:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:50:08.008132 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=3 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:50:11.962045 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593d691-eac6-40c0-a577-04718feb7593 None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:50:11.962574 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593d691-eac6-40c0-a577-04718feb7593 None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:50:11.962574 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593d691-eac6-40c0-a577-04718feb7593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:50:11.981569 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-2593d691-eac6-40c0-a577-04718feb7593 None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:50:11.982818 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-2593d691-eac6-40c0-a577-04718feb7593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:50:11.992308 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1454/2901] 10.222.0.69 () {58 vars in 1016 bytes} [Fri Jul 15 17:50:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:50:12.005829 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7471c38-83bd-4c45-a733-7eda0e94d819 None None] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:50:12.020452 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7471c38-83bd-4c45-a733-7eda0e94d819 None None] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:50:12.027130 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7afa09-6f99-436e-9544-2fc073a709f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:50:12.027744 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7afa09-6f99-436e-9544-2fc073a709f5 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:50:12.028219 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7afa09-6f99-436e-9544-2fc073a709f5 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:50:12.028498 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7afa09-6f99-436e-9544-2fc073a709f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:50:12.040787 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7afa09-6f99-436e-9544-2fc073a709f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:50:12.043077 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7afa09-6f99-436e-9544-2fc073a709f5 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:50:12.054529 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1448/2902] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:50:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:50:15.262935 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4b1fd-1715-431c-affa-784fef1d773c None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:50:15.263468 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4b1fd-1715-431c-affa-784fef1d773c None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:50:15.263468 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4b1fd-1715-431c-affa-784fef1d773c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:50:15.282310 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-cee4b1fd-1715-431c-affa-784fef1d773c None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:50:15.283715 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-cee4b1fd-1715-431c-affa-784fef1d773c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:50:15.293136 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1455/2903] 10.222.0.69 () {58 vars in 1016 bytes} [Fri Jul 15 17:50:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:50:15.308872 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7afa09-6f99-436e-9544-2fc073a709f5 service nova] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:50:15.321466 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7afa09-6f99-436e-9544-2fc073a709f5 service nova] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:50:15.328049 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06e73f-1135-4772-a98a-b7d3b2935eac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:50:15.328704 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06e73f-1135-4772-a98a-b7d3b2935eac service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:50:15.328986 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06e73f-1135-4772-a98a-b7d3b2935eac service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:50:15.329258 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06e73f-1135-4772-a98a-b7d3b2935eac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:50:15.339127 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd06e73f-1135-4772-a98a-b7d3b2935eac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:50:15.340707 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd06e73f-1135-4772-a98a-b7d3b2935eac service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:50:15.351023 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1449/2904] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:50:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:50:18.349133 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16919b-fb90-4ca6-b689-3e689b0ee28f None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:50:18.349685 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16919b-fb90-4ca6-b689-3e689b0ee28f None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:50:18.349685 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16919b-fb90-4ca6-b689-3e689b0ee28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:50:18.369144 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-6b16919b-fb90-4ca6-b689-3e689b0ee28f None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:50:18.370399 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-6b16919b-fb90-4ca6-b689-3e689b0ee28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:50:18.379701 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1456/2905] 10.222.0.69 () {58 vars in 1016 bytes} [Fri Jul 15 17:50:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:50:18.395082 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06e73f-1135-4772-a98a-b7d3b2935eac service nova] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:50:18.406944 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06e73f-1135-4772-a98a-b7d3b2935eac service nova] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:50:18.414363 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5667c-ec64-4178-9842-2187426c40f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:50:18.415007 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5667c-ec64-4178-9842-2187426c40f3 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:50:18.415287 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5667c-ec64-4178-9842-2187426c40f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:50:18.415563 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5667c-ec64-4178-9842-2187426c40f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:50:18.425375 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc5667c-ec64-4178-9842-2187426c40f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:50:18.426985 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc5667c-ec64-4178-9842-2187426c40f3 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:50:18.437459 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1450/2906] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:50:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:50:21.511072 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ecb25-a666-4e8d-9a40-864bc077581a None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:50:21.511555 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ecb25-a666-4e8d-9a40-864bc077581a None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:50:21.511668 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ecb25-a666-4e8d-9a40-864bc077581a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:50:21.530645 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-7d9ecb25-a666-4e8d-9a40-864bc077581a None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:50:21.531826 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-7d9ecb25-a666-4e8d-9a40-864bc077581a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:50:21.540442 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1457/2907] 10.222.0.69 () {58 vars in 1016 bytes} [Fri Jul 15 17:50:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:50:21.561667 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5667c-ec64-4178-9842-2187426c40f3 service nova] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:50:21.574534 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5667c-ec64-4178-9842-2187426c40f3 service nova] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:50:21.581120 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6ba42-04ff-4275-b21b-d4d42e36a1e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:50:21.581770 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6ba42-04ff-4275-b21b-d4d42e36a1e3 service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:50:21.582076 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6ba42-04ff-4275-b21b-d4d42e36a1e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:50:21.582352 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6ba42-04ff-4275-b21b-d4d42e36a1e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:50:21.590650 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a6ba42-04ff-4275-b21b-d4d42e36a1e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:50:21.592232 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a6ba42-04ff-4275-b21b-d4d42e36a1e3 service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:50:21.602319 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1451/2908] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:50:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:50:25.757415 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bb083-fed0-4471-bdf6-d74691c71f1b None None] REQUEST_METHOD: `POST` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:50:25.757976 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bb083-fed0-4471-bdf6-d74691c71f1b None None] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:50:25.757976 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bb083-fed0-4471-bdf6-d74691c71f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:50:25.784320 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.auth.core [None req-e46bb083-fed0-4471-bdf6-d74691c71f1b None None] MFA Rules not processed for user `23aa6e5135404cb6a45a96628c2e41d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80150) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 17:50:25.785511 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-e46bb083-fed0-4471-bdf6-d74691c71f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:50:25.794886 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1458/2909] 10.222.0.69 () {58 vars in 1016 bytes} [Fri Jul 15 17:50:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 17:50:25.815822 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6ba42-04ff-4275-b21b-d4d42e36a1e3 service nova] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:50:25.827404 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6ba42-04ff-4275-b21b-d4d42e36a1e3 service nova] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:50:25.833370 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee3c3e-e1cc-4100-9b1c-06d03200149e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9d548c8199e4fdbbce7597bebd63421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:50:25.834031 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee3c3e-e1cc-4100-9b1c-06d03200149e service nova] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:50:25.834311 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee3c3e-e1cc-4100-9b1c-06d03200149e service nova] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:50:25.834579 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee3c3e-e1cc-4100-9b1c-06d03200149e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:50:25.842878 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee3c3e-e1cc-4100-9b1c-06d03200149e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:50:25.844450 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee3c3e-e1cc-4100-9b1c-06d03200149e service nova] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:50:25.853891 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1452/2910] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:50:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:50:35.776213 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=15 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:50:35.849741 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=30 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:50:51.214616 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46bb083-fed0-4471-bdf6-d74691c71f1b None None] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:50:51.216209 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-e46bb083-fed0-4471-bdf6-d74691c71f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:50:51.231641 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46bb083-fed0-4471-bdf6-d74691c71f1b None None] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:50:51.237428 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7affa9b-d23e-45a3-a995-0164c9f8a798 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96b2105f8d29443383ed51a8fd5cec6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:50:51.238059 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7affa9b-d23e-45a3-a995-0164c9f8a798 service placement] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:50:51.238354 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7affa9b-d23e-45a3-a995-0164c9f8a798 service placement] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:50:51.238628 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7affa9b-d23e-45a3-a995-0164c9f8a798 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:50:51.240652 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-e7affa9b-d23e-45a3-a995-0164c9f8a798 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:50:51.253894 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7affa9b-d23e-45a3-a995-0164c9f8a798 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:50:51.255605 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7affa9b-d23e-45a3-a995-0164c9f8a798 service placement] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:50:51.267015 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1459/2911] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:50:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:50:55.419887 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee3c3e-e1cc-4100-9b1c-06d03200149e service nova] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:50:55.430051 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee3c3e-e1cc-4100-9b1c-06d03200149e service nova] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:50:55.435613 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fc5d4-4ea4-4673-acc8-4cba0fc021f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:50:55.436857 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fc5d4-4ea4-4673-acc8-4cba0fc021f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:50:55.437189 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fc5d4-4ea4-4673-acc8-4cba0fc021f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:50:55.437338 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fc5d4-4ea4-4673-acc8-4cba0fc021f1 admin admin] PATH_INFO: `/v3/users/633932aeedd64b05b9c2e492c037fd90` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:50:55.438564 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8fc5d4-4ea4-4673-acc8-4cba0fc021f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=633932aeedd64b05b9c2e492c037fd90)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:50:55.440764 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8fc5d4-4ea4-4673-acc8-4cba0fc021f1 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:50:55.496639 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-3e8fc5d4-4ea4-4673-acc8-4cba0fc021f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '633932aeedd64b05b9c2e492c037fd90'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:50:55.497368 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-3e8fc5d4-4ea4-4673-acc8-4cba0fc021f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '633932aeedd64b05b9c2e492c037fd90'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:50:55.505301 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-3e8fc5d4-4ea4-4673-acc8-4cba0fc021f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '633932aeedd64b05b9c2e492c037fd90'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:50:55.520805 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-3e8fc5d4-4ea4-4673-acc8-4cba0fc021f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '633932aeedd64b05b9c2e492c037fd90'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:50:55.532148 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-3e8fc5d4-4ea4-4673-acc8-4cba0fc021f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '633932aeedd64b05b9c2e492c037fd90'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:50:55.539810 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1453/2912] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:50:55 2022] DELETE /identity/v3/users/633932aeedd64b05b9c2e492c037fd90 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:50:55.736363 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7affa9b-d23e-45a3-a995-0164c9f8a798 service placement] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:50:55.747732 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7affa9b-d23e-45a3-a995-0164c9f8a798 service placement] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:50:55.823092 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44044d-684f-42ab-b43a-58173477c20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:50:55.823984 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44044d-684f-42ab-b43a-58173477c20c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:50:55.824261 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44044d-684f-42ab-b43a-58173477c20c admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:50:55.824529 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44044d-684f-42ab-b43a-58173477c20c admin admin] PATH_INFO: `/v3/projects/7a6db2ae2b7f496c9a20cde7844a8e6c` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:50:55.825725 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44044d-684f-42ab-b43a-58173477c20c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a6db2ae2b7f496c9a20cde7844a8e6c)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:50:55.828021 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44044d-684f-42ab-b43a-58173477c20c admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:50:55.894335 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-5e44044d-684f-42ab-b43a-58173477c20c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a6db2ae2b7f496c9a20cde7844a8e6c', 'request_id': 'req-5e44044d-684f-42ab-b43a-58173477c20c'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:50:55.904477 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-5e44044d-684f-42ab-b43a-58173477c20c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a6db2ae2b7f496c9a20cde7844a8e6c', 'request_id': 'req-5e44044d-684f-42ab-b43a-58173477c20c'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:50:55.914715 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-5e44044d-684f-42ab-b43a-58173477c20c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a6db2ae2b7f496c9a20cde7844a8e6c', 'request_id': 'req-5e44044d-684f-42ab-b43a-58173477c20c'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:50:55.927676 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-5e44044d-684f-42ab-b43a-58173477c20c admin admin] The token cache is being invalidate because project 7a6db2ae2b7f496c9a20cde7844a8e6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80150) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:50:55.927952 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-5e44044d-684f-42ab-b43a-58173477c20c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:50:55.928599 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-5e44044d-684f-42ab-b43a-58173477c20c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:50:55.930382 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1460/2913] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:50:55 2022] DELETE /identity/v3/projects/7a6db2ae2b7f496c9a20cde7844a8e6c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 17:51:05.535022 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:51:05.924702 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:51:14.077905 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fc5d4-4ea4-4673-acc8-4cba0fc021f1 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:51:14.079655 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-3e8fc5d4-4ea4-4673-acc8-4cba0fc021f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:51:14.140641 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fc5d4-4ea4-4673-acc8-4cba0fc021f1 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:51:14.193147 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6a8cb-4731-4f4b-b3bf-9ae2d38645de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:51:14.194065 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6a8cb-4731-4f4b-b3bf-9ae2d38645de service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:51:14.194343 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6a8cb-4731-4f4b-b3bf-9ae2d38645de service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:51:14.194663 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6a8cb-4731-4f4b-b3bf-9ae2d38645de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:51:14.196850 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-fff6a8cb-4731-4f4b-b3bf-9ae2d38645de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:51:14.210144 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6a8cb-4731-4f4b-b3bf-9ae2d38645de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:51:14.211561 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6a8cb-4731-4f4b-b3bf-9ae2d38645de service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:51:14.219518 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1454/2914] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:51:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:51:15.303744 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44044d-684f-42ab-b43a-58173477c20c admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:51:15.305121 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-5e44044d-684f-42ab-b43a-58173477c20c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:51:15.319688 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44044d-684f-42ab-b43a-58173477c20c admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:51:15.324329 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197fb250-3b24-4fad-8dd6-3c9647eb845f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:51:15.324981 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197fb250-3b24-4fad-8dd6-3c9647eb845f service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:51:15.325258 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197fb250-3b24-4fad-8dd6-3c9647eb845f service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:51:15.325526 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197fb250-3b24-4fad-8dd6-3c9647eb845f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:51:15.327446 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-197fb250-3b24-4fad-8dd6-3c9647eb845f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:51:15.402316 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197fb250-3b24-4fad-8dd6-3c9647eb845f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:51:15.403763 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197fb250-3b24-4fad-8dd6-3c9647eb845f service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:51:15.414787 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1461/2915] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:51:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:51:24.216229 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=46 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:51:25.409972 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=34 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:53:03.833297 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6a8cb-4731-4f4b-b3bf-9ae2d38645de service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:53:03.842871 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6a8cb-4731-4f4b-b3bf-9ae2d38645de service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:53:03.847544 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbbf6dd-6bbe-4d8a-85d1-84181a1030a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:53:03.848186 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbf6dd-6bbe-4d8a-85d1-84181a1030a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:53:03.848462 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbf6dd-6bbe-4d8a-85d1-84181a1030a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:53:03.848728 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbf6dd-6bbe-4d8a-85d1-84181a1030a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:53:03.850875 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5bbbf6dd-6bbe-4d8a-85d1-84181a1030a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:53:03.920009 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbbf6dd-6bbe-4d8a-85d1-84181a1030a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:53:03.921476 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbbf6dd-6bbe-4d8a-85d1-84181a1030a9 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:53:03.931494 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1455/2916] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:53:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:53:07.396774 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197fb250-3b24-4fad-8dd6-3c9647eb845f service neutron] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:53:07.398510 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-197fb250-3b24-4fad-8dd6-3c9647eb845f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:53:07.409943 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197fb250-3b24-4fad-8dd6-3c9647eb845f service neutron] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:53:07.415007 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40711c3d-d664-4e50-9ca1-de7f0c45adb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:53:07.416238 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40711c3d-d664-4e50-9ca1-de7f0c45adb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:53:07.417163 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40711c3d-d664-4e50-9ca1-de7f0c45adb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:53:07.417756 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40711c3d-d664-4e50-9ca1-de7f0c45adb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:53:07.420638 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-40711c3d-d664-4e50-9ca1-de7f0c45adb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:53:07.436762 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40711c3d-d664-4e50-9ca1-de7f0c45adb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:53:07.438255 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40711c3d-d664-4e50-9ca1-de7f0c45adb4 service neutron] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:53:07.452087 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1462/2917] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:53:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:53:08.780869 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbbf6dd-6bbe-4d8a-85d1-84181a1030a9 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:53:08.790201 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbbf6dd-6bbe-4d8a-85d1-84181a1030a9 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:53:08.794137 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8331b7-9711-4a93-9dad-0d1cd2efe150 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989272e5e803405d87d0833d503bb572', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:53:08.794786 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8331b7-9711-4a93-9dad-0d1cd2efe150 service neutron] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:53:08.795102 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8331b7-9711-4a93-9dad-0d1cd2efe150 service neutron] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:53:08.795376 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8331b7-9711-4a93-9dad-0d1cd2efe150 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:53:08.797181 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-5b8331b7-9711-4a93-9dad-0d1cd2efe150 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:53:08.868664 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8331b7-9711-4a93-9dad-0d1cd2efe150 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:53:08.870050 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8331b7-9711-4a93-9dad-0d1cd2efe150 service neutron] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:53:08.881235 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1456/2918] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:53:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:53:12.026914 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40711c3d-d664-4e50-9ca1-de7f0c45adb4 service neutron] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:53:12.028544 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-40711c3d-d664-4e50-9ca1-de7f0c45adb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:53:12.115469 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40711c3d-d664-4e50-9ca1-de7f0c45adb4 service neutron] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:53:12.121836 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d4cea-3e3f-4a89-b1f3-9f49d0e345c6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96b2105f8d29443383ed51a8fd5cec6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:53:12.122663 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d4cea-3e3f-4a89-b1f3-9f49d0e345c6 service placement] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:53:12.122950 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d4cea-3e3f-4a89-b1f3-9f49d0e345c6 service placement] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:53:12.123253 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d4cea-3e3f-4a89-b1f3-9f49d0e345c6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:53:12.125420 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-dd5d4cea-3e3f-4a89-b1f3-9f49d0e345c6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:53:12.138884 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d4cea-3e3f-4a89-b1f3-9f49d0e345c6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:53:12.140497 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d4cea-3e3f-4a89-b1f3-9f49d0e345c6 service placement] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:53:12.152616 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1463/2919] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:53:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:53:15.243136 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8331b7-9711-4a93-9dad-0d1cd2efe150 service neutron] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:53:15.266029 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8331b7-9711-4a93-9dad-0d1cd2efe150 service neutron] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:53:15.271625 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b2ab9-6eff-4b8c-a886-26e621af9c86 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96b2105f8d29443383ed51a8fd5cec6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:53:15.272380 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b2ab9-6eff-4b8c-a886-26e621af9c86 service placement] REQUEST_METHOD: `GET` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:53:15.273712 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b2ab9-6eff-4b8c-a886-26e621af9c86 service placement] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:53:15.274187 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b2ab9-6eff-4b8c-a886-26e621af9c86 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:53:15.276533 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-833b2ab9-6eff-4b8c-a886-26e621af9c86 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:53:15.303948 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d4cea-3e3f-4a89-b1f3-9f49d0e345c6 service placement] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:53:15.305701 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-dd5d4cea-3e3f-4a89-b1f3-9f49d0e345c6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:53:15.321333 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833b2ab9-6eff-4b8c-a886-26e621af9c86 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:53:15.323237 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833b2ab9-6eff-4b8c-a886-26e621af9c86 service placement] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:53:15.328765 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d4cea-3e3f-4a89-b1f3-9f49d0e345c6 service placement] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:53:15.335114 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb4d55-85bd-4709-bc34-b6e1c59bec53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:53:15.336254 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb4d55-85bd-4709-bc34-b6e1c59bec53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:53:15.336543 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1457/2920] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:53:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:53:15.336653 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb4d55-85bd-4709-bc34-b6e1c59bec53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:53:15.337027 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb4d55-85bd-4709-bc34-b6e1c59bec53 admin admin] PATH_INFO: `/v3/users/7973259c53bb4553883f61bef4eda02f` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:53:15.338383 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb4d55-85bd-4709-bc34-b6e1c59bec53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7973259c53bb4553883f61bef4eda02f)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:53:15.340371 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb4d55-85bd-4709-bc34-b6e1c59bec53 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:53:15.392004 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-25cb4d55-85bd-4709-bc34-b6e1c59bec53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7973259c53bb4553883f61bef4eda02f'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:53:15.392718 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-25cb4d55-85bd-4709-bc34-b6e1c59bec53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7973259c53bb4553883f61bef4eda02f'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:53:15.399509 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-25cb4d55-85bd-4709-bc34-b6e1c59bec53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7973259c53bb4553883f61bef4eda02f'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:53:15.400131 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-25cb4d55-85bd-4709-bc34-b6e1c59bec53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7973259c53bb4553883f61bef4eda02f'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:53:15.412002 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-25cb4d55-85bd-4709-bc34-b6e1c59bec53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7973259c53bb4553883f61bef4eda02f'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:53:15.426275 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1464/2921] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:53:15 2022] DELETE /identity/v3/users/7973259c53bb4553883f61bef4eda02f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:53:15.619620 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b2ab9-6eff-4b8c-a886-26e621af9c86 service placement] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:53:15.631656 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b2ab9-6eff-4b8c-a886-26e621af9c86 service placement] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:53:15.689384 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782155e0-34ac-48ee-9db0-0a3a76367ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:53:15.690302 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782155e0-34ac-48ee-9db0-0a3a76367ca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:53:15.690589 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782155e0-34ac-48ee-9db0-0a3a76367ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:53:15.690863 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782155e0-34ac-48ee-9db0-0a3a76367ca4 admin admin] PATH_INFO: `/v3/projects/565c6a28899d4190a048fa762c84751a` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:53:15.692072 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782155e0-34ac-48ee-9db0-0a3a76367ca4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=565c6a28899d4190a048fa762c84751a)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:53:15.694053 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782155e0-34ac-48ee-9db0-0a3a76367ca4 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:53:15.716822 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:SELECT=100 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:53:15.741759 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-782155e0-34ac-48ee-9db0-0a3a76367ca4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '565c6a28899d4190a048fa762c84751a', 'request_id': 'req-782155e0-34ac-48ee-9db0-0a3a76367ca4'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:53:15.749758 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-782155e0-34ac-48ee-9db0-0a3a76367ca4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '565c6a28899d4190a048fa762c84751a', 'request_id': 'req-782155e0-34ac-48ee-9db0-0a3a76367ca4'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:53:15.755201 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-782155e0-34ac-48ee-9db0-0a3a76367ca4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '565c6a28899d4190a048fa762c84751a', 'request_id': 'req-782155e0-34ac-48ee-9db0-0a3a76367ca4'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:53:15.766118 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-782155e0-34ac-48ee-9db0-0a3a76367ca4 admin admin] The token cache is being invalidate because project 565c6a28899d4190a048fa762c84751a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:53:15.766404 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-782155e0-34ac-48ee-9db0-0a3a76367ca4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:53:15.767023 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-782155e0-34ac-48ee-9db0-0a3a76367ca4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:53:15.768604 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1458/2922] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:53:15 2022] DELETE /identity/v3/projects/565c6a28899d4190a048fa762c84751a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:53:15.772861 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb4d55-85bd-4709-bc34-b6e1c59bec53 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:53:15.774380 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-25cb4d55-85bd-4709-bc34-b6e1c59bec53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:53:15.787832 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb4d55-85bd-4709-bc34-b6e1c59bec53 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:53:15.834832 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:53:15.849055 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f9dfe-a0ee-4a6c-a763-32ecbe0fcc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:53:15.849988 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f9dfe-a0ee-4a6c-a763-32ecbe0fcc23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:53:15.850274 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f9dfe-a0ee-4a6c-a763-32ecbe0fcc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:53:15.850547 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f9dfe-a0ee-4a6c-a763-32ecbe0fcc23 admin admin] PATH_INFO: `/v3/users/18128d7347e640568d9511840116e1db` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:53:15.851919 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7f9dfe-a0ee-4a6c-a763-32ecbe0fcc23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18128d7347e640568d9511840116e1db)` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:53:15.853911 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7f9dfe-a0ee-4a6c-a763-32ecbe0fcc23 admin admin] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:53:15.902607 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-4f7f9dfe-a0ee-4a6c-a763-32ecbe0fcc23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18128d7347e640568d9511840116e1db'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:53:15.903246 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-4f7f9dfe-a0ee-4a6c-a763-32ecbe0fcc23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18128d7347e640568d9511840116e1db'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:53:15.910475 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-4f7f9dfe-a0ee-4a6c-a763-32ecbe0fcc23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18128d7347e640568d9511840116e1db'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:53:15.911135 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-4f7f9dfe-a0ee-4a6c-a763-32ecbe0fcc23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18128d7347e640568d9511840116e1db'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:53:15.923781 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.notifications [None req-4f7f9dfe-a0ee-4a6c-a763-32ecbe0fcc23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18128d7347e640568d9511840116e1db'} {{(pid=80150) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:53:15.938307 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1465/2923] 10.222.0.27 () {58 vars in 1223 bytes} [Fri Jul 15 17:53:15 2022] DELETE /identity/v3/users/18128d7347e640568d9511840116e1db => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:53:16.115671 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782155e0-34ac-48ee-9db0-0a3a76367ca4 admin admin] Authenticating user token {{(pid=80149) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:53:16.117500 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.fernet_utils [None req-782155e0-34ac-48ee-9db0-0a3a76367ca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80149) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:53:16.130899 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782155e0-34ac-48ee-9db0-0a3a76367ca4 admin admin] Validating token access rules against request {{(pid=80149) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:53:16.189222 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dde932-c506-4f11-b151-a76bf3edf588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aa6e5135404cb6a45a96628c2e41d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c32a3d29e5f4e56a46352866cc5acd0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80149) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:53:16.190126 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dde932-c506-4f11-b151-a76bf3edf588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:53:16.190404 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dde932-c506-4f11-b151-a76bf3edf588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:53:16.190666 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dde932-c506-4f11-b151-a76bf3edf588 admin admin] PATH_INFO: `/v3/projects/58bbbdcc8cf347e1bcee758500b4e27f` {{(pid=80149) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:53:16.191856 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dde932-c506-4f11-b151-a76bf3edf588 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58bbbdcc8cf347e1bcee758500b4e27f)` {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:53:16.193749 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dde932-c506-4f11-b151-a76bf3edf588 admin admin] RBAC: Authorization granted {{(pid=80149) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:53:16.242531 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-77dde932-c506-4f11-b151-a76bf3edf588 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58bbbdcc8cf347e1bcee758500b4e27f', 'request_id': 'req-77dde932-c506-4f11-b151-a76bf3edf588'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:53:16.251318 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-77dde932-c506-4f11-b151-a76bf3edf588 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58bbbdcc8cf347e1bcee758500b4e27f', 'request_id': 'req-77dde932-c506-4f11-b151-a76bf3edf588'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:53:16.257436 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-77dde932-c506-4f11-b151-a76bf3edf588 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58bbbdcc8cf347e1bcee758500b4e27f', 'request_id': 'req-77dde932-c506-4f11-b151-a76bf3edf588'} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:53:16.268631 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-77dde932-c506-4f11-b151-a76bf3edf588 admin admin] The token cache is being invalidate because project 58bbbdcc8cf347e1bcee758500b4e27f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80149) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 17:53:16.268917 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-77dde932-c506-4f11-b151-a76bf3edf588 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:53:16.269606 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG keystone.notifications [None req-77dde932-c506-4f11-b151-a76bf3edf588 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80149) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 17:53:16.271181 dv-cinder-836973-11-smb devstack@keystone.service[80149]: [pid: 80149|app: 0|req: 1459/2924] 10.222.0.27 () {58 vars in 1232 bytes} [Fri Jul 15 17:53:16 2022] DELETE /identity/v3/projects/58bbbdcc8cf347e1bcee758500b4e27f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 17:53:25.935050 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=31,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:53:26.265925 dv-cinder-836973-11-smb devstack@keystone.service[80149]: DEBUG dbcounter [-] [80149] Writing DB stats keystone:DELETE=14,keystone:SELECT=66,keystone:INSERT=2 {{(pid=80149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 17:55:54.189702 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f9dfe-a0ee-4a6c-a763-32ecbe0fcc23 admin admin] Authenticating user token {{(pid=80150) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 17:55:54.191419 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-4f7f9dfe-a0ee-4a6c-a763-32ecbe0fcc23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:55:54.380543 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f9dfe-a0ee-4a6c-a763-32ecbe0fcc23 admin admin] Validating token access rules against request {{(pid=80150) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 17:55:54.448937 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f85e77f-e300-428d-934a-d559dbb81ced service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96b2105f8d29443383ed51a8fd5cec6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19cc5221b8074f48b5f73dc9c4289b03', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80150) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 17:55:54.449522 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85e77f-e300-428d-934a-d559dbb81ced service placement] REQUEST_METHOD: `GET` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 17:55:54.449831 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85e77f-e300-428d-934a-d559dbb81ced service placement] SCRIPT_NAME: `/identity` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 17:55:54.450109 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85e77f-e300-428d-934a-d559dbb81ced service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80150) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 17:55:54.452668 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.fernet_utils [None req-0f85e77f-e300-428d-934a-d559dbb81ced service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80150) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 17:55:54.465938 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f85e77f-e300-428d-934a-d559dbb81ced service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 17:55:54.467555 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f85e77f-e300-428d-934a-d559dbb81ced service placement] RBAC: Authorization granted {{(pid=80150) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 17:55:54.482446 dv-cinder-836973-11-smb devstack@keystone.service[80150]: [pid: 80150|app: 0|req: 1466/2925] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Jul 15 17:55:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 17:56:04.475194 dv-cinder-836973-11-smb devstack@keystone.service[80150]: DEBUG dbcounter [-] [80150] Writing DB stats keystone:SELECT=89 {{(pid=80150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}